skip to main content
research-article

Fortunettes: Feedforward about the Future State of GUI Widgets

Authors Info & Claims
Published:13 June 2019Publication History
Skip Abstract Section

Abstract

Feedback is commonly used to explain what happened in an interface. What if questions, on the other hand, remain mostly unanswered. In this paper, we present the concept of enhanced widgets capable of visualizing their future state, which helps users to understand what will happen without committing to an action. We describe two approaches to extend GUI toolkits to support widget-level feedforward, and illustrate the usefulness of widget-level feedforward in a standardized interface to control the weather radar in commercial aircraft. In our evaluation, we found that users require less clicks to achieve tasks and are more confident about their actions when feedforward information was available. These findings suggest that widget-level feedforward is highly suitable in applications the user is unfamiliar with, or when high confidence is desirable.

References

  1. Ashraf Abdul, Jo Vermeulen, Danding Wang, Brian Y. Lim, and Mohan Kankanhalli. 2018. Trends and Trajectories for Explainable, Accountable and Intelligible Systems: An HCI Research Agenda. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 582, 18 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Incorporated (ARINC) Aeronautical Radio. 2016. ARINC661 Cockpit Display System Interfaces to User Systems ARINC Specification 661, supplement 6. Standard. AEEC - Engineering Standards for Aircraft Systems.Google ScholarGoogle Scholar
  3. Stavros Antifakos, Nicky Kern, Bernt Schiele, and Adrian Schwaninger. 2005. Towards Improving Trust in Context-aware Systems by Displaying System Confidence. In Proceedings of the 7th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '05). ACM, New York, NY, USA, 9--14.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Caroline Appert and Michel Beaudouin-Lafon. 2006. SwingStates: Adding State Machines to the Swing Toolkit. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology (UIST '06). ACM, New York, NY, USA, 319--322. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Mark Assad, David J. Carmichael, Judy Kay, and Bob Kummerfeld. 2007. PersonisAD: Distributed, Active, Scrutable Model Framework for Context-Aware Services. In Pervasive Computing, Anthony LaMarca, Marc Langheinrich, and Khai N. Truong (Eds.). Vol. 4480. Springer Berlin Heidelberg, Berlin, Heidelberg, 55--72. http://link.springer.com/10.1007/978--3--540--72037--9_4 Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Louise Barkhuus and Anind Dey. 2003. Is Context-Aware Computing Taking Control away from the User? Three Levels of Interactivity Examined. In UbiComp 2003: Ubiquitous Computing: 5th International Conference, Seattle, WA, USA, October 12--15, 2003. Proceedings, Anind K. Dey, Albrecht Schmidt, and Joseph F. McCarthy (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 149--156.Google ScholarGoogle ScholarCross RefCross Ref
  7. Rémi Bastide and Philippe A. Palanque. 1990. Petri Net Objects for the Design, Validation and Prototyping of User-driven Interfaces. In Proceedings of the IFIP TC13 Third Interational Conference on Human-Computer Interaction (INTERACT '90). North-Holland Publishing Co., Amsterdam, The Netherlands, The Netherlands, 625--631. http://dl.acm.org/citation.cfm?id=647402.725296Google ScholarGoogle Scholar
  8. Ré mi Bastide and Philippe A. Palanque. 1996. Implementation Techniques for Petri Net Based Specifications of Human-Computer Dialogues. In Computer-Aided Design of User Interfaces I, Jean Vanderdonckt (Ed.). 285--302.Google ScholarGoogle Scholar
  9. Olivier Bau and Wendy E. Mackay. 2008. OctoPocus: A Dynamic Guide for Learning Gesture-based Command Sets. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (UIST '08). ACM, New York, NY, USA, 37--46. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Patrick Baudisch, Desney Tan, Maxime Collomb, Dan Robbins, Ken Hinckley, Ken Hinckley, Maneesh Agrawala, Shengdong Zhao, and Gonzalo Ramos. 2006. Phosphor: Explaining Transitions in the User Interface Using Afterglow Effects. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology (UIST '06). ACM, New York, NY, USA, 169--178. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Victoria Bellotti and Keith Edwards. 2001. Intelligibility and Accountability: Human Considerations in Context-Aware Systems. Human-Computer Interaction, Vol. 16, 2 (Dec. 2001), 193--212.Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Brian Burg, Andrew J. Ko, and Michael D. Ernst. 2015. Explaining Visual Changes in Web Interfaces. In Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology (UIST '15). ACM, New York, NY, USA, 259--268. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. John M. Carroll and Mary Beth Rosson. 1987. Paradox of the Active User.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Richard Catrambone and John M. Carroll. 1987. Learning a Word Processing System with Training Wheels and Guided Exploration. In Proceedings of the SIGCHI/GI Conference on Human Factors in Computing Systems and Graphics Interface (CHI '87). ACM, New York, NY, USA, 169--174. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Scott Clifford and Jennifer Jerit. 2014. Is There a Cost to Convenience? An Experimental Comparison of Data Quality in Laboratory and Online Studies. Journal of Experimental Political Science, Vol. 1, 2 (2014), 120--131.Google ScholarGoogle ScholarCross RefCross Ref
  16. Frédéric Dandurand, Thomas R. Shultz, and Kristine H. Onishi. 2008. Comparing online and lab methods in a problem-solving experiment. Behavior Research Methods, Vol. 40, 2 (01 May 2008), 428--434.Google ScholarGoogle Scholar
  17. William Delamare, Céline Coutrix, and Laurence Nigay. 2015. Designing Guiding Systems for Gesture-based Interaction. In Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS '15). ACM, New York, NY, USA, 44--53. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Tom Djajadiningrat, Kees Overbeeke, and Stephan Wensveen. 2002. But How, Donald, Tell Us How?: On the Creation of Meaning in Interaction Design Through Feedforward and Inherent Feedback. In Proceedings of the 4th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (DIS '02). ACM, New York, NY, USA, 285--291. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Mica R. Endsley. 2011. Designing for Situation Awareness: An Approach to User-Centered Design, Second Edition 2nd ed.). CRC Press, Inc., Boca Raton, FL, USA.Google ScholarGoogle Scholar
  20. David K. Farkas. 1993. The role of balloon help. ACM SIGDOC Asterisk Journal of Computer Documentation, Vol. 17, 2 (May 1993), 3--19. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Erich Gamma, Richard Helm, Ralph Johnson, and John Vlissides. 1995. Design Patterns: Elements of Reusable Object-oriented Software .Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Mark Green. 1986. A Survey of Three Dialogue Models. ACM Trans. Graph., Vol. 5, 3 (July 1986), 244--275. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. T. R. G. Green. 1989. Cognitive Dimensions of Notations. In Proceedings of the Fifth Conference of the British Computer Society, Human-Computer Interaction Specialist Group on People and Computers V. Cambridge University Press, New York, NY, USA, 443--460. http://dl.acm.org/citation.cfm?id=92968.93015 Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Tovi Grossman and George Fitzmaurice. 2010. ToolClips: An Investigation of Contextual Video Assistance for Functionality Understanding. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 1515--1524. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Caitlin Kelleher and Randy Pausch. 2005. Stencils-based Tutorials: Design and Evaluation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '05). ACM, New York, NY, USA, 541--550. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Andrew J. Ko and Brad A. Myers. 2010. Extracting and answering why and why not questions about Java program output. ACM Transactions on Software Engineering and Methodology, Vol. 20, 2 (Aug. 2010), 1--36. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Benjamin Lafreniere, Parmit K. Chilana, Adam Fourney, and Michael A. Terry. 2015. These Aren't the Commands You're Looking For: Addressing False Feedforward in Feature-Rich Software. In Proceedings of the 28th Annual ACM Symposium on User Interface Software and; Technology (UIST '15). ACM, New York, NY, USA, 619--628. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Jonathan Lazar, Adam Jones, and Ben Shneiderman. 2006. Workplace user frustration with computers: an exploratory investigation of the causes and severity. Behaviour & Information Technology, Vol. 25, 3 (May 2006), 239--251.Google ScholarGoogle Scholar
  29. Catherine Letondal, Stéphane Chatty, Greg Philips, Fabien André, and Stéphane Conversy. 2010. Usability requirements for interaction-oriented development tools. In PPIG 2010, 22nd Annual Workshop on the Psychology of Programming Interest Group. 12--16.Google ScholarGoogle Scholar
  30. Brian Y. Lim and Anind K. Dey. 2010. Toolkit to Support Intelligibility in Context-aware Applications. In Proceedings of the 12th ACM International Conference on Ubiquitous Computing (UbiComp '10). ACM, New York, NY, USA, 13--22. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Brian Y. Lim, Anind K. Dey, and Daniel Avrahami. 2009. Why and Why Not Explanations Improve the Intelligibility of Context-aware Intelligent Systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 2119--2128.Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Quentin Limbourg, Jean Vanderdonckt, Benjamin Michotte, Laurent Bouillon, and Murielle Florins. 2004. USIXML: A User Interface Description Language Supporting Multiple Levels of Independence.. In ICWE Workshops. 325--338.Google ScholarGoogle Scholar
  33. Kris Luyten, Tim Clerckx, Karin Coninx, and Jean Vanderdonckt. 2003. Derivation of a Dialog Model from a Task Model by Activity Chain Extraction. In Interactive Systems. Design, Specification, and Verification, Joaquim A. Jorge, Nuno Jardim Nunes, and Joao Falcaoe Cunha (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 203--217.Google ScholarGoogle Scholar
  34. Célia Martinie, David Navarre, Philippe Palanque, and Camille Fayollas. 2015. A Generic Tool-supported Framework for Coupling Task Models and Interactive Applications. In Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS '15). ACM, New York, NY, USA, 244--253.Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Leo A. Meyerovich, Arjun Guha, Jacob Baskin, Gregory H. Cooper, Michael Greenberg, Aleks Bromfield, and Shriram Krishnamurthi. 2009. Flapjax: a programming language for Ajax applications. ACM SIGPLAN Notices, Vol. 44, 10 (Oct. 2009), 1. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Bonnie M. Muir. 1994. Trust in Automation: Part I. Theoretical Issues in the Study of Trust and Human Intervention in Automated Systems. Ergonomics, Vol. 37, 11 (Nov. 1994), 1905--1922.Google ScholarGoogle Scholar
  37. Lars Müller, Ilhan Aslan, and Lucas Krüßen. 2013. GuideMe: A Mobile Augmented Reality System to Display User Manuals for Home Appliances. In Advances in Computer Entertainment. Vol. 8253. Springer International Publishing, Cham, 152--167.Google ScholarGoogle Scholar
  38. Brad Myers, Scott E. Hudson, Randy Pausch, and Randy Pausch. 2000. Past, Present, and Future of User Interface Software Tools. ACM Trans. Comput.-Hum. Interact., Vol. 7, 1 (March 2000), 3--28. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Brad Myers, Sun Young Park, Yoko Nakano, Greg Mueller, and Andrew Ko. 2008. How designers design and program interactive behaviors. In 2008 IEEE Symposium on Visual Languages and Human-Centric Computing. IEEE, 177--184. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Brad A. Myers. 1991. Separating Application Code from Toolkits: Eliminating the Spaghetti of Call-backs. In Proceedings of the 4th Annual ACM Symposium on User Interface Software and Technology (UIST '91). ACM, New York, NY, USA, 211--220. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Mathieu Nancel and Andy Cockburn. 2014. Causality: A Conceptual Model of Interaction History. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 1777--1786. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Donald A Norman. 2010. Living with complexity. MIT press.Google ScholarGoogle Scholar
  43. Donald A Norman. 2013. The design of everyday things: Revised and expanded edition .Basic Books (AZ). Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Dan R. Olsen, Jr. 1984. Pushdown Automata for User Interface Management. ACM Trans. Graph., Vol. 3, 3 (July 1984), 177--203. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Dan R. Olsen, Jr. 2007. Evaluating User Interface Systems Research. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (UIST '07). ACM, New York, NY, USA, 251--258. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Stephen Oney, Brad Myers, and Joel Brandt. 2012. ConstraintJS: Programming Interactive Behaviors for the Web by Integrating Constraints and States. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 229--238.Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Stephen Oney, Brad Myers, and Joel Brandt. 2014. InterState: A Language and Environment for Expressing Interface Behavior. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 263--272.Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Robert S Rist et almbox. 1986. Plans in programming: definition, demonstration, and development. In Empirical studies of programmers. 28--47. Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Gustavo Rovelo, Donald Degraen, Davy Vanacken, Kris Luyten, and Karin Coninx. 2015. Gestu-Wan - An Intelligible Mid-Air Gesture Guidance System for Walk-up-and-Use Displays. In Human-Computer Interaction - INTERACT 2015, Julio Abascal, Simone Barbosa, Mirko Fetter, Tom Gross, Philippe Palanque, and Marco Winckler (Eds.). Vol. 9297. Springer International Publishing, 368--386.Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Miro Samek. 2003. Who moved my state. Dr. Dobb's Journal (2003).Google ScholarGoogle Scholar
  51. Julia Schwarz, Jennifer Mankoff, and Scott Hudson. 2011. Monte Carlo Methods for Managing Interactive State, Action and Feedback Under Uncertainty. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, New York, NY, USA, 235--244. Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Koushik Sen, Swaroop Kalasapur, Tasneem Brutch, and Simon Gibbs. 2013. Jalangi: A Selective Record-replay and Dynamic Analysis Framework for JavaScript. In Proceedings of the 2013 9th Joint Meeting on Foundations of Software Engineering (ESEC/FSE 2013). ACM, New York, NY, USA, 488--498. Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Michael Terry and Elizabeth D. Mynatt. 2002. Side Views: Persistent, On-demand Previews for Open-ended Tasks. In Proceedings of the 15th Annual ACM Symposium on User Interface Software and Technology (UIST '02). ACM, New York, NY, USA, 71--80. Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Davy Vanacken, Alexandre Demeure, Kris Luyten, and Karin Coninx. 2008. Ghosts in the interface: meta-user interface visualizations as guides for multi-touch interaction. In Proceedings of the 3rd IEEE international workshop on Horizontal Interactive Human Computer Systems (TABLETOP '08). IEEE Computer Society, 81--84.Google ScholarGoogle ScholarCross RefCross Ref
  55. Jo Vermeulen, Kris Luyten, Elise van den Hoven, and Karin Coninx. 2013. Crossing the Bridge over Norman's Gulf of Execution: Revealing Feedforward's True Identity. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 1931--1940. Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. W. A. Woods. 1970. Transition network grammars for natural language analysis. Commun. ACM, Vol. 13, 10 (Oct. 1970), 591--606. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Fortunettes: Feedforward about the Future State of GUI Widgets

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader
          About Cookies On This Site

          We use cookies to ensure that we give you the best experience on our website.

          Learn more

          Got it!