Abstract

Feedback is commonly used to explain what happened in an interface. What if questions, on the other hand, remain mostly unanswered. In this paper, we present the concept of enhanced widgets capable of visualizing their future state, which helps users to understand what will happen without committing to an action. We describe two approaches to extend GUI toolkits to support widget-level feedforward, and illustrate the usefulness of widget-level feedforward in a standardized interface to control the weather radar in commercial aircraft. In our evaluation, we found that users require less clicks to achieve tasks and are more confident about their actions when feedforward information was available. These findings suggest that widget-level feedforward is highly suitable in applications the user is unfamiliar with, or when high confidence is desirable.
- Ashraf Abdul, Jo Vermeulen, Danding Wang, Brian Y. Lim, and Mohan Kankanhalli. 2018. Trends and Trajectories for Explainable, Accountable and Intelligible Systems: An HCI Research Agenda. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 582, 18 pages. Google Scholar
Digital Library
- Incorporated (ARINC) Aeronautical Radio. 2016. ARINC661 Cockpit Display System Interfaces to User Systems ARINC Specification 661, supplement 6. Standard. AEEC - Engineering Standards for Aircraft Systems.Google Scholar
- Stavros Antifakos, Nicky Kern, Bernt Schiele, and Adrian Schwaninger. 2005. Towards Improving Trust in Context-aware Systems by Displaying System Confidence. In Proceedings of the 7th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '05). ACM, New York, NY, USA, 9--14.Google Scholar
Digital Library
- Caroline Appert and Michel Beaudouin-Lafon. 2006. SwingStates: Adding State Machines to the Swing Toolkit. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology (UIST '06). ACM, New York, NY, USA, 319--322. Google Scholar
Digital Library
- Mark Assad, David J. Carmichael, Judy Kay, and Bob Kummerfeld. 2007. PersonisAD: Distributed, Active, Scrutable Model Framework for Context-Aware Services. In Pervasive Computing, Anthony LaMarca, Marc Langheinrich, and Khai N. Truong (Eds.). Vol. 4480. Springer Berlin Heidelberg, Berlin, Heidelberg, 55--72. http://link.springer.com/10.1007/978--3--540--72037--9_4 Google Scholar
Digital Library
- Louise Barkhuus and Anind Dey. 2003. Is Context-Aware Computing Taking Control away from the User? Three Levels of Interactivity Examined. In UbiComp 2003: Ubiquitous Computing: 5th International Conference, Seattle, WA, USA, October 12--15, 2003. Proceedings, Anind K. Dey, Albrecht Schmidt, and Joseph F. McCarthy (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 149--156.Google Scholar
Cross Ref
- Rémi Bastide and Philippe A. Palanque. 1990. Petri Net Objects for the Design, Validation and Prototyping of User-driven Interfaces. In Proceedings of the IFIP TC13 Third Interational Conference on Human-Computer Interaction (INTERACT '90). North-Holland Publishing Co., Amsterdam, The Netherlands, The Netherlands, 625--631. http://dl.acm.org/citation.cfm?id=647402.725296Google Scholar
- Ré mi Bastide and Philippe A. Palanque. 1996. Implementation Techniques for Petri Net Based Specifications of Human-Computer Dialogues. In Computer-Aided Design of User Interfaces I, Jean Vanderdonckt (Ed.). 285--302.Google Scholar
- Olivier Bau and Wendy E. Mackay. 2008. OctoPocus: A Dynamic Guide for Learning Gesture-based Command Sets. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (UIST '08). ACM, New York, NY, USA, 37--46. Google Scholar
Digital Library
- Patrick Baudisch, Desney Tan, Maxime Collomb, Dan Robbins, Ken Hinckley, Ken Hinckley, Maneesh Agrawala, Shengdong Zhao, and Gonzalo Ramos. 2006. Phosphor: Explaining Transitions in the User Interface Using Afterglow Effects. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology (UIST '06). ACM, New York, NY, USA, 169--178. Google Scholar
Digital Library
- Victoria Bellotti and Keith Edwards. 2001. Intelligibility and Accountability: Human Considerations in Context-Aware Systems. Human-Computer Interaction, Vol. 16, 2 (Dec. 2001), 193--212.Google Scholar
Digital Library
- Brian Burg, Andrew J. Ko, and Michael D. Ernst. 2015. Explaining Visual Changes in Web Interfaces. In Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology (UIST '15). ACM, New York, NY, USA, 259--268. Google Scholar
Digital Library
- John M. Carroll and Mary Beth Rosson. 1987. Paradox of the Active User.Google Scholar
Digital Library
- Richard Catrambone and John M. Carroll. 1987. Learning a Word Processing System with Training Wheels and Guided Exploration. In Proceedings of the SIGCHI/GI Conference on Human Factors in Computing Systems and Graphics Interface (CHI '87). ACM, New York, NY, USA, 169--174. Google Scholar
Digital Library
- Scott Clifford and Jennifer Jerit. 2014. Is There a Cost to Convenience? An Experimental Comparison of Data Quality in Laboratory and Online Studies. Journal of Experimental Political Science, Vol. 1, 2 (2014), 120--131.Google Scholar
Cross Ref
- Frédéric Dandurand, Thomas R. Shultz, and Kristine H. Onishi. 2008. Comparing online and lab methods in a problem-solving experiment. Behavior Research Methods, Vol. 40, 2 (01 May 2008), 428--434.Google Scholar
- William Delamare, Céline Coutrix, and Laurence Nigay. 2015. Designing Guiding Systems for Gesture-based Interaction. In Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS '15). ACM, New York, NY, USA, 44--53. Google Scholar
Digital Library
- Tom Djajadiningrat, Kees Overbeeke, and Stephan Wensveen. 2002. But How, Donald, Tell Us How?: On the Creation of Meaning in Interaction Design Through Feedforward and Inherent Feedback. In Proceedings of the 4th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (DIS '02). ACM, New York, NY, USA, 285--291. Google Scholar
Digital Library
- Mica R. Endsley. 2011. Designing for Situation Awareness: An Approach to User-Centered Design, Second Edition 2nd ed.). CRC Press, Inc., Boca Raton, FL, USA.Google Scholar
- David K. Farkas. 1993. The role of balloon help. ACM SIGDOC Asterisk Journal of Computer Documentation, Vol. 17, 2 (May 1993), 3--19. Google Scholar
Digital Library
- Erich Gamma, Richard Helm, Ralph Johnson, and John Vlissides. 1995. Design Patterns: Elements of Reusable Object-oriented Software .Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA. Google Scholar
Digital Library
- Mark Green. 1986. A Survey of Three Dialogue Models. ACM Trans. Graph., Vol. 5, 3 (July 1986), 244--275. Google Scholar
Digital Library
- T. R. G. Green. 1989. Cognitive Dimensions of Notations. In Proceedings of the Fifth Conference of the British Computer Society, Human-Computer Interaction Specialist Group on People and Computers V. Cambridge University Press, New York, NY, USA, 443--460. http://dl.acm.org/citation.cfm?id=92968.93015 Google Scholar
Digital Library
- Tovi Grossman and George Fitzmaurice. 2010. ToolClips: An Investigation of Contextual Video Assistance for Functionality Understanding. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 1515--1524. Google Scholar
Digital Library
- Caitlin Kelleher and Randy Pausch. 2005. Stencils-based Tutorials: Design and Evaluation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '05). ACM, New York, NY, USA, 541--550. Google Scholar
Digital Library
- Andrew J. Ko and Brad A. Myers. 2010. Extracting and answering why and why not questions about Java program output. ACM Transactions on Software Engineering and Methodology, Vol. 20, 2 (Aug. 2010), 1--36. Google Scholar
Digital Library
- Benjamin Lafreniere, Parmit K. Chilana, Adam Fourney, and Michael A. Terry. 2015. These Aren't the Commands You're Looking For: Addressing False Feedforward in Feature-Rich Software. In Proceedings of the 28th Annual ACM Symposium on User Interface Software and; Technology (UIST '15). ACM, New York, NY, USA, 619--628. Google Scholar
Digital Library
- Jonathan Lazar, Adam Jones, and Ben Shneiderman. 2006. Workplace user frustration with computers: an exploratory investigation of the causes and severity. Behaviour & Information Technology, Vol. 25, 3 (May 2006), 239--251.Google Scholar
- Catherine Letondal, Stéphane Chatty, Greg Philips, Fabien André, and Stéphane Conversy. 2010. Usability requirements for interaction-oriented development tools. In PPIG 2010, 22nd Annual Workshop on the Psychology of Programming Interest Group. 12--16.Google Scholar
- Brian Y. Lim and Anind K. Dey. 2010. Toolkit to Support Intelligibility in Context-aware Applications. In Proceedings of the 12th ACM International Conference on Ubiquitous Computing (UbiComp '10). ACM, New York, NY, USA, 13--22. Google Scholar
Digital Library
- Brian Y. Lim, Anind K. Dey, and Daniel Avrahami. 2009. Why and Why Not Explanations Improve the Intelligibility of Context-aware Intelligent Systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 2119--2128.Google Scholar
Digital Library
- Quentin Limbourg, Jean Vanderdonckt, Benjamin Michotte, Laurent Bouillon, and Murielle Florins. 2004. USIXML: A User Interface Description Language Supporting Multiple Levels of Independence.. In ICWE Workshops. 325--338.Google Scholar
- Kris Luyten, Tim Clerckx, Karin Coninx, and Jean Vanderdonckt. 2003. Derivation of a Dialog Model from a Task Model by Activity Chain Extraction. In Interactive Systems. Design, Specification, and Verification, Joaquim A. Jorge, Nuno Jardim Nunes, and Joao Falcaoe Cunha (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 203--217.Google Scholar
- Célia Martinie, David Navarre, Philippe Palanque, and Camille Fayollas. 2015. A Generic Tool-supported Framework for Coupling Task Models and Interactive Applications. In Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS '15). ACM, New York, NY, USA, 244--253.Google Scholar
Digital Library
- Leo A. Meyerovich, Arjun Guha, Jacob Baskin, Gregory H. Cooper, Michael Greenberg, Aleks Bromfield, and Shriram Krishnamurthi. 2009. Flapjax: a programming language for Ajax applications. ACM SIGPLAN Notices, Vol. 44, 10 (Oct. 2009), 1. Google Scholar
Digital Library
- Bonnie M. Muir. 1994. Trust in Automation: Part I. Theoretical Issues in the Study of Trust and Human Intervention in Automated Systems. Ergonomics, Vol. 37, 11 (Nov. 1994), 1905--1922.Google Scholar
- Lars Müller, Ilhan Aslan, and Lucas Krüßen. 2013. GuideMe: A Mobile Augmented Reality System to Display User Manuals for Home Appliances. In Advances in Computer Entertainment. Vol. 8253. Springer International Publishing, Cham, 152--167.Google Scholar
- Brad Myers, Scott E. Hudson, Randy Pausch, and Randy Pausch. 2000. Past, Present, and Future of User Interface Software Tools. ACM Trans. Comput.-Hum. Interact., Vol. 7, 1 (March 2000), 3--28. Google Scholar
Digital Library
- Brad Myers, Sun Young Park, Yoko Nakano, Greg Mueller, and Andrew Ko. 2008. How designers design and program interactive behaviors. In 2008 IEEE Symposium on Visual Languages and Human-Centric Computing. IEEE, 177--184. Google Scholar
Digital Library
- Brad A. Myers. 1991. Separating Application Code from Toolkits: Eliminating the Spaghetti of Call-backs. In Proceedings of the 4th Annual ACM Symposium on User Interface Software and Technology (UIST '91). ACM, New York, NY, USA, 211--220. Google Scholar
Digital Library
- Mathieu Nancel and Andy Cockburn. 2014. Causality: A Conceptual Model of Interaction History. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 1777--1786. Google Scholar
Digital Library
- Donald A Norman. 2010. Living with complexity. MIT press.Google Scholar
- Donald A Norman. 2013. The design of everyday things: Revised and expanded edition .Basic Books (AZ). Google Scholar
Digital Library
- Dan R. Olsen, Jr. 1984. Pushdown Automata for User Interface Management. ACM Trans. Graph., Vol. 3, 3 (July 1984), 177--203. Google Scholar
Digital Library
- Dan R. Olsen, Jr. 2007. Evaluating User Interface Systems Research. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (UIST '07). ACM, New York, NY, USA, 251--258. Google Scholar
Digital Library
- Stephen Oney, Brad Myers, and Joel Brandt. 2012. ConstraintJS: Programming Interactive Behaviors for the Web by Integrating Constraints and States. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 229--238.Google Scholar
Digital Library
- Stephen Oney, Brad Myers, and Joel Brandt. 2014. InterState: A Language and Environment for Expressing Interface Behavior. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 263--272.Google Scholar
Digital Library
- Robert S Rist et almbox. 1986. Plans in programming: definition, demonstration, and development. In Empirical studies of programmers. 28--47. Google Scholar
Digital Library
- Gustavo Rovelo, Donald Degraen, Davy Vanacken, Kris Luyten, and Karin Coninx. 2015. Gestu-Wan - An Intelligible Mid-Air Gesture Guidance System for Walk-up-and-Use Displays. In Human-Computer Interaction - INTERACT 2015, Julio Abascal, Simone Barbosa, Mirko Fetter, Tom Gross, Philippe Palanque, and Marco Winckler (Eds.). Vol. 9297. Springer International Publishing, 368--386.Google Scholar
Digital Library
- Miro Samek. 2003. Who moved my state. Dr. Dobb's Journal (2003).Google Scholar
- Julia Schwarz, Jennifer Mankoff, and Scott Hudson. 2011. Monte Carlo Methods for Managing Interactive State, Action and Feedback Under Uncertainty. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, New York, NY, USA, 235--244. Google Scholar
Digital Library
- Koushik Sen, Swaroop Kalasapur, Tasneem Brutch, and Simon Gibbs. 2013. Jalangi: A Selective Record-replay and Dynamic Analysis Framework for JavaScript. In Proceedings of the 2013 9th Joint Meeting on Foundations of Software Engineering (ESEC/FSE 2013). ACM, New York, NY, USA, 488--498. Google Scholar
Digital Library
- Michael Terry and Elizabeth D. Mynatt. 2002. Side Views: Persistent, On-demand Previews for Open-ended Tasks. In Proceedings of the 15th Annual ACM Symposium on User Interface Software and Technology (UIST '02). ACM, New York, NY, USA, 71--80. Google Scholar
Digital Library
- Davy Vanacken, Alexandre Demeure, Kris Luyten, and Karin Coninx. 2008. Ghosts in the interface: meta-user interface visualizations as guides for multi-touch interaction. In Proceedings of the 3rd IEEE international workshop on Horizontal Interactive Human Computer Systems (TABLETOP '08). IEEE Computer Society, 81--84.Google Scholar
Cross Ref
- Jo Vermeulen, Kris Luyten, Elise van den Hoven, and Karin Coninx. 2013. Crossing the Bridge over Norman's Gulf of Execution: Revealing Feedforward's True Identity. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 1931--1940. Google Scholar
Digital Library
- W. A. Woods. 1970. Transition network grammars for natural language analysis. Commun. ACM, Vol. 13, 10 (Oct. 1970), 591--606. Google Scholar
Digital Library
Index Terms
Fortunettes: Feedforward about the Future State of GUI Widgets
Recommendations
RBE: Rendering By Example
ICDE '95: Proceedings of the Eleventh International Conference on Data EngineeringRendering is defined to be a customized presentation of data in such a way that allows users to subsequently interact with the presented data. Traditionally such a user interface would be a custom application written using conventional programming ...
The previewable switch: a light switch with feedforward
DIS '14: Proceedings of the 2014 conference on Designing interactive systemsA light switch and its spatial mapping constitute an unsolved, user interface problem introduced to the realm of Human Computer Interaction by Norman. In this paper, we introduce the Previewable Switch which is a light switch enhanced with a touch ...
Fortune Nets for Fortunettes: Formal, Petri Nets-Based, Engineering of Feedforward for GUI Widgets
Formal Methods. FM 2019 International WorkshopsAbstractFeedback and feedforward are two fundamental mechanisms that supports users’ activities while interacting with computing devices. While feedback can be easily solved by providing information to the users following the triggering of an action, ...






Comments