skip to main content
research-article

Context- and Data-driven Satisfaction Analysis of User Interface Adaptations Based on Instant User Feedback

Published:13 June 2019Publication History
Skip Abstract Section

Abstract

Modern User Interfaces (UIs) are increasingly expected to be plastic, in the sense that they retain a constant level of usability, even when subjected to context (platform, user, and environment) changes at runtime. Adaptive UIs have been promoted as a solution for context variability due to their ability to automatically adapt to the context-of-use at runtime. However, evaluating end-user satisfaction of adaptive UIs is a challenging task, because the UI and the context-of-use are both constantly changing. Thus, an acceptance analysis of UI adaptation features should consider the context-of-use when adaptations are triggered. Classical usability evaluation methods like usability tests mostly focus on a posteriori analysis techniques and do not fully exploit the potential of collecting implicit and explicit user feedback at runtime. To address this challenge, we present an on-the-fly usability testing solution that combines continuous context monitoring together with collection of instant user feedback to assess end-user satisfaction of UI adaptation features. The solution was applied to a mobile Android mail application, which served as basis for a usability study with 23 participants. A data-driven end-user satisfaction analysis based on the collected context information and user feedback was conducted. The main results show that most of the triggered UI adaptation features were positively rated.

References

  1. Mai Abusair, Antinisca Di Marco, and Paola Inverardi. 2017. Context-Aware Adaptation of Mobile Applications Driven by Software Quality and User Satisfaction. In 2017 IEEE International Conference on Software Quality, Reliability and Security Companion, QRS-C 2017, Prague, Czech Republic, July 25--29, 2017. 31--38.Google ScholarGoogle ScholarCross RefCross Ref
  2. Pierre A. Akiki. 2014. Engineering adaptive model-driven user interfaces for enterprise applications . Ph.D. Dissertation. Open University, UK . http://oro.open.ac.uk/40828/Google ScholarGoogle Scholar
  3. Pierre A. Akiki, Arosha K. Bandara, and Yijun Yu. 2013. RBUIS: simplifying enterprise application user interfaces through engineering role-based adaptive behavior. In ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS'13, London, United Kingdom - June 24 - 27, 2013 . 3--12. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Pierre A. Akiki, Arosha K. Bandara, and Yijun Yu. 2014. Adaptive Model-Driven User Interface Development Systems. ACM Comput. Surv., Vol. 47, 1 (2014), 9:1--9:33. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Andrea Bunt, Cristina Conati, and Joanna McGrenere. 2007. Supporting interface customization using a mixed-initiative approach. In Proceedings of the 12th International Conference on Intelligent User Interfaces, IUI 2007, Honolulu, Hawaii, USA, January 28--31, 2007. 92--101. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Gaë lle Calvary, Joë lle Coutaz, and David Thevenin. 2001. A Unifying Reference Framework for the Development of Plastic User Interfaces. In Engineering for Human-Computer Interaction, 8th IFIP International Conference, EHCI 2001, Toronto, Canada, May 11--13, 2001, Revised Papers . 173--192. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Gaë lle Calvary, Joë lle Coutaz, David Thevenin, Quentin Limbourg, Laurent Bouillon, and Jean Vanderdonckt. 2003. A Unifying Reference Framework for multi-target user interfaces. Interacting with Computers, Vol. 15, 3 (2003), 289--308.Google ScholarGoogle ScholarCross RefCross Ref
  8. Sebastian Feuerstack, Marco Blumendorf, Maximilian Kern, Michael Kruppa, Michael Quade, Mathias Runge, and Sahin Albayrak. 2008. Automated Usability Evaluation during Model-Based Interactive System Development. In Engineering Interactive Systems, Second Conference on Human-Centered Software Engineering, HCSE 2008, and 7th International Workshop on Task Models and Diagrams, TAMODIA 2008, Pisa, Italy, September 25--26, 2008. Proceedings . 134--141. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Leah Findlater and Krzysztof Z. Gajos. 2009. Design Space and Evaluation Challenges of Adaptive Graphical User Interfaces. AI Magazine, Vol. 30, 4 (2009), 68--73.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Krzysztof Z. Gajos, Katherine Everitt, Desney S. Tan, Mary Czerwinski, and Daniel S. Weld. 2008. Predictability and accuracy in adaptive user interfaces. In Proceedings of the 2008 Conference on Human Factors in Computing Systems, CHI 2008, 2008, Florence, Italy, April 5--10, 2008. 1271--1274. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Giuseppe Ghiani, Marco Manca, Fabio Paternò, Jö rg Rett, and Atul Vaibhav. 2015. Adaptive multimodal web user interfaces for smart work environments. JAISE, Vol. 7, 6 (2015), 701--717.Google ScholarGoogle Scholar
  12. Jamil Hussain, Anees Ul Hassan, Hafiz Syed Muhammad Bilal, Rahman Ali, Muhammad Afzal, Shujaat Hussain, Jae Hun Bang, Oresti Banos, and Sungyoung Lee. 2018. Model-based adaptive user interface based on context and user experience evaluation. J. Multimodal User Interfaces, Vol. 12, 1 (2018), 1--16.Google ScholarGoogle ScholarCross RefCross Ref
  13. Talia Lavie and Joachim Meyer. 2010. Benefits and costs of adaptive user interfaces. Int. J. Hum.-Comput. Stud., Vol. 68, 8 (2010), 508--524. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Nesrine Mezhoudi. 2013. User interface adaptation based on user feedback and machine learning. In 18th International Conference on Intelligent User Interfaces, IUI '13, Santa Monica, CA, USA, March 19--22, 2013, Companion Volume. 25--28. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Raú l Mi n ó n, Fabio Paternò, Myriam Arrue, and Julio Abascal. 2016. Integrating adaptation rules for people with special needs in model-based UI development process. Universal Access in the Information Society, Vol. 15, 1 (2016), 153--168. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Nikola Mitrovic and Eduardo Mena. 2002. Adaptive User Interface for Mobile Devices. In Interactive Systems. Design, Specification, and Verification, 9th International Workshop, DSV-IS 2002, Rostock Germany, June 12--14, 2002. 29--43. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Michael Nebeling, Maximilian Speicher, and Moira C. Norrie. 2013. CrowdAdapt: enabling crowdsourced web page adaptation for individual viewing conditions and preferences. In ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS'13, London, United Kingdom - June 24 - 27, 2013 . 23--32. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Fabio Paternò. 2013. User Interface Design Adaptation. In The Encyclopedia of Human-Computer Interaction, 2nd Ed. Soegaard, Mads and Dam, Rikke Friis (eds.)., Aarhus, Denmark, Chapter 39.Google ScholarGoogle Scholar
  19. Tim F. Paymans, Jasper Lindenberg, and Mark A. Neerincx. 2004. Usability trade-offs for adaptive user interfaces: ease of use and learnability. In Proceedings of the 9th International Conference on Intelligent User Interfaces, IUI 2004, Funchal, Madeira, Portugal, January 13--16, 2004. 301--303. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Katharina Reinecke and Abraham Bernstein. 2011. Improving performance, perceived usability, and aesthetics with culturally adaptive user interfaces. ACM Trans. Comput.-Hum. Interact., Vol. 18, 2 (2011), 8:1--8:29. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Norbert Seyff, Gregor Ollmann, and Manfred Bortenschlager. 2014. AppEcho: a user-driven, in situ feedback approach for mobile platforms and applications. In Proceedings of the 1st International Conference on Mobile Software Engineering and Systems, MOBILESoft 2014, Hyderabad, India, June 2--3, 2014. 99--108.Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Elhadi M. Shakshuki, Malcolm Reid, and Tarek R. Sheltami. 2015. An Adaptive User Interface in Healthcare. In The 10th International Conference on Future Networks and Communications (FNC 2015) / The 12th International Conference on Mobile Systems and Pervasive Computing (MobiSPC 2015) / Affiliated Workshops, August 17--20, 2015, Belfort, France. 49--58.Google ScholarGoogle Scholar
  23. Jean-Sé bastien Sottet, Gaë lle Calvary, Joë lle Coutaz, and Jean-Marie Favre. 2007. A Model-Driven Engineering Approach for the Usability of Plastic User Interfaces. In Engineering Interactive Systems - EIS 2007 Joint Working Conferences, EHCI 2007, DSV-IS 2007, HCSE 2007, Salamanca, Spain, March 22--24, 2007. Selected Papers. 140--157. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Lex van Velsen, Thea van der Geest, Rob Klaassen, and Michaë l F. Steehouder. 2008. User-centered evaluation of adaptive and adaptable systems: a literature review. Knowledge Eng. Review, Vol. 23, 3 (2008), 261--281.Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Janet Louise Wesson, Akash Singh, and Bradley van Tonder. 2010. Can Adaptive Interfaces Improve the Usability of Mobile Applications?. In Human-Computer Interaction - Second IFIP TC 13 Symposium, HCIS 2010, Held as Part of WCC 2010, Brisbane, Australia, September 20--23, 2010. Proceedings . 187--198.Google ScholarGoogle ScholarCross RefCross Ref
  26. Enes Yigitbas, Silas Grü n, Stefan Sauer, and Gregor Engels. 2017a. Model-Driven Context Management for Self-adaptive User Interfaces. In Ubiquitous Computing and Ambient Intelligence - 11th International Conference, UCAmI 2017, Philadelphia, PA, USA, November 7--10, 2017, Proceedings . 624--635.Google ScholarGoogle Scholar
  27. Enes Yigitbas and Stefan Sauer. 2016. Engineering Context-Adaptive UIs for Task-Continuous Cross-Channel Applications. In Human-Centered and Error-Resilient Systems Development - IFIP WG 13.2/13.5 Joint Working Conference 6th International Conference on Human-Centered Software Engineering, HCSE 2016, and 8th International Conference on Human Error, Safety, and System Development, HESSD 2016 Stockholm, Sweden, August 29--31, 2016, Proceedings. 281--300.Google ScholarGoogle Scholar
  28. Enes Yigitbas, Hagen Stahl, Stefan Sauer, and Gregor Engels. 2017b. Self-adaptive UIs: Integrated Model-Driven Development of UIs and Their Adaptations. In Modelling Foundations and Applications - 13th European Conference, ECMFA 2017, Held as Part of STAF 2017, Marburg, Germany, July 19--20, 2017, Proceedings. 126--141.Google ScholarGoogle Scholar

Index Terms

  1. Context- and Data-driven Satisfaction Analysis of User Interface Adaptations Based on Instant User Feedback

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!