Abstract
Testing is an important part of the software engineering process to help ensure that systems will behave as expected. In this paper we investigate interactive system testing, taking into consideration the different components of the system. Interactive systems have three different components, the interactive, functional and overlap. The interactive component is the interface of the interactive system, the functional the underlying instructions of the interactive system, and the overlap component the point at which the interactive and functional components intersect. The interactive and functional components are often tested separately, however, problems can occur where these components overlap. Therefore, in this paper we present a model-based testing approach specifically designed to inspect the overlap component behaviour and to ensure that it behaves as expected.
- 2017. A General Framework for Comparing Automatic Testing Techniques of Android Mobile Apps.J. Syst. Softw. 125, C (March 2017), 322--343. https://doi.org/10.1016/j.jss.2016.12.017Google Scholar
- E. Barboni, J.-F. Ladry, D. Navarre, P. Palanque, and M. Winckler. 2010. Beyond Modelling: An Integrated Environment Supporting Co-execution of Tasks and Systems Models. In Proceedings of the 2Nd ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS '10). ACM, New York, NY, USA, 165--174. https://doi.org/10.1145/1822018.1822043Google Scholar
- F. Belli and C. J. Budnik. 2005. Minimal Spanning Set for Coverage Testing of Interactive Systems. In Theoretical Aspects of Computing - ICTAC 2004, Z. Liu and K. Araki (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 220--234.Google Scholar
- J. Bowen and S. Reeves. 2013. UI-design Driven Model-based Testing. Innovations in Systems and Software Engineering 9, 3 (2013), 201--215. https://doi.org/10.1007/s11334-013-0199--6Google Scholar
Digital Library
- J. C. Campos, C. Fayollas, M. Gonçalves, C. Martinie, D. Navarre, P. Palanque, and M. Pinto. 2017. A More Intelligent Test Case Generation Approach Through Task Models Manipulation. Proc. ACM Hum.-Comput. Interact.1, EICS, Article 9 (June 2017), 20 pages. https://doi.org/10.1145/3095811Google Scholar
- J. C. Campos and M. D. Harrison. 2001. Model Checking Interactor Specifications. Automated Software Engineering 8, 3(01 August 2001), 275--310. https://doi.org/10.1023/A:1011265604021Google Scholar
- J. C. Campos, J. Saraiva, C. Silva, and J. C. Silva. 2012. GUIsurfer: A Reverse Engineering Framework for User Interface Software. In Reverse Engineering, A.C. Telea (Ed.). In Tech, Rijeka, Chapter 2. https://doi.org/10.5772/32931Google Scholar
- CNBC. 2017. Uber Suspends Self-driving Car Program after Arizona Crash. Website. Retrieved March 13, 2018 fromhttps://www.cnbc.com/2017/03/26/uber-self-driving-car-arizona-crash-suspended.html.Google Scholar
- Daily Mail Reporter. 2011. Website. Retrieved August 8, 2018 from http://www.dailymail.co.uk/health/article-1359778/Mother-dies-nurse-administers-TEN-times-prescribed-drug.html, Title = Mother Dies after Nurse makes Error Ad-ministering Drug.Google Scholar
- United States Food and Drug Administration. 2015. Infusion Pumps. Website. Retrieved August 8, 2018 from http://www.fda.gov/MedicalDevices/ProductsandMedicalProcedures/GeneralHospitalDevicesandSupplies/InfusionPumps/.Google Scholar
- Google. 2019. Espresso. Website. Retrieved February 11, 2019 from https://developer.android.com/training/testing/espresso/.Google Scholar
- J. E. Hopcroft. 1979. Introduction to Automata Theory, Languages, and Computation. Addison-Wesley, Reading, Mass.Google Scholar
Digital Library
- C. Hu and I. Neamtiu. 2011. Automating GUI Testing for Android Applications. In Proceedings of the 6th International Workshop on Automation of Software Test (AST '11). Association for Computing Machinery, New York, NY, USA, 77--83. https://doi.org/10.1145/1982595.1982612Google Scholar
- C.-Y. Huang, J.-R. Chang, and Y.-H. Chang. 2010. Design and Analysis of GUI Test-case prioritization using Weight-based methods. The Journal of Systems & Software 83, 4 (2010), 646--659.Google Scholar
Digital Library
- C. N. Ip and D. L. Dill. 1993. Efficient Verification of Symmetric Concurrent Systems. In Computer Design: VLSI in Computers and Processors, 1993. ICCD'93. Proceedings., 1993 IEEE International Conference on. IEEE, 230--234. https://doi.org/10.1109/ICCD.1993.393375Google Scholar
- J. Jacky. 1997.The Way of Z: Practical Programming with Formal Methods. Cambridge University Press, Cambridge ;New York, NY, USA.Google Scholar
- S. Jaidka, S. Reeves, and J. Bowen. 2019. A Coloured Petri Net Approach to Model and Analyse Safety-Critical Interactive Systems. (2019). To appear in APSEC 2019.Google Scholar
- Glenn E. Krasner and Stephen T. Pope. 1988. A Cookbook for Using the Model-view Controller User Interface Paradigm in Smalltalk-80. J. Object Oriented Program.1, 3 (Aug. 1988), 26--49. http://dl.acm.org/citation.cfm?id=50757.50759Google Scholar
Digital Library
- P. Lee, F. Thompson, and H. Thimbleby. 2012. Analysis of Infusion Pump Error Logs and their Significance for Health Care. British Journal of Nursing (Mark Allen Publishing)21 (April 2012), S12, S14, S16--20.Google Scholar
- F. Lettner, C. Grossauer, and C. Holzmann. 2014. Mobile Interaction Analysis: Towards a Novel Concept for Interaction Sequence Mining. In Proceedings of the 16th International Conference on Human-computer Interaction with Mobile Devices & Services (MobileHCI '14). ACM, New York, NY, USA, 359--368. https://doi.org/10.1145/2628363.2628384Google Scholar
- A. Machiry, R. Tahiliani, and M. Naik. 2013. Dynodroid: An Input Generation System for Android Apps. In Proceedings of the 2013 9th Joint Meeting on Foundations of Software Engineering (ESEC/FSE 2013). Association for Computing Machinery, New York, NY, USA, 224--234. https://doi.org/10.1145/2491411.2491450Google Scholar
Digital Library
- P. Masci. 2014. A Preliminary Hazard Analysis for the GIP Number Entry Software.Google Scholar
- P. Masci, Y. Zhang, P. L. Jones, H. Thimbleby, and P. Curzon. 2014. A Generic User Interface Architecture for Analyzing Use Hazards in Infusion Pump Software. In Proceedings of the 5th Workshop on Medical Cyber-Physical Systems. 1--14.Google Scholar
- A. Matthews-King. 2018. Faulty Opiate Injection Pumps used in Gosport Scandal to be Reviewed Amid Fears Over Deaths Across NHS, Hunt says. Website. Retrieved July 17, 2018 from https://www.independent.co.uk/news/health/gosport-scandal-opiate-painkillers-jane-barton-patient-deaths-a8415916.html.Google Scholar
- Moodle. 2020. Disappearing Students. Website. Retrieved February 11, 2020 from https://moodle.org/mod/forum/discuss.php?d=137710.Google Scholar
- R. M. L. M. Moreira, A. C. Paiva, M. Nabuco, and A. Memon. 2017. Pattern-based GUI testing: Bridging the gap between design and quality assurance. Software Testing, Verification and Reliability 27, 3 (2017), e1629. https://doi.org/10.1002/stvr.1629 arXiv: https://onlinelibrary.wiley.com/doi/pdf/10.1002/stvr.1629 e1629 stvr.1629.Google Scholar
Cross Ref
- G. J. Myers. 2012.The Art of Software Testing(3rd ed.. ed.). John Wiley & Sons, Hoboken, N.J., Chapter 1, 1--5.Google Scholar
- New Zealand Herald. 2018. Elderly Patient's Cancer goes Unnoticed for Eight Months due to System Failure. Website. Retrieved August 9, 2018 from https://www.nzherald.co.nz/nz/news/article.cfm?c_id=1&objectid=12102251.Google Scholar
- B. N. Nguyen, B. Robbins, I. Banerjee, and A. Memon. 2014. GUITAR: An Innovative Tool for Automated Testing of GUI-driven Software. Automated Software Engineering 21, 1 (March 2014), 65--105.Google Scholar
Digital Library
- C. Norris IP and D. L. Dill. 1996. Better Verification through Symmetry. Formal Methods in System Design9, 1 (01 August 1996), 41--75. https://doi.org/10.1007/BF00625968Google Scholar
- P. Oladimeji, H. Thimbleby, and A. L. Cox. 2013. A Performance Review of Number Entry Interfaces. In Human-Computer Interaction -- INTERACT 2013, P. Kotzé, G. Marsden, G. Lindgaard, J. Wesson, and M. Winckler (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 365--382.Google Scholar
- F. Paternò, C. Santoro, and L. D. Spano. 2012. Improving Support for Visual Task Modelling, In Human-Centered Software Engineering.Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)7623, 299--306.Google Scholar
- A. M. Porrello. [n. d.]. Death and Denial: The Failure of the THERAC-25, A Medical Linear Accelerator. Website. Retrieved August 8, 2018 from http://users.csc.calpoly.edu/~jdalbey/SWE/Papers/THERAC25.html.Google Scholar
- C. Romanyk, R. McCallum, and P. Salehi. 2016. A Model Based Approach to Web Application Design for Older Adults using MVC Design Pattern. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 9752. Springer Verlag, 348--357.Google Scholar
- P. Salem. 2016. Practical Programming, Validation and Verification with Finite-state Machines: A Library and its Industrial Application. In Proceedings of the 38th International Conference on Software Engineering Companion (ICSE'16). ACM, New York, NY, USA, 51--60. https://doi.org/10.1145/2889160.2889226Google Scholar
Digital Library
- H. Thimbleby. 2004. User Interface Design with Matrix Algebra. ACM Transactions on Computer-Human Interaction(TOCHI)11, 2 (June 2004), 181--236.Google Scholar
- H. Thimbleby. 2009. Contributing to Safety and Due Diligence in Safety-critical Interactive Systems Development by Generating and Analyzing Finite State Models. In Proceedings of the 1st ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS '09). ACM, New York, NY, USA, 221--230. https://doi.org/10.1145/1570433.1570474Google Scholar
Digital Library
- H. Thimbleby. 2013. Reasons to Question Seven Segment Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 1431--1440. https://doi.org/10.1145/2470654.2466190Google Scholar
Digital Library
- H. Thimbleby. 2015. Safer User Interfaces: A Case Study in Improving Number Entry. IEEE Transactions on Software Engineering 41, 7 (July 2015), 711--729. https://doi.org/10.1109/TSE.2014.2383396Google Scholar
Cross Ref
- H. Thimbleby, A. Gimblett, and A. Cauchi. 2011. Buffer Automata: A UI Architecture Prioritising HCI Concerns for Interactive Devices. In Proceedings of the 3rd ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS '11). ACM, New York, NY, USA, 73--78. https://doi.org/10.1145/1996461.1996497Google Scholar
- J. Turner. 2019.Supporting Interactive System Testing using Interaction Sequences. Ph.D. Dissertation. The University of Waikato, Hamilton, New Zealand.Google Scholar
- J. Turner, J. Bowen, and S. Reeves. 2018. Simulating Interaction Sequences. In Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS '18). ACM, New York, NY, USA, Article 8, 7 pages. https://doi.org/10.1145/3220134.3220139Google Scholar
- J. Turner, J. Bowen, and S. Reeves. 2018. Using Abstraction with Interaction Sequences for Interactive System Modelling. In Software Technologies: Applications and Foundations, M. Mazzara, I. Ober, and G. Salaün (Eds.). Springer International Publishing, Cham, 257--273.Google Scholar
- M. Utting and B. Legeard. 2007. Practical Model-based Testing : A Tools Approach. Morgan Kaufmann Publishers, San Francisco, CA.Google Scholar
- L. White and H. Almezen. 2000. Generating Test Cases for GUI Responsibilities Using Complete Interaction Sequences. In Proceedings of the 11th International Symposium on Software Reliability Engineering (ISSRE '00). IEEE Computer Society, Washington, DC, USA, 110--121. http://dl.acm.org/citation.cfm?id=851024.856239Google Scholar
Cross Ref
- L. White, H. Almezen, and N. Alzeidi. 2001. User-Based Testing of GUI Sequences and their Interactions. In Proceedings of the 12th International Symposium on Software Reliability Engineering (ISSRE '01). IEEE Computer Society, Washington, DC, USA, 54--63. http://dl.acm.org/citation.cfm?id=851028.856281Google Scholar
Index Terms
Model-based Testing of Interactive Systems using Interaction Sequences
Recommendations
Interactive System Testing using Interaction Sequences
EICS '18: Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing SystemsInteraction sequences (ISeqs) are an abstraction of interactive systems which allow us to inspect the interactive system behaviour. In this research, ISeqs are used to support interactive system testing. In interactive system testing the components of ...
Interactive System Testing: Beyond GUI Testing
EICS '18: Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing SystemsThe increasing variety of Input/Output devices and functionalities in interactive systems raises concerns regarding the way they are tested. Indeed, while most of the existing testing techniques are suitable for interactive systems supporting WIMP ...
Rationalizing the Need of Architecture-Driven Testing of Interactive Systems
Human-Centered Software Engineering






Comments