Towards a pattern language for model-based GUI testing

ABSTRACT

Graphical user interfaces (GUIs) have become popular as they appear in everydays' software. GUIs have become an ideal way of interacting with computer programs, making the software friendlier to its users. GUIs have grown, and so has the usage of UI Patterns featured in GUIs. UI Patterns are recurring solutions to solve common GUI design problems. We developed the notion of UI Test Patterns that, are able to test different implementations of UI Patterns. Therefore, we created a new methodology called Pattern-Based GUI Testing (PBGT) that aims at systematizing and automating the GUI testing process. PBGT samples the input space using UI Test Patterns, which provide a reusable and configurable test strategy, in order to test a GUI that was implemented using a set of UI Patterns. In this paper we present three UI Test Patterns: Login, Master/Detail and Sort.

References

1. C. Alexander, S. Ishikawa, and M. Silverstein. A Pattern Language: Towns, Buildings, Construction. Oxford University Press, Oxford, 1977.
2. S. Arlt, C. Bertolini, S. Pahl, and M. Schäf. Trends in Model-based GUI Testing. Advances in Computers, 86: 183--222, 2012.
3. P. Costa, M. Nabuco, and A. C. R. Paiva. Model-based testing for Mobile Applications. In The 9th International Conference on the Quality of Information and Communications Technology, QUATIC. IEEE Computer Society, 2014.
4. M. Cunha, A. C. R. Paiva, H. Sereno Ferreira, and R. Abreu. PETTool: A Pattern-Based GUI Testing Tool. In 2nd International Conference on Software Technology and Engineering (ICSTE'10), SFM'12, pages 202--206, 2010.
5. J. Dubois. Tudu lists. http://www.julien-dubois.com/tudu-lists.html. Accessed June, 2014.
6. I. K. El-Far and J. A. Whittaker. Model-based software testing. Encyclopedia of Software Engineering, 2001.
7. Facebook. Welcome to Facebook -- Log In, Sign Up or Learn More. http://www.facebook.com. Accessed January, 2014.
8. E. Gamma, R. Helm, R. Johnson, and J. M. Vlissides. Design Patterns: Elements of Reusable Object-Oriented Software. Addison-Wesley Professional, 1 edition, 1994.
9. Google. Gmail. www.gmail.com. Accessed February, 2014.
10. S. Hung. Australian charts portal. http://australian-charts.com. Accessed February, 2012.
11. A. Kervinen, M. Maunumaa, T. Päkkönen, and M. Katara. Model-based testing through a GUI. In In Proceedings of the 5th International Workshop on Formal Approaches to Testing of Software (FATES 2005), number 3997 in Lecture Notes in Computer Science, pages 16--31. Springer, 2006.
12. R. C. Martin. Agile software development: principles, patterns, and practices. Prentice Hall PTR, 2003.
13. A. M. Memon. A comprehensive framework for testing graphical user interfaces. PhD thesis, 2001. Advisors: Mary Lou Soffa and Martha Pollack; Committee members: Prof. Rajiv Gupta (University of Arizona), Prof. Adele E. Howe (Colorado State University), Prof. Lori Pollock (University of Delaware).
14. A. M. Memon. GUI testing: Pitfalls and process. Computer, 35(8): 87--88, 2002.
15. G. Meszaros and J. Doble. A Pattern Language for Pattern Writing. In The 3rd Pattern Languages of Programming conference, pages 1--33, 1996.
16. Microsoft. Outlook -- Sign In. https://login.live.com/. Accessed January, 2014.
17. mobile.de. mobile.de -- Germany's Biggest Vehicle Marketplace Online. Search, Buy and Sell Used and New Vehicles. http://www.mobile.de/?lang=en. Accessed November, 2013.
18. R. M. L. M. Moreira and A. C. R. Paiva. Visual Abstract Notation for GUI Modelling and Testing -- VAN4GUIM. In ICSOFT (SE/MUSE/GSDCA), pages 104--111. INSTICC Press, 2008.
19. R. M. L. M. Moreira and A. C. R. Paiva. A GUI Modeling DSL for Pattern-Based GUI Testing - PARADIGM. In L. A. Maciaszek and J. Filipe, editors, ENASE. SciTePress, 2014.
20. R. M. L. M. Moreira and A. C. R. Paiva. PBGT Tool: An Integrated Modeling and Testing Environment for Pattern-Based GUI Testing. In ASE '14: Proceedings of the 29th IEEE international conference on Automated Software Engineering. ACM, 2014.
21. Rodrigo M. L. M. Moreira and Ana C. R. Paiva. A Novel Approach using Alloy in Domain-Specific Language Engineering. In Proceedings of the 3rd International Conference on Model-Driven Engineering and Software Development (MODELSWARD 2015), ESEO, Angers, Loire Valley, France, 2015.
22. R. M. L. M. Moreira, A. C. R. Paiva, and A. Memon. A Pattern-Based Approach for GUI Modeling and Testing. In Proceedings of the 24th International Symposium on Software Reliability Engineering, ISSRE'13, Pasadena, CA, USA, 2013. IEEE Computer Society.
23. M. Nabuco, A. C. R. Paiva, and J. P. Faria. Inferring User Interface Patterns from Execution Traces of Web Applications. In Software Quality workshop of the 14th International Conference on Computational Science and Applications (ICCSA), 2014.
24. S. Ozier. TaskFreak! web based task manager and todo list, project management made easy. http://www.taskfreak.com/original. Accessed June, 2014.
25. A. Paiva, J. C. P. Faria, and R. F. A. M. Vidal. Specification-Based Testing of User Interfaces. In Interactive Systems. Design, Specification, and Verification, 10th International Workshop, volume 2844 of LNCS, pages 139--153. Springer, 2003.
26. A. C. R. Paiva, J. C. P. Faria, N. Tillmann, and R. F. A. M. Vidal. A Model-to-Implementation Mapping Tool for Automated Model-Based GUI Testing. In K.-K. Lau and R. Banach, editors, ICFEM, volume 3785 of LNCS, pages 450--464. Springer, 2005.
27. F. Paternò, C. Mancini, and S. Meniconi. ConcurTaskTrees: A Diagrammatic Notation for Specifying Task Models. In Proceedings of the IFIP TC13 International Conference on Human-Computer Interaction, INTERACT '97, pages 362--369, London, UK, UK, 1997. Chapman & Hall, Ltd.
28. Patternry. Patternry Open -- A Free Front-End Resource j Patternry. http://patternry.com/patterns/. Accessed January, 2014.
29. PBGT. Pattern-Based GUI Testing Wiki. http://paginas.fe.up.pt/~apaiva/pbgtwiki/doku.php?id=publications, 2014. Accessed August, 2014.
30. R. Raszka. Pttrns -- Mobile User Interface Patterns. http://pttrns.com/. Accessed January, 2014.
31. C. Sacramento and A. C. R. Paiva. Web Application Model Generation through Reverse Engineering and UI Pattern Inferring. In The 9th International Conference on the Quality of Information and Communications Technology, QUATIC. IEEE Computer Society, 2014.
32. Telerik. Telerik Mobile App Development Platform, .NET UI Controls, Web, Mobile, Desktop Development Tools. www.telerik.com. Accessed January, 2014.
33. J. Tidwell. Designing Interfaces. O'Reilly, Sebastopol, CA, 2011.
34. A. Toxboe. Design patterns. http://ui-patterns.com/patterns/. Accessed January, 2014.
35. I. D. T. UASP. Pattern Browser. http://patternbrowser.org/code/pattern/pattern.php. Accessed January, 2014.
36. M. van Welie. Interaction Design Pattern Library. http://www.welie.com/patterns, 2008. Accessed January, 2014.
37. C. Wacha. home -- PHP iAddressBook. http://iaddressbook.org/wiki/. Accessed June, 2014.
38. Yahoo! Yahoo! Mail -- Sign in to Yahoo. http://mail.yahoo.com. Accessed January, 2014.
39. Yahoo! Yahoo! Design Pattern Library. http://developer.yahoo.com/ypatterns, 2012. Accessed December, 2013.

Index Terms

• General and reference

  • Cross-computing tools and techniques

    • Verification

• Software and its engineering

  • Software creation and management

    • Software development techniques

      • Reusability

    • Software verification and validation

      • Software defect analysis

        • Software testing and debugging