Javier Godoy
Juan Pablo Galeotti
Diego Garbervetsky
Sebastián Uchitel
Skip Abstract Section
Abstract
A significant proportion of classes in modern software introduce or use object protocols, prescriptions on the temporal orderings of method calls on objects. This article studies search-based test generation techniques that aim to exploit a particular abstraction of object protocols (enabledness preserving abstractions (EPAs)) to find failures. We define coverage criteria over an extension of EPAs that includes abnormal method termination and define a search-based test case generation technique aimed at achieving high coverage. Results suggest that the proposed case generation technique with a fitness function that aims at combined structural and extended EPA coverage can provide better failure-detection capabilities not only for protocol failures but also for general failures when compared to random testing and search-based test generation for standard structural coverage.
- [n.d.]. Oracle. Retrieved from https://docs.oracle.com/javase/8/docs/api/java/util/ListIterator.html and https://docs.oracle.com/javase/8/docs/api/java/util/ListIterator..htmlGoogle Scholar
- [n.d.]. Tcases: A Model-Based Test Case Generator. Retrieved from https://github.com/Cornutum/tcases and https://github.com/Cornutum/tcasesl.Google Scholar
- [n.d.]. Apache. Retrieved from https://xalan.apache.org and https://xalan.apache.org.Google Scholar
- [n.d.]. Retrieved from https://bugs.openjdk.java.net/browse/JDK-4308549 and https://bugs.openjdk.java.net/browse/JDK-4308549.Google Scholar
- [n.d.]. Retrieved from http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6529795 and http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6529795.Google Scholar
- [n.d.]. Apache. Retrieved from https://issues.apache.org/jira/browse/COLLECTIONS-360 and https://issues.apache.org/jira/browse/COLLECTIONS-360.Google Scholar
- [n.d.]. Retrieved from http://hg.openjdk.java.net/openjfx/10-dev/rt/rev/572a70fabb47 and http://hg.openjdk.java.net/openjfx/10-dev/rt/rev/572a70fabb47.Google Scholar
- [n.d.]. Retrieved from https://bugs.openjdk.java.net/browse/JDK-4238266 and https://bugs.openjdk.java.net/browse/JDK-4238266.Google Scholar
- [n.d.]. Retrieved from https://bugs.java.com/bugdatabase/view_bug.do?bug_id=4135670 and https://bugs.java.com/bugdatabase/view_bug.do?bug_id=4135670.Google Scholar
- [n.d.]. Retrieved from https://issues.apache.org/jira/browse/COLLECTIONS-61 and https://issues.apache.org/jira/browse/COLLECTIONS-61.Google Scholar
- [n.d.]. Retrieved from https://bugs.openjdk.java.net/ and https://bugs.openjdk.java.net/.Google Scholar
- [n.d.]. Retrieved from http://bugs.sun.com and http://bugs.sun.com.Google Scholar
- [n.d.]. Retrieved from https://issues.apache.org and https://issues.apache.org.Google Scholar
- D. Amalfitano, A. R. Fasolino, P. Tramontana, B. D. Ta, and A. M. Memon. 2015. MobiGUITAR: Automated model-based testing of mobile apps. IEEE Softw. 32, 5 (September 2015), 53--59. DOI:https://doi.org/10.1109/MS.2014.55Google ScholarDigital Library
- James H. Andrews, Lionel C. Briand, Yvan Labiche, and Akbar Siami Namin. 2006. Using mutation analysis for assessing and comparing testing coverage criteria. IEEE Trans. Softw. Eng. 32, 8 (2006), 608--624. DOI:https://doi.org/10.1109/TSE.2006.83Google ScholarDigital Library
- James H. Andrews, Tim Menzies, and Felix C. H. Li. 2011. Genetic algorithms for randomized unit testing. IEEE Trans. Softw. Eng. 37, 1 (2011), 80--94.Google ScholarDigital Library
- Andrea Arcuri and Lionel Briand. 2011. A practical guide for using statistical tests to assess randomized algorithms in software engineering. In Proceedings of the 33rd International Conference on Software Engineering (ICSE’11). IEEE, 1--10.Google ScholarDigital Library
- Andrea Arcuri and Lionel C. Briand. 2014. A Hitchhiker’s guide to statistical tests for assessing randomized algorithms in software engineering. Softw. Test. Verif. Reliabil. 24, 3 (2014), 219--250. DOI:https://doi.org/10.1002/stvr.1486Google ScholarDigital Library
- Andrea Arcuri, Gordon Fraser, and Juan Pablo Galeotti. 2014. Automated unit test generation for classes with environment dependencies. In Proceedings of the ACM/IEEE International Conference on Automated Software Engineering (ASE’14), Ivica Crnkovic, Marsha Chechik, and Paul Grünbacher (Eds.). ACM, 79--90. DOI:https://doi.org/10.1145/2642937.2642986Google ScholarDigital Library
- Andrea Arcuri, Gordon Fraser, and Juan Pablo Galeotti. 2015. Generating TCP/UDP network data for automated unit test generation. In Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering (ESEC/FSE’15), Elisabetta Di Nitto, Mark Harman, and Patrick Heymans (Eds.). ACM, 155--165. DOI:https://doi.org/10.1145/2786805.2786828Google ScholarDigital Library
- Andrea Arcuri, Gordon Fraser, and René Just. 2017. Private API access and functional mocking in automated unit test generation. In Proceedings of the 2017 IEEE International Conference on Software Testing, Verification and Validation (ICST’17). IEEE Computer Society, 126--137. DOI:https://doi.org/10.1109/ICST.2017.19Google ScholarCross Ref
- Cyrille Valentin Artho, Armin Biere, Masami Hagiya, Eric Platon, Martina Seidl, Yoshinori Tanabe, and Mitsuharu Yamamoto. 2013. Modbat: A model-based API tester for event-driven systems. In Proceedings of the Haifa Verification Conference. Springer, 112--128.Google ScholarCross Ref
- Thomas Ball and Sriram K. Rajamani. 2001. Automatically validating temporal safety properties of interfaces. In Proceedings of the 8th International SPIN Workshop on Model Checking of Software (SPIN’01). Springer-Verlag, Berlin, 103--122.Google ScholarDigital Library
- N. Beckman, D. Kim, and J. Aldrich. [n.d.]. An empirical study of object protocols in the wild. In Proceedings of the European Conference on Object-Oriented Programming (ECOOP’11). 2--26.Google Scholar
- Kevin Bierhoff and Jonathan Aldrich. 2007. Modular typestate checking of aliased objects. SIGPLAN Not. 42, 10 (Oct. 2007), 301--320. DOI:https://doi.org/10.1145/1297105.1297050Google ScholarDigital Library
- José Campos, Yan Ge, Nasser Albunian, Gordon Fraser, Marcelo Eler, and Andrea Arcuri. 2018. An empirical evaluation of evolutionary algorithms for unit test suite generation. Inf. Softw. Technol. 104 (2018), 207--235. DOI:https://doi.org/10.1016/j.infsof.2018.08.010Google ScholarCross Ref
- Henry Coles, Thomas Laurent, Christopher Henard, Mike Papadakis, and Anthony Ventresque. 2016. Pit: A practical mutation testing tool for java. In Proceedings of the 25th International Symposium on Software Testing and Analysis. ACM, 449--452.Google ScholarDigital Library
- H. Czemerinski, V. Braberman, and S. Uchitel. 2016. Behaviour abstraction adequacy criteria for API call protocol testing. Softw. Test. Verif. Reliabil. 26, 3 (2016), 211–244. DOI:https://doi.org/10.1002/stvr.1593Google ScholarDigital Library
- Valentin Dallmeier, Nikolai Knopp, Christoph Mallon, Gordon Fraser, Sebastian Hack, and Andreas Zeller. 2012. Automatically generating test cases for specification mining. IEEE Trans. Softw. Eng. 38, 2 (2012), 243--257. DOI:https://doi.org/10.1109/TSE.2011.105Google ScholarDigital Library
- G. de Caso, V. Braberman, D. Garbervetsky, and S. Uchitel. [n.d.]. Program abstractions for behaviour validation. In Proceedings of the International Conference on Software Engineering (ICSE’11). 381--390.Google Scholar
- G. de Caso, V. Braberman, D. Garbervetsky, and S. Uchitel. [n.d.]. Validation of contracts using enabledness preserving finite state abstractions. In Proceedings of the International Conference on Software Engineering (ICSE’09). 452--462.Google Scholar
- Guido de Caso, Victor Braberman, Diego Garbervetsky, and Sebastian Uchitel. 2012. Automated abstractions for contract validation. IEEE Trans. Softw. Eng. 38, 1 (2012), 141--162.Google ScholarDigital Library
- G. de Caso, V. Braberman, D. Garbervetsky, and S. Uchitel. 2013. Enabledness-based program abstractions for behavior validation. ACM Trans. Softw. Eng. Methodol. 22, 3 (2013).Google Scholar
- Kalyanmoy Deb, Samir Agrawal, Amrit Pratap, and T. Meyarivan. 2002. A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evol. Comput. 6, 2 (2002), 182--197. DOI:https://doi.org/10.1109/4235.996017Google ScholarDigital Library
- Robert DeLine and Manuel Fähndrich. 2004. Typestates for objects. In Proceedings of the European Conference on Object-Oriented Programming (ECOOP’04). 465--490.Google ScholarCross Ref
- Mariangiola Dezani-Ciancaglini, Dimitris Mostrous, Nobuko Yoshida, and Sophia Drossopoulou. 2006. Session types for object-oriented languages. In Proceedings of the European Conference on Object-Oriented Programming. Springer, 328--352.Google ScholarDigital Library
- John Field, Deepak Goyal, G. Ramalingam, and Eran Yahav. 2003. Typestate verification: Abstraction techniques and complexity results. In Proceedings of the International Static Analysis Symposium. Springer, 439--462.Google ScholarCross Ref
- Stephen J Fink, Eran Yahav, Nurit Dor, G. Ramalingam, and Emmanuel Geay. 2008. Effective typestate verification in the presence of aliasing. ACM Trans. Softw. Eng. Methodol. 17, 2 (2008), 9.Google ScholarDigital Library
- G. Fraser and A. Arcuri. 2013. Whole test suite generation. IEEE Trans. Softw. Eng. 39, 2 (2013), 276--291.Google ScholarDigital Library
- Gordon Fraser and Andrea Arcuri. 2014. A large-scale evaluation of automated unit test generation using EvoSuite. ACM Trans. Softw. Eng. Methodol. 24, 2, Article 8 (December 2014), 42 pages. DOI:https://doi.org/10.1145/2685612Google ScholarDigital Library
- Gordon Fraser and Andrea Arcuri. 2015. Achieving scalable mutation-based generation of whole test suites. Emp. Softw. Eng. 20, 3 (2015), 783--812. DOI:https://doi.org/10.1007/s10664-013-9299-zGoogle ScholarDigital Library
- Gordon Fraser and Andreas Zeller. 2011. Exploiting common object usage in test case generation. In Proceedings of the 4th IEEE International Conference on Software Testing, Verification and Validation (ICST’11). IEEE Computer Society, 80--89. DOI:https://doi.org/10.1109/ICST.2011.53Google ScholarDigital Library
- G. Fraser and A. Zeller. 2012. Mutation-driven generation of unit tests and oracles. Trans. Softw. Eng. 28, 2 (2012), 278--292.Google ScholarDigital Library
- Wolfgang Grieskamp, Yuri Gurevich, Wolfram Schulte, and Margus Veanes. 2002. Generating finite state machines from abstract state machines. In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA’02). 112--122.Google ScholarDigital Library
- W. Grieskamp, N. Kicillof, K. Stobie, and V. Braberman. 2011. Model-based quality assurance of protocol documentation: Tools and methodology. STVR 21, 1 (2011), 55--71. DOI:https://doi.org/10.1002/stvr.427Google Scholar
- A. Groce, C. Zhang, E. Eide, Y. Chen, and J. Regehr. [n.d.]. Swarm testing. In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA’12). 78--88.Google Scholar
- Mats P. E. Heimdahl, Devaraj George, and Robert Weber. 2004. Specification test coverage adequacy criteria = Specification test generation inadequacy criteria. In Proceedings of the Eighth IEEE International Conference on High Assurance Systems Engineering (HASE’04). IEEE Computer Society, USA, 178–186.Google ScholarDigital Library
- Robert M. Hierons, Kirill Bogdanov, Jonathan P. Bowen, Rance Cleaveland, John Derrick, Jeremy Dick, Marian Gheorghe, Mark Harman, Kalpesh Kapoor, Paul Krause, Gerald Lüttgen, Anthony J. H. Simons, Sergiy Vilkomir, Martin R. Woodward, and Hussein Zedan. 2009. Using formal specifications to support testing. Comput. Surveys 41, 2, Article 9 (2009), 9:1--9:76 pages.Google Scholar
- Kobi Inkumsah and Tao Xie. 2008. Improving structural testing of object-oriented programs via integrating evolutionary testing and symbolic execution. In Proceedings of the 2008 23rd IEEE/ACM International Conference on Automated Software Engineering. IEEE Computer Society, 297--306.Google ScholarDigital Library
- Jan and Tretmans. 1996. Conformance testing with labelled transition systems: Implementation relations and test generation. Comput. Netw. ISDN Syst. 29, 1 (1996), 49--79.Google ScholarDigital Library
- René Just, Darioush Jalali, and Michael D. Ernst. 2014. Defects4J: A database of existing faults to enable controlled testing studies for Java programs. In Proceedings of the International Symposium on Software Testing and Analysis, (ISSTA’14), Corina S. Pasareanu and Darko Marinov (Eds.). ACM, 437--440. DOI:https://doi.org/10.1145/2610384.2628055Google Scholar
- René Just, Darioush Jalali, Laura Inozemtseva, Michael D Ernst, Reid Holmes, and Gordon Fraser. 2014. Are mutants a valid substitute for real faults in software testing? In Proceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering. ACM, 654--665.Google ScholarDigital Library
- Teemu Kanstrén and Olli-Pekka Puolitaival. 2012. Using built-in domain-specific modeling support to guide model-based test generation. Model-Driven Engineering of Information Systems: Principles, Techniques, and Practice (2012), 295--319.Google Scholar
- I. Krka, Y. Brun, and N. Medvidovic. [n.d.]. Automatic mining of specifications from invocation traces and method invariants. In Proceedings of the Symposium on the Foundations of Software Engineering (FSE’14). 178--189.Google Scholar
- Kiran Lakhotia, Phil McMinn, and Mark Harman. 2010. An empirical investigation into branch coverage for C programs using CUTE and AUSTIN. J. Syst. Softw. 83, 12 (December 2010), 2379--2391. DOI:https://doi.org/10.1016/j.jss.2010.07.026Google ScholarDigital Library
- Tien-Duy B. Le, Xuan-Bach D. Le, David Lo, and Ivan Beschastnikh. 2015. Synergizing specification miners through model fissions and fusions (T). In Proceedings of the 30th IEEE/ACM International Conference on Automated Software Engineering (ASE’15), Myra B. Cohen, Lars Grunske, and Michael Whalen (Eds.). IEEE Computer Society, 115--125. DOI:https://doi.org/10.1109/ASE.2015.83Google ScholarDigital Library
- David Lee and Mihalis Yannakakis. 1996. Principles and methods of testing finite state machines-a survey. Proc. IEEE 84, 8 (1996), 1090--1123.Google ScholarCross Ref
- Wenbin Li, Franck Le Gall, and Naum Spaseski. 2017. A survey on model-based testing tools for test case generation. In Proceedings of the International Conference on Tools and Methods for Program Analysis. Springer, 77--89.Google Scholar
- Lisa Liu, Bertrand Meyer, and Bernd Schoeller. 2007. Using contracts and Boolean queries to improve the quality of automatic test generation. In Proceedings of the 1st International Conference on Tests and Proofs (TAP’07). Springer-Verlag, Berlin, Heidelberg, 114–130.Google ScholarDigital Library
- Lech Madeyski, Wojciech Orzeszyna, Richard Torkar, and Mariusz Jozala. 2014. Overcoming the equivalent mutant problem: A systematic literature review and a comparative experiment of second order mutation. IEEE Trans. Softw. Eng. 40, 1 (2014), 23--42. DOI:https://doi.org/10.1109/TSE.2013.44Google ScholarDigital Library
- Alessandro Marchetto, Paolo Tonella, and Filippo Ricca. 2008. State-based testing of Ajax web applications. In Proceedings of the 1st International Conference on Software Testing, Verification, and Validation (ICST’08). 121--130. DOI:https://doi.org/10.1109/ICST.2008.22Google ScholarDigital Library
- Leonardo Mariani, Mauro Pezzè, Oliviero Riganelli, and Mauro Santoro. 2011. AutoBlackTest: A tool for automatic black-box testing. In Proceedings of the International Conference on Software Engineering (ICSE’11). 1013--1015.Google ScholarDigital Library
- Raluca Marinescu, Cristina Seceleanu, Hèléne Le Guen, and Paul Pettersson. 2015. A research overview of tool supported model-based testing of requirements-based designs. Adv. Comput. 98 (2015), 89--140.Google ScholarCross Ref
- P. McMinn. 2004. Search-based software test data generation: A survey. Softw. Test., Verif. Reliabil. 14, 2 (2004), 105--156.Google ScholarDigital Library
- Atif M. Memon, Mary Lou Soffa, and Martha E. Pollack. 2001. Coverage criteria for GUI testing. In Proceedings of the 8th European Software Engineering Conference Held Jointly with 9th ACM SIGSOFT International Symposium on Foundations of Software Engineering (ESEC/FSE-9). ACM, New York, NY, 256--267. DOI:https://doi.org/10.1145/503209.503244Google Scholar
- A. Mesbah, E. Bozdag, and A. v. Deursen. 2008. Crawling AJAX by inferring user interface state changes. In Proceedings of the 2008 8th International Conference on Web Engineering. 122--134. DOI:https://doi.org/10.1109/ICWE.2008.24Google ScholarDigital Library
- S. Mouchawrab, L. C. Briand, Y. Labiche, and M. Di Penta. 2011. Assessing, comparing, and combining state machine-based testing and structural testing: A series of experiments. IEEE Trans. Softw. Eng. 37, 2 (March 2011), 161--187. DOI:https://doi.org/10.1109/TSE.2010.32Google ScholarDigital Library
- Shinichi Nakagawa. 2004. A farewell to Bonferroni: The problems of low statistical power and publication bias. Behav. Ecol. 15, 6 (11 2004), 1044--1045. DOI:https://doi.org/10.1093/beheco/arh107Google Scholar
- Alessandro Orso and Gregg Rothermel. 2014. Software testing: A research travelogue (2000--2014). In Proceedings of the on Future of Software Engineering. ACM, 117--132.Google ScholarDigital Library
- Carlos Pacheco, Shuvendu K. Lahiri, Michael D. Ernst, and Thomas Ball. 2007. Feedback-directed random test generation. In Proceedings of the 29th International Conference on Software Engineering (ICSE’07). 75--84.Google ScholarDigital Library
- Annibale Panichella, Fitsum Meshesha Kifetew, and Paolo Tonella. 2015. Reformulating branch coverage as a many-objective optimization problem. In Proceedings of the 8th IEEE International Conference on Software Testing, Verification and Validation (ICST’15). IEEE Computer Society, 1--10. DOI:https://doi.org/10.1109/ICST.2015.7102604Google ScholarCross Ref
- Annibale Panichella, Fitsum Meshesha Kifetew, and Paolo Tonella. 2018. Automated test case generation as a many-objective optimisation problem with dynamic selection of the targets. IEEE Trans. Softw. Eng. 44, 2 (2018), 122--158. DOI:https://doi.org/10.1109/TSE.2017.2663435Google ScholarCross Ref
- Thomas V. Perneger. 1998. What’s wrong with Bonferroni adjustments. Br. Med. J. 316, 7139 (1998), 1236--1238. DOI:https://doi.org/10.1136/bmj.316.7139.1236 arXiv:https://www.bmj.com/contentGoogle ScholarCross Ref
- Michael Pradel, Philipp Bichsel, and Thomas R. Gross. 2010. A framework for the evaluation of specification miners based on finite state machines. In Proceedings of the 26th IEEE International Conference on Software Maintenance (ICSM’10). IEEE Computer Society, 1--10. DOI:https://doi.org/10.1109/ICSM.2010.5609576Google Scholar
- A. Pretschner, W. Prenninger, S. Wagner, C. Kühnel, M. Baumgartner, B. Sostawa, R. Zölch, and T. Stauner. 2005. One evaluation of model-based testing and its automation. In Proceedings of the International Conference on Software Engineering (ICSE’05). 392--401.Google Scholar
- A. Pretschner, W. Prenninger, S. Wagner, C. Kühnel, M. Baumgartner, B. Sostawa, R. Zölch, and T. Stauner. 2005. One evaluation of model-based testing and its automation. In Proceedings of the 27th International Conference on Software Engineering (ICSE’05). ACM, New York, NY, 392--401. DOI:https://doi.org/10.1145/1062455.1062529Google Scholar
- J. Rojas, J. Campos, M. Vivanti, G. Fraser, and A. Arcuri. [n.d.]. Combining multiple coverage criteria in search-based unit test generation. In Proceedings of the Symposium on Search Based Software Engineering (SSBSE’15). 93--108.Google Scholar
- José Miguel Rojas, Mattia Vivanti, Andrea Arcuri, and Gordon Fraser. 2017. A detailed investigation of the effectiveness of whole test suite generation. Emp. Softw. Eng. 22, 2 (2017), 852--893. DOI:https://doi.org/10.1007/s10664-015-9424-2Google ScholarDigital Library
- Gregg Rothermel, Mary Jean Harrold, Jeffery Ostrin, and Christie Hong. 1998. An empirical study of the effects of minimization on the fault detection capabilities of test suites. In Proceedings of the International Conference on Software Maintenance (ICSM’98). IEEE Computer Society, Los Alamitos, CA, 34--. http://dl.acm.org/citation.cfm?id=850947.853294Google ScholarCross Ref
- M. J. Rutherford, A. Carzaniga, and A. L. Wolf. 2008. Evaluating test suites and adequacy criteria using simulation-based models of distributed systems. IEEE Trans. Softw. Eng. 34, 4 (July 2008), 452--470. DOI:https://doi.org/10.1109/TSE.2008.33Google ScholarDigital Library
- V. Santiago, A. S. Martins Do Amaral, N. L. Vijaykumar, M. D. Fatima Mattiello-francisco, E. Martins, and O. C. Lopes. 2006. A practical approach for automated test case generation using statecharts. In Proceedings of the 30th Annual International Computer Software and Applications Conference (COMPSAC’06), Vol. 2. 183--188. DOI:https://doi.org/10.1109/COMPSAC.2006.100Google Scholar
- Muhammad Shafique and Yvan Labiche. 2015. A systematic review of state-based test tools. Int. J. Softw. Tools Technol. Transf. 17, 1 (2015), 59--76.Google ScholarDigital Library
- Sina Shamshiri, René Just, José Miguel Rojas, Gordon Fraser, Phil McMinn, and Andrea Arcuri. 2015. Do automatically generated unit tests find real faults? An empirical study of effectiveness and challenges (T). In Proceedings of the 30th IEEE/ACM International Conference on Automated Software Engineering (ASE’15), Myra B. Cohen, Lars Grunske, and Michael Whalen (Eds.). IEEE Computer Society, 201--211. DOI:https://doi.org/10.1109/ASE.2015.86Google ScholarDigital Library
- Sina Shamshiri, José Miguel Rojas, Luca Gazzola, Gordon Fraser, Phil McMinn, Leonardo Mariani, and Andrea Arcuri. 2018. Random or evolutionary search for object-oriented test suite generation? Softw. Test. Verif. Reliabil. 28, 4 (2018), e1660.Google ScholarCross Ref
- R. Sharma, M. Gligoric, A. Arcuri, G. Fraser, and D. Marinov. 2011. Testing container classes: Random or systematic? In Proceedings of the International Conference on Fundamental Approaches to Software Engineering (FASE’11). 262--277.Google Scholar
- M. Srinivas and Lalit M. Patnaik. 1994. Genetic algorithms: A survey. IEEE Comput. 27, 6 (1994), 17--26. DOI:https://doi.org/10.1109/2.294849Google ScholarDigital Library
- Robert E. Strom and Shaula Yemini. 1986. Typestate: A programming language concept for enhancing software reliability. IEEE Trans. Softw. Eng. SE-12, 1 (Jan. 1986), 157–171. DOI:10.1109/TSE.1986.6312929Google ScholarDigital Library
- Suresh Thummalapenta, Tao Xie, Nikolai Tillmann, Jonathan de Halleux, and Zhendong Su. 2011. Synthesizing method sequences for high-coverage testing. In Proceedings of the ACM Object-Oriented Programming, Systems, Languages 8 Applications (OOPSLA’11).Google ScholarDigital Library
- P. Tonella. 2004. Evolutionary testing of classes. SIGSOFT Softw. Eng. Notes 29, 4 (July 2004), 119--128.Google ScholarDigital Library
- Roland H. Untch, A. Jefferson Offutt, and Mary Jean Harrold. 1993. Mutation analysis using mutant schemata. In ACM SIGSOFT Software Engineering Notes, Vol. 18. ACM, 139--148.Google Scholar
- Mark Utting and Bruno Legeard. 2010. Practical Model-based Testing: A Tools Approach. Elsevier.Google ScholarDigital Library
- M. Utting, G. Perrone, J. Winchester, S. Thompson, R. Yang, and P. Douangsavanh. 2009. Model junit. Department of Computer Science, University of Waikato, Waikato, New Zealand (2009).Google Scholar
- Mark Utting, Alexander Pretschner, and Bruno Legeard. 2012. A taxonomy of model-based testing approaches. Softw. Test. Verif. Reliabil. 22, 5 (2012), 297--312.Google ScholarDigital Library
- Machiel van der Bijl, Arend Rensink, and Jan Tretmans. 2003. Compositional testing with ioco. In Formal Approaches to Software Testing, Proceedings of the 3rd International Workshop on Formal Approaches to Testing of Software (FATES’03), Alexandre Petrenko and Andreas Ulrich (Eds.), Lecture Notes in Computer Science, Vol. 2931. Springer, 86--100. DOI:https://doi.org/10.1007/978-3-540-24617-6_7Google Scholar
- S. Weißleder. 2010. Simulated satisfaction of coverage criteria on UML state machines. In Proceedings of the 2010 3rd International Conference on Software Testing, Verification and Validation. 117--126. DOI:https://doi.org/10.1109/ICST.2010.28Google ScholarDigital Library
- X. Xiao, T. Xie, N. Tillmann, and J. de Halleux. [n.d.]. Precise identification of problems for structural test generation. In Proceedings of the International Conference on Software Engineering (ICSE’11). 611--620.Google Scholar
- Dianxiang Xu, Weifeng Xu, Michael Kent, Lijo Thomas, and Linzhang Wang. 2015. An automated test generation technique for software quality assurance. IEEE Transactions on Reliability 64, 1 (2015), 247--268.Google ScholarCross Ref
Index Terms
Enabledness-based Testing of Object Protocols
Recommendations
Evolutionary testing: a case study
HVC'06: Proceedings of the 2nd international Haifa verification conference on Hardware and software, verification and testingThe paper presents a case study of applying genetic algorithms (GAs) to the automatic test data generation problem. We present the basic techniques implemented in our prototype test generation system, whose goal is to get branch coverage of the program ...
From genetic to bacteriological algorithms for mutation-based testing: Research Articles
The level of confidence in a software component is often linked to the quality of its test cases. This quality can in turn be evaluated with mutation analysis: faults are injected into the software component (making mutants of it) to check the ...
Connectivity Testing
This paper presents a new approach, connectivity testing, for testing embedded systems. Instead of testing the conformance of a system against its specification, which often turns out to be infeasible, we suggest to test only the composition of the ...
Comments