Enabledness-based program abstractions for behavior validation

Abstract

Code artifacts that have nontrivial requirements with respect to the ordering in which their methods or procedures ought to be called are common and appear, for instance, in the form of API implementations and objects. This work addresses the problem of validating if API implementations provide their intended behavior when descriptions of this behavior are informal, partial, or nonexistent. The proposed approach addresses this problem by generating abstract behavior models which resemble typestates. These models are statically computed and encode all admissible sequences of method calls. The level of abstraction at which such models are constructed has shown to be useful for validating code artifacts and identifying findings which led to the discovery of bugs, adjustment of the requirements expected by the engineer to the requirements implicit in the code, and the improvement of available documentation.

References

1. Alur, R., Cerny, P., Madhusudan, P., and Nam, W. 2005. Synthesis of interface specifications for java classes. In Proceedings of the 32^nd ACM SIGPLAN-SIGACT Symposium on Principles of Programming Panguages (POPL'05). 98--109.
2. Andersen, M., Barnett, M., Fahndrich, M., Grunkemeyer, B., King, K., Logozzo, F., Patel, V., and Zuniga, D. 2009. Code contracts. http://research.microsoft.com/enus/projects/contracts.
3. Barrett, C. and Berezin, S. 2004. CVC Lite: A new implementation of the cooperating validity checker. In Proceedings of the 16^th International Conference on Computer Aided Verification (CAV'04). 515--518.
4. Beckman, N. and Nori, A. 2011. Probabilistic, modular and scalable inference of typestate specifications. In Proceedings of the 32^nd ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI'11).
5. Beckman, N. E., Kim, D., and Aldrich, J. 2011. An empirical study of object protocols in the wild. In Proceedings of the 25^th European Conference on Object-Oriented Programming (ECOOP'11).
6. Beschastnikh, I., Brun, Y., Sloan, S., and Ernst, M. 2011. Leveraging existing instrumentation to automatically infer invariant-constrained models. In Proceedings of the 19^th ACM SIGSOFT Symposium and the 13^th European Conference on Foundations of Software Engineering (FSE'11).
7. Beyer, D., Henzinger, T., Jhala, R., and Majumdar, R. 2007. The software model checker blast. Int. J. Softw. Tools Technol. Transfer 9, 5, 505--525.
8. Bierhoff, K. and Aldrich, J. 2008. Plural: Checking protocol compliance under aliasing. In Companion of the 30^th International Conference on Software Engineering (ICSE'08). ACM Press, New York, 971--972.
9. Cok, D. and Kiniry, J. 2005. ESC/Java2: Uniting esc/java and jml. In Proceedings of the International Workshop on Construction and Analysis of Safe, Secure, and Interoperable Smart Devices. Lecture Notes in Computer Science, vol. 3362. Springer, 108--128.
10. Dallmeier, V., Knopp, N., Mallon, C., Hack, S., and Zeller, A. 2010. Generating test cases for specification mining. In Proceedings of the International Symposium on Software Testing and Analysis.
11. Dallmeier, V., Lindig, C., Wasylkowski, A., and Zeller, A. 2006. Mining object behavior with ADABU. In Proceedings of the Workshop on Dynamic Systems Analysis.
12. De Caso, G., Braberman, V., Garbervetsky, D., and Uchitel, S. 2010. Automated abstractions for contract validation. IEEE Trans. Softw. Engin. 38, 1, 141--162.
13. Deline, R. and Fahndrich, M. 2001. Enforcing high-level protocols in low-level software. In Proceedings of the ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI'01). 59--69.
14. Demsky, B. and Rinard, M. 2009. Automatic extraction of heap reference properties in object-oriented programs. IEEE Trans. Softw. Engin. 35, 305--324.
15. Dijkstra, E. 1975. Guarded commands, nondeterminacy and formal derivation of programs. Comm. ACM 18, 8, 453--457.
16. Ernst, M., Perkins, J., Guo, P., Mccamant, S., Pacheco, C., Tschantz, M., and Xiao, C. 2007. The Daikon system for dynamic detection of likely invariants. Sci. Comput. Program. 69, 35--45.
17. Gabel, M. and Su, Z. 2008. Symbolic mining of temporal specifications. In Companion of the 30^th International Conference on Software Engineering (ICSE'08). 51--60.
18. Ghezzi, C., Mocci, A., and Monga, M. 2009. Synthesizing intensional behavior models by graph transformation. In Companion of the 31^st International Conference on Software Engineering (ICSE'09). 430--440.
19. Giannakopoulou, D. and Pasa Reanu, C. 2009. Interface generation and compositional verification in javapathfinder. In Proceedings of the 12^th International Conference on Fundamental Approaches to Software Engineering (FASE'09): Held as Part of the Joint European Conferences on Theory and Practice of Software (ETAPS'09). 94--108.
20. Graf, S. and Saidi, H. 1997. Construction of abstract state graphs with pvs. In Proceedings of the 9^th International Conference on Computer Aided Verification (CAV'97). 72--83.
21. Grieskamp, W., Gurevich, Y., Schulte, W., and Veanes, M. 2002. Generating finite state machines from abstract state machines. In Proceedings of the ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA'02). 112--122.
22. Grieskamp, W., Kicillof, N., Macdonald, D., Nandan, A., Stobie, K., and Wurden, F. 2008. Model-based quality assurance of windows protocol documentation. In Proceedings of the 1^st International Conference on Software Testing, Verification, and Validation (ICST'08). 502--506.
23. Grieskamp, W., Kicillof, N., Stobie, K., and Braberman, V. 2011. Model-based quality assurance of protocol documentation: Tools and methodology. Softw. Testing Verif. Reliabil. 21, 1, 55--71.
24. Henzinger, T., Jhala, R., and Majumdar, R. 2005. Permissive interfaces. In Proceedings of the 10^th European Software Engineering Conference held jointly with the 13^th ACM SIGSOFT International Symposium on Foundations of Software Engineering (ESEC/FSE'05). 31--40.
25. Hodges, W. 1997. A Shorter Model Theory. Cambridge University Press.
26. Khurshid, S., Pasa Reanu, C., and Visser, W. 2003. Generalized symbolic execution for model checking and testing. In Tools and Algorithms for the Construction and Analysis of Systems, 553--568.
27. Klensin, J., Freed, N., Rose, M., Stefferud, E., and Crocker, D. 1995. Smtp service extensions. Tech. rep., RFC 2846.
28. Leavens, G., Leino, K., and Muller, P. 2007. Specification and verification challenges for sequential object-oriented programs. Formal Aspects Comput. 19, 2, 159--189.
29. Lee, D. and Yannakakis, M. 1992. Online minimization of transition systems (extended abstract). In Proceedings of the 24^th Annual ACM Symposium on Theory of Computing (STOC'92). 264--274.
30. Liu, L., Meyer, B., and Schoeller, B. 2007. Using contracts and boolean queries to improve the quality of automatic test generation. In Proceedings of the 1^st International Conference on Tests and Proofs (TAP'07). 114--130.
31. Lorenzoli, D., Mariani, L., and Pezze, M. 2008. Automatic generation of software behavioral models. In Companion of the 30^th International Conference on Software Engineering (ICSE'08). 501--510.
32. Nanda, M., Grothoff, C., and Chandra, S. 2005. Deriving object typestates in the presence of interobject references. ACM SIGPLAN Not. 40, 10, 77--96.
33. Pacheco, C. and Ernst, M. 2007. Randoop: Feedback-directed random testing for java. In Proceeding of the Companion to the 22^nd ACM SIGPLAN Conference on Object-Oriented Programming Systems and Applications Companion (OOPSLA'07). ACM Press, New York, 815--816.
34. Pradel, M. and Gross, T. R. 2009. Automatic generation of object usage specifications from large method traces. In Proceedings of the IEEE/ACM International Conference on Automated Software Engineering (ASE'09). IEEE, 371--382.
35. Strom, R. and Yemini, S. 1986. Typestate: A programming language concept for enhancing software reliability. IEEE Trans. Softw. Engin. 12, 1, 157--171.
36. Uribe, T. 1999. Abstraction-based deductive-algorithmic verification of reactive systems. http://www-step.stanford.edu/papers/dissertations/tomas.pdf.
37. Zoppi, E., Braberman, V., De Caso, G., Garbervetsky, D., and Uchitel, S. 2011. Contractor.net: Inferring typestate properties to enrich code contracts. In Proceedings of the 1^st Workshop on Developing Tools as Plug-ins (TOPI'11). ACM Press, New York, 44--47.

Index Terms

• General and reference

  • Cross-computing tools and techniques

    • Verification

• Software and its engineering

  • Software creation and management

    • Software development process management

    • Software verification and validation

      • Formal software verification

  • Software organization and properties

    • Software functional properties

      • Formal methods

        • Software verification

• Theory of computation

  • Semantics and reasoning

    • Program reasoning

      • Program verification