Abstract
A well-known issue with compiler conformance testing is that the tested environment may differ from the end user's environment, in ways that defy analysis. Possible differences include the host or target computer instruction set, the host or target computer operating system version, version differences in various components of the compilation system, and differences in compilation switch settings. Most of these differences can be eliminated by retesting in the end-user's actual environment. However, if the end user's environment includes compilation switches that suppress some or all of Ada's run-time checks, which we believe to be quite common, it is not currently feasible to re-run ACATS testing in that mode. That is because many ACATS tests rely on run-time checking, and those tests are not segregated or otherwise identified. We propose to remedy this difficulty by identifying such tests, so that the remaining tests can all be run and expected to pass with compilation flags that suppress some or all checks.
- Baptiste Fouques, list of errors whose detection is required by RM, comp.lang.ada, August 8, 2011. http://groups.google.com/forum/#!topic/comp.lang.ada/-5HAYDbXmuI Reprinted in Ada User Journal, Vol 32, No 4 December 2011.Google Scholar
- Randall L. Brukardt, Ada Conformity Assessment Test Suite (ACATS), http://www.ada-auth.org/acats.html.Google Scholar
- S. Tucker Taft, Robert A. Duff, Randall L. Brukardt, Erhard Ploedereder, Pascal Leroy, (Eds.) Ada 2005 Reference Manual. Language and Standard Libraries. International Standard ISO/IEC 8652/1995(E) with Technical Corrigendum 1 and Amendment 1, Lecture Notes in Computer Science, Vol. 4348, Springer, 2006. Google Scholar
Digital Library
- J.-P. Rosen, The Ada paradoxes(es), ACM SIGAda Ada Letters, Vol 29, Issue 2, August 2009, pp 28--35. Google Scholar
Digital Library
- Dan Eilers and Tero Koskinen, Adapting ACATS to the Ahven Testing Framework. Reliable Software Technologies -- Ada-Europe 2011, Lecture Notes in Computer Science, 2011, Vol. 6652/2011, pp. 75--88. Google Scholar
Digital Library
- Dan Eilers and Tero Koskinen, Making the non-executable ACATS tests executable. SIGAda 2011, pp. 75--80. Google Scholar
Digital Library
- Ada Resource Association, Operating Procedures for Ada Conformity Assessments, Version 3.0, 2001. http://www.ada-auth.org/procs/3.0/ACAP30.htmlGoogle Scholar
- Tery L. Hardy, Software and System Safety: Accidents, Incidents, and Lessons Learned, 2012; p. 223.Google Scholar
- Ada Compiler Validation Implementers' Guide, SofTech, Inc., Waltham, Massachusetts, October, 1980.Google Scholar
Index Terms
Adapting ACATS for use with run-time checks suppressed
Recommendations
Adapting ACATS for use with run-time checks suppressed
HILT '12: Proceedings of the 2012 ACM conference on High integrity language technologyA well-known issue with compiler conformance testing is that the tested environment may differ from the end user's environment, in ways that defy analysis. Possible differences include the host or target computer instruction set, the host or target ...
Adapting ACATS to the Ahven testing framework
Ada-Europe'11: Proceedings of the 16th Ada-Europe international conference on Reliable software technologiesThe Ada Conformity Assessment Test Suite (ACATS) includes thousands of individual executable test programs, but no test driver or tools for grading the output. We show how ACATS can be adapted to work with the Ahven testing framework, resulting in a ...
Making the non-executable ACATS tests executable
The Ada Conformity Assessment Test Suite (ACATS) includes both positive and negative tests. The negative tests have intentional errors that a compiler is intended to diagnose with a compile-time error message. Interestingly, the negative tests also ...







Comments