Abstract
The Ada Conformity Assessment Test Suite (ACATS) includes both positive and negative tests. The negative tests have intentional errors that a compiler is intended to diagnose with a compile-time error message. Interestingly, the negative tests also include numerous "OK" lines that the compiler must not reject. But the absence of an error message on the "OK" lines is not always a convincing demonstration that the "OK" lines were correctly compiled, since the negative tests are not executable. By removing the intentional errors from a copy of each negative test, we are able to compile and run the resulting modified tests, demonstrating more convincingly that the "OK" lines are correctly compiled.
- Randall L. Brukardt, "Ada Conformity Assessment Test Suite (ACATS)," http://www.ada-auth.org/acats.html.Google Scholar
- {2} IEC 61508--3:2010 Functional safety of electrical/electronic/programmable electronic safety-related systems, Part 3: Software requirements, 2010.Google Scholar
- S. Tucker Taft, Robert A. Duff, Randall L. Brukardt, Erhard Ploedereder, Pascal Leroy, (Eds.) Ada 2005 Reference Manual. Language and Standard Libraries. International Standard ISO/IEC 8652/1995(E) with Technical Corrigendum 1 and Amendment 1, Lecture Notes in Computer Science, Vol. 4348, Springer, 2006. Google Scholar
Digital Library
- DARPA contract for Ada83 ACVC development, MDA903--79-C-0687, 1979.Google Scholar
- DISA contract for Ada95 ACVC development DCA100--97-D-0025.Google Scholar
- Ada Compiler Validation Implementers' Guide, SofTech, Waltham, Massachusett| October, 1980.Google Scholar
- John B. Goodenough, "The Ada Compiler Validation Capability," Computer, vol. 13, no. 6, pp. 57--64, June 1981, doi:10.1109/C-M.1981.220496. Google Scholar
Digital Library
- Randall L. Brukardt, Ada Conformity Assessment Test Suite (ACATS) User's Guide, Version 3.0, 2008, http://www.ada-auth.org/acats-files/3.0/docs/ACATS-UG.PDF.Google Scholar
- Donald E. Knuth, Preface to Selected Papers on Analysis of Algorithms, Stanford, California: Center for the Study of Language and Information, 2000. Google Scholar
Digital Library
- Dan Eilers and Tero Koskinen, Adapting ACATS to the Ahven Testing Framework, Reliable Software Technologies - Ada-Europe 2011, Lecture Notes in Computer Science, 2011, Vol. 6652/2011, pp. 75--88. Google Scholar
Digital Library
- Tero Koskinen, Ahven developer, http://sourceforge.net/projects/ahven.Google Scholar
- Robert Eachus, Personal communication, May 2010.Google Scholar
- Randall L. Brukardt, ACATS 3.0 Test Objectives (partial), 2007. http://www.ada-auth.org/acats-files/3.0/devs/TESTOBJ.ZIPGoogle Scholar
Index Terms
Making the non-executable ACATS tests executable
Recommendations
Making the non-executable ACATS tests executable
SIGAda '11: Proceedings of the 2011 ACM annual international conference on Special interest group on the ada programming languageThe Ada Conformity Assessment Test Suite (ACATS) includes both positive and negative tests. The negative tests have intentional errors that a compiler is intended to diagnose with a compile-time error message. Interestingly, the negative tests also ...
Adapting ACATS to the Ahven testing framework
Ada-Europe'11: Proceedings of the 16th Ada-Europe international conference on Reliable software technologiesThe Ada Conformity Assessment Test Suite (ACATS) includes thousands of individual executable test programs, but no test driver or tools for grading the output. We show how ACATS can be adapted to work with the Ahven testing framework, resulting in a ...
Adapting ACATS for use with run-time checks suppressed
HILT '12: Proceedings of the 2012 ACM conference on High integrity language technologyA well-known issue with compiler conformance testing is that the tested environment may differ from the end user's environment, in ways that defy analysis. Possible differences include the host or target computer instruction set, the host or target ...







Comments