skip to main content
research-article

Making the non-executable ACATS tests executable

Published:06 November 2011Publication History
Skip Abstract Section

Abstract

The Ada Conformity Assessment Test Suite (ACATS) includes both positive and negative tests. The negative tests have intentional errors that a compiler is intended to diagnose with a compile-time error message. Interestingly, the negative tests also include numerous "OK" lines that the compiler must not reject. But the absence of an error message on the "OK" lines is not always a convincing demonstration that the "OK" lines were correctly compiled, since the negative tests are not executable. By removing the intentional errors from a copy of each negative test, we are able to compile and run the resulting modified tests, demonstrating more convincingly that the "OK" lines are correctly compiled.

References

  1. Randall L. Brukardt, "Ada Conformity Assessment Test Suite (ACATS)," http://www.ada-auth.org/acats.html.Google ScholarGoogle Scholar
  2. {2} IEC 61508--3:2010 Functional safety of electrical/electronic/programmable electronic safety-related systems, Part 3: Software requirements, 2010.Google ScholarGoogle Scholar
  3. S. Tucker Taft, Robert A. Duff, Randall L. Brukardt, Erhard Ploedereder, Pascal Leroy, (Eds.) Ada 2005 Reference Manual. Language and Standard Libraries. International Standard ISO/IEC 8652/1995(E) with Technical Corrigendum 1 and Amendment 1, Lecture Notes in Computer Science, Vol. 4348, Springer, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. DARPA contract for Ada83 ACVC development, MDA903--79-C-0687, 1979.Google ScholarGoogle Scholar
  5. DISA contract for Ada95 ACVC development DCA100--97-D-0025.Google ScholarGoogle Scholar
  6. Ada Compiler Validation Implementers' Guide, SofTech, Waltham, Massachusett| October, 1980.Google ScholarGoogle Scholar
  7. John B. Goodenough, "The Ada Compiler Validation Capability," Computer, vol. 13, no. 6, pp. 57--64, June 1981, doi:10.1109/C-M.1981.220496. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Randall L. Brukardt, Ada Conformity Assessment Test Suite (ACATS) User's Guide, Version 3.0, 2008, http://www.ada-auth.org/acats-files/3.0/docs/ACATS-UG.PDF.Google ScholarGoogle Scholar
  9. Donald E. Knuth, Preface to Selected Papers on Analysis of Algorithms, Stanford, California: Center for the Study of Language and Information, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Dan Eilers and Tero Koskinen, Adapting ACATS to the Ahven Testing Framework, Reliable Software Technologies - Ada-Europe 2011, Lecture Notes in Computer Science, 2011, Vol. 6652/2011, pp. 75--88. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Tero Koskinen, Ahven developer, http://sourceforge.net/projects/ahven.Google ScholarGoogle Scholar
  12. Robert Eachus, Personal communication, May 2010.Google ScholarGoogle Scholar
  13. Randall L. Brukardt, ACATS 3.0 Test Objectives (partial), 2007. http://www.ada-auth.org/acats-files/3.0/devs/TESTOBJ.ZIPGoogle ScholarGoogle Scholar

Index Terms

  1. Making the non-executable ACATS tests executable

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in

            Full Access

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader
            About Cookies On This Site

            We use cookies to ensure that we give you the best experience on our website.

            Learn more

            Got it!