article

Eurisko: A program that learns new heuristics and domain concepts

Published:01 March 1983Publication History
Skip Abstract Section

Abstract

The AM program, an early attempt to mechanize learning by discovery, has recently been expanded and extended to several other task domains. AM's ultimate failure apparently was due to its inability to discover new, powerful, domain-specific heuristics for the various new fields it uncovered. At that time, it seemed straight-forward to simply add 'Heuristics' as one more field in which to let AM explore, observe, define, and develop. That task-learning new heuristics by discovery-turned out to be much more difficult than was realized initially, and we have just now achieved some successes at it. Along the way, it became clearer why AM had succeeded in the first place, and why it was so difficult to use the same paradigm to discover new heuristics. In essence, AM was an automatic programming system, whose primitive actions were modifications to pieces of LISP code, code which represented the characteristic functions of various math concepts. It was only because of the deep relationship between LISP and Mathematics that these operations (loop unwinding, recursion elimination, composition, argument elimination, function substitution, etc.) which were basic LISP mutators also turned out to yield a high 'hit rat' of viable, useful new math concepts when applied to previously-known, useful math concepts. But no such deep relationship existed between LISP and Heuristics, and when the basic automatic programming operators were applied to viable, useful heuristics, they almost always produced useless (often worse than useless) new rules. Our work on the nature of heuristics has enabled the construction of a new language in which the statement of heuristics is more natural and compact. Briefly, the vocabulary includes many types of conditions, actions, and descriptive properties that a heuristic might possess; instead of writing a large lump of LISP code to represent the heuristic, one spreads the same information out across dozens of 'slots'. By employing this new language, the old property that AM satisfied fortuitously is once again satisfied: the primitive syntactic operators usually now produce meaningful semantic variants of what they operate on. The ties to the foundations of Heuretics have been engineered into the syntax and vocabulary of the new language, partly by design and partly by evolution, much as John McCarthy engineered ties to the foundations of Mathematics into LISP. The EURISKO program embodies this language, and it is described in this paper, along with its results in eight task domains: design of naval fleets, elementary set theory and number theory, LISP programming, biological evolution, games in general, the design of three-dimensional VLSI devices, the discovery of heuristics which help the system discover heuristics, and the discovery of appropriate new types of 'slots' in each domain. Along the way, some very powerful new concepts, designs, and heuristics were indeed discovered mechanically. Characteristics that make a domain ripe for AM-like exploration for new concepts and conjectures are explicated, plus features that make a domain especially suitable for EURISKO-level exploration for new heuristics.

References

  1. 1. On the representation of problems of reasoning about actions. In: Michie, D. (Ed.), Machine Intelligence, 3. Elsevier, New York. pp. 131-171.Google ScholarGoogle Scholar
  2. 2. A man-machine theorem-proving system. Artificial Intelligence. v5. 51-72.Google ScholarGoogle Scholar
  3. 3. In: Knowledge Based Systems in AI, McGraw-Hill, New York.Google ScholarGoogle Scholar
  4. 4. Knowledge engineering: the practical side of artificial intelligence. In: HPP Memo, Stanford University, Stanford, CA.Google ScholarGoogle Scholar
  5. 5. One-gate-wide CMOS inverter on laser-recrystalized polysilicon. IEEE Electron Device Letters. v1 i6.Google ScholarGoogle Scholar
  6. 6. In: Hayes-Roth, F., Waterman, D., Lenat, D. (Eds.), Building Expert Systems, Proc. 1980 San Diego Workshop in Expert Systems, Addison-Wesley, Reading, MA.Google ScholarGoogle Scholar
  7. 7. In: Surrel Numbers, Addison-Wesley, Reading, MA.Google ScholarGoogle Scholar
  8. 8. RLL: a representation language language. In: Proc. First Annual Meeting of the American Association for Artificial Intelligence,Google ScholarGoogle Scholar
  9. 9. The nature of heuristics. In: Artificial Intelligence, 19. pp. 189-249.Google ScholarGoogle Scholar
  10. 10. Learning by discovery: three case studies in natural and artificial learning systems. In: Michalski, R.S., Mitchell, T., Carbonell, J.G. (Eds.), Machine Learning, Tioga Press, Palo Alto, CA.Google ScholarGoogle Scholar
  11. 11. Heuristic search for new microcircuit strutures. AI Magazine. v3 i3. 17-33.Google ScholarGoogle Scholar
  12. 12. Theory formation by heuristic search; the nature of heuristics II: Backgroud and examples. Artificial Intelligence. v21 i1, 2. 31-59. Google ScholarGoogle Scholar
  13. 13. Some philosophical problems from the standpoint of artificial intelligence. In: Meltzer, B., Michie, D. (Eds.), Machine Intelligence, 4. Edinburgh University Press, Edinburgh. pp. 463-502.Google ScholarGoogle Scholar
  14. 14. Results of the 1981 Trillion credit squadron competition. J. Travellers Aid Soc.Google ScholarGoogle Scholar

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in

Full Access

  • Published in

    cover image Artificial Intelligence
    Artificial Intelligence  Volume 21, Issue 1-2
    March, 1983
    267 pages

    Copyright © North-Holland © 1983

    Publisher

    Elsevier Science Publishers Ltd.

    United Kingdom

    Publication History

    • Published: 1 March 1983

    Qualifiers

    • article
About Cookies On This Site

We use cookies to ensure that we give you the best experience on our website.

Learn more

Got it!