Physical programming: designing tools for children to create physical interactive environments

ABSTRACT

Physical interactive environments can come in many forms: museum installations, amusement parks, experimental theaters, and more. Programming these environments has historically been done by adults, and children, as the visiting participants, have been offered few pre-created choices to explore. Given these creative limitations, the goal of our research has been to develop programming tools for physical interactive environments that are appropriate for use by young children (ages 4-6). We have explored numerous design approaches over the past two years. Recently we began focusing on a "physical programming" approach and developed a wizard-of-oz prototype for young children. This paper presents the motivation for this research, the evolution of our programming approach, and our recent explorations with children

References

1. Abowd, G. D., and Mynatt, E. D. Charting past, present and future research in ubiquitous computing. ACM Transactions on Computer-Human Interaction, Special issue on HCI in the new Millenium 7, 1 (March 2000), 29--58.
2. Alborzi, H., Druin, A., Montemayor, J., Platner, M., Porteous, J., Sherman, L., Boltman, A., Tax¿En, G., Best, J., Hammer, J., Kruskal, A., Lal, A., Plaisant-Schwenn, T., Sumida, L., Wagner, R., and Hendler, J. Designing StoryRooms: Interactive storytelling spaces for children. In Proceedings of Designing Interactive Systems (DIS-2000) (2000), ACM Press, 95--104.
3. Annany, M., and Cassell, J. Telltale: A toy to encourage written literacy skills through oral storytelling. Presentation at Conference on Text, Discourse and Cognition (Winter 2001).
4. Assey, J. The Future of Technology in K-12 Arts Education. White Paper for the U.S. Department of Education, Requested as a result of: Forum on Technology in Education: Envisioning the Future. (2000), http://www.air.org/forum/Assey.pdf.
5. Bobick, A., Intille, S. S., Davis, J. W., Baird, F., Pinhanez, C. S., Campbell, L. W., Ivanov, Y. A., Schutte, A., and Wilson, A. The kidsroom: A perceptually-based interactive and immersive story environment. In PRESENCE: Teleoperators and Virtual Environments (August 1999), 367---391.
6. Brosterman, N. Inventing Kindergarten. Harry N. Adams Inc., 1997.
7. Bruner, J. Toward a theory of instruction. Harvard University Press, 1966.
8. Cypher, A., and Smith, D. Kidsim: End-user programming of simulations. In Proceedings of CHI 95 (1995), ACM Press, 27--34.
9. Druin, A. Cooperative inquiry: Developing new technologies for children with children. In Proceedings of CHI 99 (1999), ACM Press, 592--599.
10. Druin, A., and Perlin, K. Immersive environments: A physical approach to the computer interface. In Proceedings of CHI 94 (1994), ACM Press, 325--326.
11. Druin, A., Montemayor, J., Hendler, J., McAlister, B., Boltman, A., Fiterman, E., Plaisant, A., Kruskal, A., Olsen, H., Revett, I., Plaisant-Schwenn, T., Sumida, L., and Wagner, R. Designing PETS: A personal electronic teller of stories. In Proceedings of CHI 99(1999), ACM Press, 326--329.
12. Fitzmaurice, G. W., Ishii, H., and Buxton, W. Bricks: Laying the foundations for graspable user interfaces. In Proceedings of CHI 95 (1995), 442--449.
13. Frei, P., Su, V., Mikhak, B., and Ishii, H. curlybot: Designing a new class of computational toys. In Proceedings of CHI 2000, CHI Letters, 2(1), (2000), ACM Press, 129--136.
14. Geisel, T. The Sneetches, and other stories. Random House, New York, 1961.
15. Given, N. & Barlex, D. The Role of Published Materials in Curriculum Development and Implementation for Secondary School Design and Technology in England and Wales. International Journal of Technology and Design Education,11(2), 2001, http://www.wkap.nl/sample.pdf?313033.
16. Ishii, H., and Ullmer, B. Tangible bits: Towards seamless interfaces between people, bits and atoms. In Proceedings of CHI 97 (1997), ACM Press, 234--241.
17. Kahn, K. Generalizing by removing detail: How any program can be created by working with examples, 2000. Available at http://www.animatedprograms.com/PBD/index.html.
18. Mackay, W., Velay, G., Carter, K., Ma, C., and Pagani, D. Augmenting reality: Adding computational dimensions to paper. Computer-Augmented Environ-ments: Back to the Real World. Special issue of Communications of the ACM 36, 7 (1993).
19. Martin, F., Mikhak, B., Resnick, M., Silverman, B., and Berg, R. To mindstorms and beyond: Evolution of a construction kit for magical machines. In Robots for kids: New technologies for learning, A. Druin and J. Hendler, Eds. Morgan Kaufmann, San Francisco CA, 2000, 9--33.
20. McNerney, T. S. Tangible programming bricks: An approach to making programming accessible to everyone. Master's thesis, MIT Media Lab, 2000.
21. Myers, B., and Buxton, W. Creating highly-interactive and graphical user interfaces by demonstration, computer graphics 20(3). In Proceedings of SIGGRAPH '86 (1986), 249--258.
22. Papert, S. Mindstorms: Children, computers and powerful ideas. Basic Books, New York, 1980.
23. Resnick, M., Martin, F., Berg, R., Borovoy, R., Colella, V., Kramer, K., and Silverman, B. Digital manipulatives: New toys to think with. In Proceedings of CHI 98 (1998), ACM Press, 281--287.
24. Roschelle, J. M, Pea, R. D., Hoadley, C. M., Gordin, D. N., & Means, B. Changing How and What Children Learn in School with Computer-Based Technologies. The Future of Children: Children and Computer Technology, 10(2), (Fall/Winter 2000).
25. Salber, D., Dey, A., and Abowd, G. Ubiquitous computing: Defining an hci research agenda for an emerging interaction paradigm. Tech. rep., Georgia Institute of Technology, (1998), Tech. Report GIT-GVU-98-01.
26. Edwin Schlossberg Incorporated. url: http://www.esidesign.com/.
27. Semper, R. J. Science museums as environments for learning. Physics Today (November 1990), 50--56.
28. Smith, D. C. Pygmalion: An executable electronic blackboard. In Watch What I Do: Programming by Demonstration, A. Cypher, D. C. Halbert, D. Kurlander, H. Lieberman, D. Maulsby, B. A. Myers, and A. Turransky, Eds. MIT Press, 1993, ch. 1.
29. Strommen, E. When the interface is a talking dinosaur: Learning across media with actimates barney. In Proceedings of CHI 98 (1998), ACM Press, 288--295.
30. Umaschi, M. Soft toys with computer hearts: Building personal storytelling environments. In Proceedings of CHI 97 (1997), ACM Press, 20--21.
31. Weiser, M. The computer for the twenty-first century. Scientific American (September 1991), 94--104.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision problems

        • Reconstruction

• Human-centered computing

  • Human computer interaction (HCI)

• Software and its engineering

  • Software notations and tools

    • Development frameworks and environments