10.1145/2380116.2380142acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedings
research-article

DejaVu: integrated support for developing interactive camera-based programs

ABSTRACT

The increasing popularity of interactive camera-based programs highlights the inadequacies of conventional IDEs in developing these programs given their distinctive attributes and workflows. We present DejaVu, an IDE enhancement that eases the development of these programs by enabling programmers to visually and continuously monitor program data in consistency with the frame-based pipeline of computer-vision programs; and to easily record, review, and reprocess temporal data to iteratively improve the processing of non-reproducible camera input. DejaVu was positively received by three experienced programmers of interactive camera-based programs in our preliminary user trial.

References

  1. Balzer, R. (1969). EXDAMS: extensible debugging and monitoring system. Spring joint computer conference, p. 567--580. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Bradski, G. (2000). The OpenCV Library. Dr. Dobb's Journal November 2000, Computer Security.Google ScholarGoogle Scholar
  3. Cao, X., Balakrishnan, R. (2003). VisionWand: interaction techniques for large displays using a passive wand tracked in 3D. UIST, p. 173--182. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Cardenas, T., Bastea-Forte, M., Ricciardi, A., Hartmann, B., Klemmer, S. (2008). Testing physical computing prototypes through time-shifted & simulated input traces. UIST adjunct proceedings.Google ScholarGoogle Scholar
  5. Diaz-Marino, R., Greenberg, S. (2006). CAMBIENCE: A Video-Driven Sonic Ecology for Media Spaces. Video Proceedings of CSCW.Google ScholarGoogle Scholar
  6. Edwards, J. (2005). Subtext: Uncovering the simplicity of programming. OOPSLA, p. 505--518. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Fails, J., Olsen, D. (2003). A design tool for camera-based interaction. CHI, p. 449--456. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Geels, D., Altekar, G., Shenker, S., Stoica, I. (2006). Replay debugging for distributed applications. USENIX, p. 289--300. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Hager, G. D., Toyama, K. (1998). X Vision: A portable substrate for real-time vision applications. Computer Vision and Image Understanding, 69(1), p. 23--37. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Hartmann, B., Abdulla, L., Mittal, M., Klemmer, S. R. (2007). Authoring sensor-based interactions by demonstration with direct manipulation and pattern recognition. CHI, p. 145--154. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Hartmann, B., Klemmer, S. R., Bernstein, M., Abdulla, L., Burr, B., Robinson-Mosher, A., Gee, J. (2006). Reflective physical prototyping through integrated design, test, and analysis. UIST, p. 299--308. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Hartmann, B., Yu, L., Allison, A., Yang, Y., Klemmer, S. R. (2008). Design as exploration: creating interface alternatives through parallel authoring and runtime tuning. UIST, p. 91--100. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Klemmer, S. R., Li, J., Lin, J., Landay, J. A. (2004). Papier-Mache: toolkit support for tangible input. CHI, p. 399--406. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Landay, J. and Myers, B. (1995). Interactive sketching for the early stages of user interface design. CHI, p. 43--50. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Maynes-Aminzade, D., Pausch, R., Seitz, S. (2002). Techniques for interactive audience participation. ICMI, p. 15--20. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Maynes-Aminzade, D., Winograd, T., Igarashi, T. (2007). Eyepatch: Prototyping Camera-based Interaction Through Examples. UIST, p. 33--42. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Max/MSP. Cycling '74. http://cycling74.com/products/maxmspGoogle ScholarGoogle Scholar
  18. McDirmid, S. (2007). Living it up with a live programming language. OOPSLA, p. 623--638. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Microsoft Visual Studio Visualizers. http://msdn.microsoft.com/en-us/library/zayyhzts.aspxGoogle ScholarGoogle Scholar
  20. Moher, T. G. (1988). PROVIDE: a process visualization and debugging environment. IEEE Transactions on Software Engineering, 14(6), p. 849--857. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Newman, M. W., Ackerman, M. S., Kim, J., Prakash, A., Hong, Z., Mandel, J., Dong, T. (2010). Bringing the field into the lab: supporting capture and replay of contextual data for the design of context-aware applications. UIST, p. 105--108. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Norman, D. A., Draper, S. W. (1986). User centered system design; new perspectives on human-computer interaction. L. Erlbaum Assoc. Inc. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Patel, K., Bancroft, N., Drucker, S. M., Fogarty, J., Ko, A. J., Landay, J. (2010). Gestalt: integrated support for implementation and analysis in machine learning. UIST, p. 37--46. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Pothier, G., Tanter, E., Piquer, J. (2007). Scalable omniscient debugging. SIGPLAN, p. 535--552. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Segen, J., Kumar, S. (1998). Gesture VR: Vision-based 3D hand interface for spatial interaction. Multimedia. p. 455--464. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. SharpDevelop. http://www.icsharpcode.net/opensource/sd/Google ScholarGoogle Scholar
  27. Visan, A., Arya, K., Cooperman, G., Denniston, T. (2011). URDB: a universal reversible debugger based on decomposing debugging histories. PLOS, p. 1--5. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Wang, S., Xiong, X., Xu, Y., Wang, C., Zhang, W., Dai, X., Zhang, D. (2006). Face-tracking as an augmented input in video games: enhancing presence, role-playing and control. CHI, p. 1097--1106. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Wilson, A. D. (2005). PlayAnywhere: a compact interactive tabletop projection-vision system. UIST, p. 83--92. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Zeller, A., Lütkehaus, D. (1996). DDD - a free graphical front-end for UNIX debuggers. SIGPLAN Notices, 31(1), p. 22--27. Google ScholarGoogle ScholarDigital LibraryDigital Library

Supplemental Material

paper_0211-file3.mp4

Index Terms

  1. DejaVu

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!