ABSTRACT

The increasing popularity of interactive camera-based programs highlights the inadequacies of conventional IDEs in developing these programs given their distinctive attributes and workflows. We present DejaVu, an IDE enhancement that eases the development of these programs by enabling programmers to visually and continuously monitor program data in consistency with the frame-based pipeline of computer-vision programs; and to easily record, review, and reprocess temporal data to iteratively improve the processing of non-reproducible camera input. DejaVu was positively received by three experienced programmers of interactive camera-based programs in our preliminary user trial.
References
- Balzer, R. (1969). EXDAMS: extensible debugging and monitoring system. Spring joint computer conference, p. 567--580. Google Scholar
Digital Library
- Bradski, G. (2000). The OpenCV Library. Dr. Dobb's Journal November 2000, Computer Security.Google Scholar
- Cao, X., Balakrishnan, R. (2003). VisionWand: interaction techniques for large displays using a passive wand tracked in 3D. UIST, p. 173--182. Google Scholar
Digital Library
- Cardenas, T., Bastea-Forte, M., Ricciardi, A., Hartmann, B., Klemmer, S. (2008). Testing physical computing prototypes through time-shifted & simulated input traces. UIST adjunct proceedings.Google Scholar
- Diaz-Marino, R., Greenberg, S. (2006). CAMBIENCE: A Video-Driven Sonic Ecology for Media Spaces. Video Proceedings of CSCW.Google Scholar
- Edwards, J. (2005). Subtext: Uncovering the simplicity of programming. OOPSLA, p. 505--518. Google Scholar
Digital Library
- Fails, J., Olsen, D. (2003). A design tool for camera-based interaction. CHI, p. 449--456. Google Scholar
Digital Library
- Geels, D., Altekar, G., Shenker, S., Stoica, I. (2006). Replay debugging for distributed applications. USENIX, p. 289--300. Google Scholar
Digital Library
- Hager, G. D., Toyama, K. (1998). X Vision: A portable substrate for real-time vision applications. Computer Vision and Image Understanding, 69(1), p. 23--37. Google Scholar
Digital Library
- Hartmann, B., Abdulla, L., Mittal, M., Klemmer, S. R. (2007). Authoring sensor-based interactions by demonstration with direct manipulation and pattern recognition. CHI, p. 145--154. Google Scholar
Digital Library
- Hartmann, B., Klemmer, S. R., Bernstein, M., Abdulla, L., Burr, B., Robinson-Mosher, A., Gee, J. (2006). Reflective physical prototyping through integrated design, test, and analysis. UIST, p. 299--308. Google Scholar
Digital Library
- Hartmann, B., Yu, L., Allison, A., Yang, Y., Klemmer, S. R. (2008). Design as exploration: creating interface alternatives through parallel authoring and runtime tuning. UIST, p. 91--100. Google Scholar
Digital Library
- Klemmer, S. R., Li, J., Lin, J., Landay, J. A. (2004). Papier-Mache: toolkit support for tangible input. CHI, p. 399--406. Google Scholar
Digital Library
- Landay, J. and Myers, B. (1995). Interactive sketching for the early stages of user interface design. CHI, p. 43--50. Google Scholar
Digital Library
- Maynes-Aminzade, D., Pausch, R., Seitz, S. (2002). Techniques for interactive audience participation. ICMI, p. 15--20. Google Scholar
Digital Library
- Maynes-Aminzade, D., Winograd, T., Igarashi, T. (2007). Eyepatch: Prototyping Camera-based Interaction Through Examples. UIST, p. 33--42. Google Scholar
Digital Library
- Max/MSP. Cycling '74. http://cycling74.com/products/maxmspGoogle Scholar
- McDirmid, S. (2007). Living it up with a live programming language. OOPSLA, p. 623--638. Google Scholar
Digital Library
- Microsoft Visual Studio Visualizers. http://msdn.microsoft.com/en-us/library/zayyhzts.aspxGoogle Scholar
- Moher, T. G. (1988). PROVIDE: a process visualization and debugging environment. IEEE Transactions on Software Engineering, 14(6), p. 849--857. Google Scholar
Digital Library
- Newman, M. W., Ackerman, M. S., Kim, J., Prakash, A., Hong, Z., Mandel, J., Dong, T. (2010). Bringing the field into the lab: supporting capture and replay of contextual data for the design of context-aware applications. UIST, p. 105--108. Google Scholar
Digital Library
- Norman, D. A., Draper, S. W. (1986). User centered system design; new perspectives on human-computer interaction. L. Erlbaum Assoc. Inc. Google Scholar
Digital Library
- Patel, K., Bancroft, N., Drucker, S. M., Fogarty, J., Ko, A. J., Landay, J. (2010). Gestalt: integrated support for implementation and analysis in machine learning. UIST, p. 37--46. Google Scholar
Digital Library
- Pothier, G., Tanter, E., Piquer, J. (2007). Scalable omniscient debugging. SIGPLAN, p. 535--552. Google Scholar
Digital Library
- Segen, J., Kumar, S. (1998). Gesture VR: Vision-based 3D hand interface for spatial interaction. Multimedia. p. 455--464. Google Scholar
Digital Library
- SharpDevelop. http://www.icsharpcode.net/opensource/sd/Google Scholar
- Visan, A., Arya, K., Cooperman, G., Denniston, T. (2011). URDB: a universal reversible debugger based on decomposing debugging histories. PLOS, p. 1--5. Google Scholar
Digital Library
- Wang, S., Xiong, X., Xu, Y., Wang, C., Zhang, W., Dai, X., Zhang, D. (2006). Face-tracking as an augmented input in video games: enhancing presence, role-playing and control. CHI, p. 1097--1106. Google Scholar
Digital Library
- Wilson, A. D. (2005). PlayAnywhere: a compact interactive tabletop projection-vision system. UIST, p. 83--92. Google Scholar
Digital Library
- Zeller, A., Lütkehaus, D. (1996). DDD - a free graphical front-end for UNIX debuggers. SIGPLAN Notices, 31(1), p. 22--27. Google Scholar
Digital Library
Supplemental Material
Index Terms
DejaVu


Jun Kato




Comments