C-blink: a hue-difference-based light signal marker for large screen interaction via any mobile terminal

ABSTRACT

To enable common mobile terminals to interact with contents shown on large screens, we propose "C-Blink", a new light signal marker method that uses the color liquid-crystal display of a mobile terminal as a visible light source. We overcome the performance limitations of such displays by developing a hue-difference-blink technique. In combination with a screen-side sensor, we describe a system that detects and receives light signal markers sent by cell phone displays. Evaluations of a prototype system confirm that C-Blink performs well under common indoor lighting. The C-Blink program can be installed in any mobile terminal that has a color display, and the installation costs are small. C-Blink is a very useful way of enabling ubiquitous large screens to become interfaces for mobile terminals.

References

1. Olsen, D. and Nielsen, T. Laser Pointer Interaction. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI2001), 2001, pp.17--22.
2. Oh, J.-Y. and Stuerzlinger, W. Laser pointer as collaborative pointing devices. In Proceedings of Graphics Interface (GI2002), 2002, pp.141--149.
3. Vogt, F., Wong, J., Fels, S. and Cavens, D. Tracking multiple laser pointers for large screen interaction. Extended Abstracts of the ACM Symposium on User Interface Software and Technology (UIST2003), 2003, pp. 95--96.
4. Matsushita, N., Hihara, D., Ushiro, T., Yoshimura, S., Rekimoto, J. and Yamamoto, Y. ID CAM: a smart camera for scene capturing and ID recognition. In Proceedings of the Second IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'03), 2003, pp. 227--236.
5. Moore, D. J., Want, R., Harrion, L. B., Gujar, A. and Fishkin, K. Implementing phicons: combining computer vision with infrared technology for interactive physical icon. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST`99), 1999, pp. 67--68.
6. Aoki, H. and Matsushita, S. Balloon Tag: (in)visible marker which tells who's who. In Proceedings of the Fourth International Symposium on Wearable Computers (ISWC'00), 2000, pp. 181--182.
7. Kishino, Y., Tsukamoto, M., Sakane, Y., and Nishio, S. Realizing a visual marker using LEDs for wearable computing environment. In Proceedings of IEEE International Conference on Distributed Computing Systems Workshops (ICDCSW'03), 2003 pp. 314--319.
8. Rekimoto, J. and Ayatsuka, Y. CyberCode: designing augmented reality environments with visual tags. In Proceedings of DARE'00 on Designing Augmented Reality Environments, 2000, pp. 1--10.
9. Cho, Y. and Neumann, U. Multi-ring color fiducial systems for scalable fiducial tracking augmented reality. In Proceedings of IEEE Virtual Reality Annual International Symposium (VRAIS '98), 1998, page212.
10. Thomas,G.A., Jin, J., Niblett, T., and Urquhart, C. A versatile camera position measurement system for virtual reality TV production. In Proceedings of International Broadcasting Convention (IBC '97), 1997, pp.284--289.
11. Fairchild, M.D. Color Appearance Models. Addison-Wesley, Reading, MA, 1998.
12. Kohtake, N., Rekimoto, J., and Anzai, Y. InfoPoint: A device that provides a uniform user interface to allow appliances to work together over a network. Personal and Ubiquitous Computing, vol. 5, no. 4, (2001), pp.264--274.
13. Rekimoto, J. Pick-and-Drop: A direct manipulation technique for multiple computer environments. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST`97), 1997, pp. 31--39.
14. Hosoya, E., Kitabata, M., Sato, H., Harada, I., Nojima, H., Morisawa, F., Mutoh, S., and Onozawa, A. A Mirror Metaphor Interaction System: Touching Remote Real Objects in an Augmented Reality Environment. In Proceedings of the Second IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'03), 2003, pp.350--351.
15. Morikawa, O. and Maesato, T. HyperMirror - Toward Pleasant-to-use Video Mediated Communication System. In Proceeding of the ACM Conference on Computer-Supported Cooperative Work (CSCW'98), 1998, pp. 149--152.
16. Maes, P., Darrell, T., Blumberg, B. and Pentland, A. The ALIVE System: Wireless, Full-body Interaction with Autonomous Agents. The ACM Multimedia Systems, Vol. 5, No. 2, 1997, pp. 105--112.
17. Krueger, M.W., Gionfriddo, T. and Hinrichsen, K. VIDEOPLACE--An Artificial Reality. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI'85), 1985, pp. 35--40.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

  • Computer graphics

    • Graphics systems and interfaces

• Hardware

  • Communication hardware, interfaces and storage

    • Signal processing systems

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Graphics input devices

      • Touch screens