ABSTRACT

We present JOLED, a mid-air display for interactive physical visualization using Janus objects as physical voxels. The Janus objects have special surfaces that have two or more asymmetric physical properties at different areas. In JOLED, they are levitated in mid-air and controllably rotated to reveal their different physical properties. We made voxels by coating the hemispheres of expanded polystyrene beads with different materials, and applied a thin patch of titanium dioxide to induce electrostatic charge on them. Transparent indium tin oxide electrodes are used around the levitation volume to create a tailored electric field to control the orientation of the voxels. We propose a novel method to control the angular position of individual voxels in a grid using electrostatic rotation and their 3D position using acoustic levitation. We present a display in which voxels can be flipped independently, and two mid-air physical games with a voxel as the playable character that moves in 3D across other physical structures and rotates to reflect its status in the games. We demonstrate a voxel update speed of 37.8 ms/flip, which is video-rate.
References
- Sankyo International, Reed relay. http://www.sankyointernational.co.jp/ denshibuhin/reed_relay/02.html.Google Scholar
- 9613--1:1993, I. Acoustics -- attenuation of sound during propagation outdoors -- part 1: Calculation of the absorption of sound by the atmosphere, 2015.Google Scholar
- 9613--2:1996, I. Acoustics -- attenuation of sound during propagation outdoors -- part 2: General method of calculation, 2012.Google Scholar
- Barnum, P. C., Narasimhan, S. G., and Kanade, T. A multi-layered display with water drops. ACM Trans. Graph. 29, 4 (July 2010), 76:1--76:7. Google Scholar
Digital Library
- Demierre, N., Braschler, T., Linderholm, P., Seger, U., van Lintel, H., and Renaud, P. Characterization and optimization of liquid electrodes for lateral dielectrophoresis. Lab Chip 7 (2007), 355--365. Google Scholar
Cross Ref
- Eitoku, S., Tanikawa, T., and Suzuki, Y. Display composed of water drops for filling space with materialized virtual three-dimensional objects. In Virtual Reality Conference, 2006 (March 2006), 159--166. Google Scholar
Digital Library
- Foresti, D., Nabavi, M., Klingauf, M., Ferrari, A., and Poulikakos, D. Acoustophoretic contactless transport and handling of matter in air. Proceedings of the National Academy of Sciences 110, 31 (2013), 12549--12554. Google Scholar
Cross Ref
- Grossman, T., and Wigdor, D. Going deeper: a taxonomy of 3d on the tabletop. In Horizontal Interactive Human-Computer Systems, 2007. TABLETOP '07. Second Annual IEEE International Workshop on (Oct 2007), 137--144.Google Scholar
Cross Ref
- Hilliges, O., Kim, D., Izadi, S., Weiss, M., and Wilson, A. Holodesk: Direct 3d interactions with a situated see-through display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '12, ACM (New York, NY, USA, 2012), 2421--2430. Google Scholar
Digital Library
- Hong, J., Yoon, D. S., Kim, S. K., Kim, T. S., Kim, S., Pak, E. Y., and No, K. Ac frequency characteristics of coplanar impedance sensors as design parameters. Lab Chip 5 (2005), 270--279. Google Scholar
Cross Ref
- Howard, M. E., Richley, E. A., Sprague, R., and Sheridon, N. K. Gyricon electric paper. Journal of the Society for Information Display 6, 4 (1998), 215--217. Google Scholar
Cross Ref
- Jansen, Y., Dragicevic, P., Isenberg, P., Alexander, J., Karnik, A., Kildal, J., Subramanian, S., and Hornbæk, K. Opportunities and challenges for data physicalization. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI '15, ACM (New York, NY, USA, 2015), 3227--3236. Google Scholar
Digital Library
- Kimura, H., Asano, A., Fujishiro, I., Nakatani, A., and Watanabe, H. True 3d display. In ACM SIGGRAPH 2011 Emerging Technologies, SIGGRAPH '11, ACM (New York, NY, USA, 2011), 20:1--20:1. Google Scholar
Digital Library
- Lawton, B. W. Damage to human hearing by airborne sound of very high frequency or ultrasonic frequency, 2001.Google Scholar
- Lee, C., DiVerdi, S., and Hollerer, T. Depth-fused 3d imagery on an immaterial display. IEEE Transactions on Visualization and Computer Graphics 15, 1 (Jan 2009), 20--33. Google Scholar
Digital Library
- Lee, J., Post, R., and Ishii, H. Zeron: Mid-air tangible interaction enabled by computer controlled magnetic levitation. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, UIST '11, ACM (New York, NY, USA, 2011), 327--336. Google Scholar
Digital Library
- Long, B., Seah, S. A., Carter, T., and Subramanian, S. Rendering volumetric haptic shapes in mid-air using ultrasound. ACM Transactions on Graphics (TOG) 33, 6 (2014), 181. Google Scholar
Digital Library
- Martinez Plasencia, D., Joyce, E., and Subramanian, S. Mistable: Reach-through personal screens for tabletops. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems, CHI '14, ACM (New York, NY, USA, 2014), 3493--3502. Google Scholar
Digital Library
- Marzo, A., Seah, S. A., Drinkwater, B. W., Sahoo, D. R., Long, B., and Subramanian, S. Holographic acoustic elements for manipulation of levitated objects. Nature Communications 6, 8661 (October 2015). Google Scholar
Cross Ref
- Matoba, Y., Tokui, T., Sato, R., Sato, T., and Koike, H. Splashdisplay. In Proceedings of the 2012 Virtual Reality International Conference, VRIC '12, ACM (New York, NY, USA, 2012), 27:1--27:4. Google Scholar
Digital Library
- Nakamura, M., Inaba, G., Tamaoki, J., Shiratori, K., and Hoshino, J. Mounting and application of bubble display system: Bubble cosmos. In Proceedings of the 2006 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, ACE '06, ACM (New York, NY, USA, 2006). Google Scholar
Digital Library
- Nash, S. G., and Nocedal, J. A numerical study of the limited memory bfgs method and the truncated-newton method for large scale optimization. SIAM Journal on Optimization 1, 3 (1991), 358--372. Google Scholar
Cross Ref
- NIST. EEEL Safety rules for moderate and high voltages, 2008.Google Scholar
- Ochiai, Y., Hoshi, T., and Rekimoto, J. Pixie dust: Graphics generated by levitated and animated objects in computational acoustic-potential field. ACM Trans. Graph. 33, 4 (July 2014), 85:1--85:13. Google Scholar
Digital Library
- Ochiai, Y., Kumagai, K., Hoshi, T., Rekimoto, J., Hasegawa, S., and Hayasaki, Y. Fairy lights in femtoseconds: Aerial and volumetric graphics rendered by focused femtosecond laser combined with computational holographic fields. ACM Trans. Graph. 35, 2 (Feb. 2016), 17:1--17:14. Google Scholar
Digital Library
- Ochiai, Y., Oyama, A., Hoshi, T., and Rekimoto, J. Poppable display: A display that enables popping, breaking, and tearing interactions with people. In Consumer Electronics (GCCE), 2013 IEEE 2nd Global Conference on (Oct 2013), 124--128. Google Scholar
Cross Ref
- Omirou, T., Marzo, A., Seah, S. A., and Subramanian, S. Levipath: Modular acoustic levitation for 3d path visualisations. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI '15, ACM (New York, NY, USA, 2015), 309--312. Google Scholar
Digital Library
- Omirou, T., Marzo, A., Subramanian, S., and Roudaut, A. Floating charts: Data plotting using free-floating acoustically levitated representations. In 3D User Interfaces (3DUI), 2016 IEEE Symposium on (March 2016), 1--4.Google Scholar
- Perlin, K., and Han, J. Y. Volumetric display with dust as the participating medium. Retrieved from US Patent 6,997,558, Feb 2006.Google Scholar
- Rakkolainen, I. How feasible are star wars mid-air displays. In Information Visualization, 2007. IV '07. 11th International Conference (July 2007), 935--942. Google Scholar
Digital Library
- Sahoo, D. R., Martinez Plasencia, D., and Subramanian, S. Control of non-solid diffusers by electrostatic charging. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI '15, ACM (New York, NY, USA, 2015), 11--14. Google Scholar
Digital Library
- Saito, H., Kimura, H., Shimada, S., Naemura, T., Kayahara, J., Jarusirisawad, S., Nozick, V., Ishikawa, H., Murakami, T., Aoki, J., Asano, A., Kimura, T., Kakehata, M., Sasaki, F., Yashiro, H., Mori, M., Torizuka, K., and Ino, K. Laser-plasma scanning 3d display for putting digital contents in free space. vol. 6803 (2008), 680309-680309'10.Google Scholar
- Seah, S. A., Martinez Plasencia, D., Bennett, P. D., Karnik, A., Otrocol, V. S., Knibbe, J., Cockburn, A., and Subramanian, S. Sensabubble: A chrono-sensory mid-air display of sight and smell. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems, CHI '14, ACM (New York, NY, USA, 2014), 2863--2872. Google Scholar
Digital Library
- Tokuda, Y., Hiyama, A., Hirose, M., and Yamamoto, H. R2d2 w/ airr: Real time & real space double-layered display with aerial imaging by retro-reflection. In SIGGRAPH Asia 2015 Emerging Technologies, SA '15, ACM (New York, NY, USA, 2015), 20:1--20:3. Google Scholar
Digital Library
- Whymark, R. Acoustic field positioning for containerless processing. Ultrasonics 13, 6 (1975), 251--261. Google Scholar
Cross Ref
- Xiang, Y. The electrostatic capacitance of an inclined plate capacitor. Journal of Electrostatics 64, 1 (2006), 29--34. Google Scholar
Cross Ref
- Xiang, Y. Further study on electrostatic capacitance of an inclined plate capacitor. Journal of Electrostatics 66, 78 (2008), 366--368. Google Scholar
Cross Ref
- Yagi, A., Imura, M., Kuroda, Y., and Oshiro, O. 360degreee fog projection interactive display. In SIGGRAPH Asia 2011 Emerging Technologies, SA '11, ACM (New York, NY, USA, 2011), 19:1--19:1. Google Scholar
Digital Library
Supplemental Material
Index Terms
JOLED


Deepak Ranjan Sahoo
Asier Marzo
Sriram Subramanian


Comments