10.1145/3173574.3174071acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedings
research-article

PolarTrack: Optical Outside-In Device Tracking that Exploits Display Polarization

ABSTRACT

PolarTrack is a novel camera-based approach to detecting and tracking mobile devices inside the capture volume. In PolarTrack, a polarization filter continuously rotates in front of an off-the-shelf color camera, which causes the displays of observed devices to periodically blink in the camera feed. The periodic blinking results from the physical characteristics of current displays, which shine polarized light either through an LC overlay to produce images or through a polarizer to reduce light reflections on OLED displays. PolarTrack runs a simple detection algorithm on the camera feed to segment displays and track their locations and orientations, which makes PolarTrack particularly suitable as a tracking system for cross-device interaction with mobile devices. Our evaluation of PolarTrack's tracking quality and comparison with state-of-the-art camera-based multi-device tracking showed a better tracking accuracy and precision with similar tracking reliability. PolarTrack works as standalone multi-device tracking but is also compatible with existing camera-based tracking systems and can complement them to compensate for their limitations.

References

  1. Till Ballendat, Nicolai Marquardt, and Saul Greenberg. 2010. Proxemic Interaction: Designing for a Proximity and Orientation-Aware Environment. In ACM International Conference on Interactive Tabletops and Surfaces - ITS '10. ACM Press, New York, New York, USA, 121. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Frederik Brudy, Steven Houben, Nicolai Marquardt, and Yvonne Rogers. 2016. CurationSpace: Cross-Device Content Curation Using Instrumental Interaction. In Proceedings of the 2016 ACM on Interactive Surfaces and Spaces (ISS '16). ACM, New York, NY, USA, 159--168. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Nicholas Chen, François Guimbretière, and Abigail Sellen. 2013. Graduate student use of a multi-slate reading system. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems ­ CHI '13. ACM Press, New York, New York, USA, 1799. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. R. Cok. 2004. OLED display with circular polarizer. (Sept. 30 2004). https://www.google.com/patents/US20040189196 US Patent App. 10/817,536.Google ScholarGoogle Scholar
  5. Saul Greenberg, Nicolai Marquardt, Till Ballendat, Robert Diaz-Marino, and Miaosen Wang. 2011. Proxemic Interactions: The New Ubicomp? interactions 18, 1 (jan 2011), 42. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Jens Grubert and Matthias Kranz. 2017. HeadPhones: Ad Hoc Mobile Multi-Display Environments Through Head Tracking. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3966--3971. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Peter Hamilton and Daniel J. Wigdor. 2014. Conductor: enabling and understanding cross-device interaction. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems - CHI '14 (CHI '14). ACM Press, New York, New York, USA, 2773--2782. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Ken Hinckley, Gonzalo Ramos, Francois Guimbretiere, Patrick Baudisch, and Marc Smith. 2004. Stitching: pen gestures that span multiple displays. In Proceedings of the working conference on Advanced visual interfaces ­ AVI '04. ACM Press, New York, New York, USA, 23. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Da-Yuan Huang, Chien-Pang Lin, Yi-Ping Hung, Tzu-Wen Chang, Neng-Hao Yu, Min-Lun Tsai, and Mike Y. Chen. 2012. MagMobile: enhancing social interactions with rapid view-stitching games of mobile devices. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia ­ MUM '12 (MUM '12). ACM Press, New York, New York, USA, 1. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Haojian Jin, Christian Holz, and Kasper Hornbæk. 2015. Tracko: Ad-hoc Mobile 3D Tracking Using Bluetooth Low Energy and Inaudible Signals for Cross-Device Interaction. In Proceedings of the 28th Annual ACM Symposium on User Interface Software&Technology (UIST '15). ACM, New York, NY, USA, 147--156. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Abhijit Karnik, Diego Martinez Plasencia, Walterio Mayol-Cuevas, and Sriram Subramanian. 2012a. PiVOT: Personalized View-overlays for Tabletops. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 271--280. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Abhijit Karnik, Walterio Mayol-Cuevas, and Sriram Subramanian. 2012b. MUSTARD: A Multi User See Through AR Display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 2541--2550. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Ulrike Kister, Konstantin Klamka, Christian Tominski, and Raimund Dachselt. 2017. GraSp: Combining Spatially-aware Mobile Devices and a Display Wall for Graph Visualization and Interaction. Computer Graphics Forum, 36 36 (6 2017), 503--514. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Hideki Koike, Wataru Nishikawa, and Kentaro Fukuchi. 2009. Transparent 2-D Markers on an LCD Tabletop System. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 163--172. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Martin Kuechler and Andreas M. Kunz. 2010. Collaboard: A Remote Collaboration Groupware Device Featuring an Embodiment-enriched Shared Workspace. In Proceedings of the 16th ACM International Conference on Supporting Group Work (GROUP '10). ACM, New York, NY, USA, 211--214. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Ming Li and Leif Kobbelt. 2012. Dynamic tiling display: building an interactive display surface using multiple mobile devices. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia ­ MUM '12. ACM Press, New York, New York, USA, 1. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. David Lindlbauer, Toru Aoki, Robert Walter, Yuji Uema, Anita Höchtl, Michael Haller, Masahiko Inami, and Jörg Müller. 2014. Tracs: Transparency-control for See-through Displays. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 657--661. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Roman Lissermann, Jochen Huber, Martin Schmitz, Jürgen Steimle, and Max Mühlhäuser. 2014. Permulin: Mixed-focus Collaboration on Multi-view Tabletops. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 3191--3200. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Andrés Lucero, Jussi Holopainen, and Tero Jokela. 2011. Pass-them-around: collaborative use of mobile phones for photo sharing. In Proceedings of the 2011 annual conference on Human factors in computing systems - CHI '11, Vol. 54. ACM Press, New York, New York, USA, 1787. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Andrés Lucero, Jaakko Keränen, and Hannu Korhonen. 2010. Collaborative use of mobile phones for brainstorming. In Proceedings of the 12th international conference on Human computer interaction with mobile devices and services - MobileHCI '10. ACM Press, New York, New York, USA, 337. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Nicolai Marquardt, Robert Diaz-Marino, Sebastian Boring, and Saul Greenberg. 2011. The proximity toolkit: prototyping proxemic interactions in ubiquitous computing ecologies. In Proceedings of the 24th annual ACM symposium on User interface software and technology - UIST '11. ACM Press, New York, New York, USA, 315. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Nicolai Marquardt, Ken Hinckley, and Saul Greenberg. 2012. Cross-device interaction via micro-mobility and f-formations. In Proceedings of the 25th annual ACM symposium on User interface software and technology ­ UIST '12. ACM Press, New York, New York, USA, 13. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Thomas Plank, Hans-Christian Jetter, Roman Rädle, Clemens N. Klokmose, Thomas Luger, and Harald Reiterer. 2017. Is Two Enough?: ! Studying Benefits, Barriers, and Biases of Multi-Tablet Use for Collaborative Visualization. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 4548--4560. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Roman Rädle, Hans-Christian Jetter, Nicolai Marquardt, Harald Reiterer, and Yvonne Rogers. 2014. HuddleLamp: Spatially-Aware Mobile Displays for Ad-hoc Around-the-Table Collaboration. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces - ITS '14. ACM Press, New York, New York, USA, 45--54. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Roman Rädle, Hans-Christian Jetter, Mario Schreiner, Zhihao Lu, Harald Reiterer, and Yvonne Rogers. 2015. Spatially-aware or Spatially-agnostic?: Elicitation and Evaluation of User-Defined Cross-Device Interactions. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15. ACM Press, New York, New York, USA, 3913--3922. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Mario Schreiner, Roman Rädle, Hans-Christian Jetter, and Harald Reiterer. 2015. Connichiwa: A Framework for Cross-Device Web Applications. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '15. ACM Press, New York, New York, USA, 2163--2168. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Garth B. D. Shoemaker and Kori M. Inkpen. 2001. Single Display Privacyware: Augmenting Public Displays with Private Information. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '01). ACM, New York, NY, USA, 522--529. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. John C. Tang and Scott L. Minneman. 1990. VideoDraw: A Video Interface for Collaborative Drawing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '90). ACM, New York, NY, USA, 313--320. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Andrew D. Wilson and Hrvoje Benko. 2014. CrossMotion: Fusing Device and Image Motion for User Identification, Tracking and Device Association. In Proceedings of the 16th International Conference on Multimodal Interaction (ICMI '14). ACM, New York, NY, USA, 216--223. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Pawel Wozniak, Nitesh Goyal, Przemyslaw Kucharski, Lars Lischke, Sven Mayer, and Morten Fjeld. 2016. RAMPARTS: Supporting Sensemaking with Spatially-Aware Mobile Interactions. Proceedings of the SIGCHI Conference on Human Factors in Computing System 2016 (2016). Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Chi-Jui Wu, Steven Houben, and Nicolai Marquardt. 2017. EagleSense: Tracking People and Devices in Interactive Spaces Using Real-Time Top-View Depth-Sensing. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3929--3942. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Johannes Zagermann, Ulrike Pfeil, Roman Rädle, Hans-Christian Jetter, Clemens Klokmose, and Harald Reiterer. 2016. When Tablets meet Tabletops: The Effect of Tabletop Size on Around-the-Table Collaboration with Personal Tablets. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems ­ CHI '16. ACM Press, New York, New York, USA, 5470--5481. Google ScholarGoogle ScholarDigital LibraryDigital Library

Supplemental Material

pn4051-file5.mp4

Index Terms

  1. PolarTrack

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!