Framing fraught topics through tangible multi-display engagement with live news

ABSTRACT

We describe an art museum installation that employed tangible interface, peripheral interface, and ambient display modalities to engage with news content regarding politically charged topics. News content was sourced via Google News, and used as driver for both a kinetic sculpture and a screen-faced tangible interaction console. Tangible tokens represented several keywords such as "human rights" and "torture," in the context of a 2006 project engaging the U.S. "War on Terror." We describe our implementation and experiences from two gallery deployments, and reflect on the piece's engagement with sensitive material after a decade's passage.

References

1. The meaning and origin of the expression: Preaching to the choir. http://www.phrases.org.uk/meanings/preaching-to-the-choir.html.
2. Chinese torture for Ireland. Sky Sports (UK), April 9, 2006 2006. http://home.skysports.com/list.asp?hlid=378889&clid=&channel=fai&title=Chinese+torture+for+Ireland.
3. 'Computer nerd' hacker could face torture by US government. Life Style Extra (UK), 2006. http://www.lse.co.uk/ShowStory.asp?story=YT1224282O&news_headline=computer_nerd_hacker_could_face_torture_by_us_government http://www.prisonplanet.com/articles/april2006/130406_b_hacker.htm.
4. Short goodbye. Monroe News Star, April 9 2006. http://www.thenewsstar.com/apps/pbcs.dll/article?AID=/20060319/SPORTS/603190353/1006.
5. Pope Francis warns on 'piecemeal World War III'. BBC News, September 13 2014. http://www.bbc.com/news/world-europe-29190890.
6. AFP. EU vice president says union must defend against 'alternative facts', 2017. http://www.timesofisrael.com/eu-vice-president-says-union-must-defend-against-alternative-facts/.
7. American Association for the Advancement of Science et al. Museums of the future. Science, 295(5562):2009--2009, 2002.
8. S. Bakker. Design for peripheral interaction. PhD thesis, TU/Eindhoven, 2013.
9. S. Bakker, D. Hausen, and T. Selker. Peripheral Interaction: Challenges and Opportunities for HCI in the Periphery of Attention. Springer, 2016.
10. J. Bank and E. Kolawole. A tortured history. FactCheck.org, December 19 2005. http://web.archive.org/web/20060201011912/http://www.factcheck.org/article365.html.
11. J. Berendt. Pope Francis says world is at war, but it's not a religious conflict. New York Times, July 27 2016. http://www.nytimes.com/2016/07/28/world/europe/pope-francis-poland-world-youth-day.html.
12. K. Bharat. And now, News, January 23 2006. https://googleblog.blogspot.com/2006/01/and-now-news.html.
13. S. Brave and A. Dahley. intouch: a medium for haptic interpersonal communication. In Proc. of CHI'97 Extended Abstracts, pages 363--364. ACM, 1997.
14. E. Bumiller. Cheney calls Guantánamo prison essential. New York Times, June 14 2005. http://www.nytimes.com/2005/06/14/politics/cheney-calls-guantanamo-prison-essential.html.
15. G. Bush. President tours border, discusses immigration reform in Texas. White House Office of the Press Secretary, November 29 2005. http://web.archive.org/web/20060131091052/http://www.whitehouse.gov/news/releases/2005/11/20051129-2.html.
16. K. Camarata, E. Do, B. Johnson, and M. Gross. Navigational blocks: Navigating information space with tangible media. In Proc. of IUI'02, pages 31--38, 2002.
17. J. M. Carroll. What's in a Name? An Essay in the Psychology of Reference. WH Freeman/Times Books/Henry Holt & Co, 1985.
18. A. Chang, S. O'Modhrain, R. Jacob, E. Gunther, and H. Ishii. Comtouch: design of a vibrotactile communication device. In Proc. of DIS'02, pages 312--320. ACM, 2002.
19. S. Claes and A. V. Moere. The role of tangible interaction in exploring information on public visualization displays. In Proc. of Pervasive Displays'15, PerDis '15, pages 201--207, New York, NY, USA, 2015. ACM.
20. A. Colley, L. Virtanen, J. Väyrynen, and J. Häkkilä. Physically guiding touch screen interaction with public displays. In Proc. of Pervasive Displays'15, PerDis '15, pages 255--256, New York, NY, USA, 2015. ACM.
21. S. Crouch. In the dark on Darfur. New York Daily News, April 13 2006. http://www.nydailynews.com/news/ideas_opinions/story/408283p-345615c.html;http://www.nydailynews.com/archives/opinions/dark-darfur-black-leaders-shine-light-raise-ruckus-article-1.568635.
22. E. Cullen. The art of war, 2006.
23. A. Dahley, C. Wisneski, and H. Ishii. Water lamp and pinwheels: ambient projection of digital information into architectural space. In CHI 98 Conference Summary, pages 269--270. ACM, 1998.
24. Dalai Lama. The Dalai Lama: Why I'm hopeful about the future of the world. Pittsburgh Post-Gazette, July 12 2016. http://www.post-gazette.com/opinion/Op-Ed/2016/07/12/Why-I-m-hopeful-about-the-future/stories/201606160019.
25. P. Dalsgaard and K. Halskov. Designing urban media façades: cases and challenges. In Proc. of CHI'10, pages 2277--2286. ACM, 2010.
26. A. Dunne and F. Raby. Fields and thresholds. Proceedings of the Doors of Perception-2, 1994.
27. D. Edge and A. F. Blackwell. Peripheral tangible interaction by analytic design. In Proc. of TEI'09, pages 69--76, 2009.
28. J. Flint. Rhetoric and Reality: the failure to resolve the Darfur conflict. Small Arms Survey, Graduate Institute of International and Development Studies, 2010. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.180.522&rep=rep1&atype=pdf.
29. S. Follmer, D. Leithinger, A. Olwal, A. Hogge, and H. Ishii. inform: dynamic physical affordances and constraints through shape and object actuation. In Proc. of UIST'13, volume 13, pages 417--426, 2013.
30. L. Frater. Engaging the media: An academic's sojourn in the newsroom. Researching Sustainability: A Guide to Social Science Methods, Practice and Engagement, page 277, 2013.
31. J. Fritsch and M. Brynskov. Between engagement and information: Experimental urban media in the climate change debate. In Workshop on Digital Cities, volume 6, pages 1--4, 2009.
32. Google Scholar. scholar.google: "google news" ("tangible interface" OR "tangible user interface" OR "tangible interaction"). https://scholar.google.com/scholar?q="google+news"+%28"tangible+interface"+OR+"tangible+user+interface"+OR+"tangible+interaction"%29.
33. S. Greenberg and H. Kuzuoka. Using digital but physical surrogates to mediate awareness, communication and privacy in media spaces. Personal Technologies, 4(1):182--198, January 2000.
34. M. H. M. Hafez. "Facebook" usage during election campaigns and its impact on voters' attitudes and decisions towards political candidates. PhD thesis, Cairo University, 2016. http://erepository.cu.edu.eg/index.php/cutheses/article/view/6485.
35. J. Häkkilä, T. Lappalainen, and S. Koskinen. In the candle light: Pervasive display concept for emotional communication. In Proc. of Pervasive Displays'16, PerDis '16, pages 161--167, New York, NY, USA, 2016. ACM.
36. D. Hausen. Peripheral interaction: exploring the design space. PhD thesis, Ludwig-Maximilians-Universität München, 2013.
37. D. Hausen, S. Boring, C. Lueling, S. Rodestock, and A. Butz. StaTube: facilitating state management in instant messaging systems. In Proc. of TEI'12, pages 283--290. ACM, 2012.
38. S. I. Hayakawa. Language in action. Barvas Books, 1939, 2016. https://www.amazon.com/dp/B01H422KMW/.
39. M. S. Horn. Tangible computer programming: exploring the use of emerging technology in classrooms and science museums. PhD thesis, Tufts University, 2009.
40. M. S. Horn, E. T. Solovey, and R. J. Jacob. Tangible programming and informal science learning: making tuis work for museums. In Proc. of IDC'08, pages 194--201. ACM, 2008.
41. E. Hornecker and J. Buur. Getting a grip on tangible interaction: a framework on physical space and social interaction. In Proc. of CHI '06, pages 437--446, New York, NY, USA, 2006. ACM.
42. M. Isaac. Facebook mounts effort to limit tide of fake news, 2016. https://www.nytimes.com/2016/12/15/technology/facebook-fake-news.html.
43. H. Ishii. Tangible Bits: beyond pixels. In Proc. of TEI'08, TEI '08, pages xv--xxv, 2008.
44. H. Ishii and B. Ullmer. Tangible Bits: towards seamless interfaces between people, bits and atoms. In Proc. of CHI'97, pages 234--241, 1997.
45. H. Ishii and B. Ullmer. The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications, chapter Tangible User Interfaces (Chapter 8), pages 95--132. CRC Press, 2012.
46. N. Jeremijenko. Connected environments. In Proc. of UIST'10, pages 183--184. ACM, 2010.
47. N. Jeremijenko and K. Rich. Suicide box. http://eprints.uwe.ac.uk/31315/, 1996.
48. I. Khan. Amnesty International report, 2005; speech by Irene Khan at Foreign Press Association. https://web.archive.org/web/20060220210041/http://web.amnesty.org/library/Index/ENGPOL100142005, May 25 2005.
49. K. M. Lee. Presence, explicated. Communication theory, 14(1):27--50, 2004.
50. N. A. Lewis. Red cross finds detainee abuse in guantanamo. New York Times, 30(11), 2004. http://www.nytimes.com/2004/11/30/politics/red-cross-finds-detainee-abuse-in-guantanamo.html.
51. M. Lombard and T. Ditton. At the heart of it all: The concept of presence. Journal of Computer-Mediated Communication, 3(2):0--0, 1997.
52. J. Ma, L. Sindorf, I. Liao, and J. Frazier. Using a tangible versus a multi-touch graphical user interface to support data exploration at a museum exhibit. In Proc. of TEI'15, pages 33--40. ACM, 2015.
53. J. Mankoff, A. K. Dey, G. Hsieh, J. Kientz, S. Lederer, and M. Ames. Heuristic evaluation of ambient displays. In Proc. of CHI'03, pages 169--176, 2003.
54. M. McLuhan. Understanding media: The extensions of man. Signet Books, 1964.
55. M. Minsky. Telepresence. Omni, 2:45--51, 1980.
56. M. Nilsson, S. Johansson, and M. Håkansson. Nostalgia: An evocative tangible interface for elderly users. In CHI '03 Extended Abstracts on Human Factors in Computing Systems, CHI EA '03, pages 964--965, New York, NY, USA, 2003. ACM.
57. G. Orwell. Nineteen Eighty-Four. Signet Classics, 1949. https://ebooks.adelaide.edu.au/o/orwell/george/o79n/chapter1.4.html.
58. R. H. Phillips. Castro 'waiting' to get U.S. base; Guantanamo a 'headache' for Kennedy, he says; 'torture' alleged there. New York Times, January 14 1961. http://query.nytimes.com/mem/archive-free/pdf?res=950DE4D6123FE13ABC4C52DFB766838A679EDE.
59. S. J. Robinson, S. Mendenhall, V. Novosel, and A. Mazalek. Tangible anchoring: grasping news and public opinion. In Proc. of ACE'10, ACE '10, pages 75--78, New York, NY, USA, 2010. ACM.
60. K. Rush. Religion, science find common ground. San Bernadina County Sun, April 9 2006. http://www.sbsun.com/news/ci_3691895;https://www.highbeam.com/doc/1P2-12257842.html.
61. R. Sankaran, B. Ullmer, and S. Jandhyala. Blades and tiles: An extensible hardware architecture approach for ubiquitous interaction devices. UbiComp'07 Adjunct Proc., 2007.
62. R. Sankaran, B. Ullmer, J. Ramanujam, K. Kallakuri, S. Jandhyala, C. Toole, and C. Laan. Decoupling interaction hardware design using libraries of reusable electronics. In Proc. of TEI'09, pages 331--337, 2009.
63. J. Scheible and M. Funk. Dronelandart: Landscape as organic pervasive display. In Proc. of Pervasive Displays'16, PerDis '16, pages 255--256, New York, NY, USA, 2016. ACM.
64. K. Seelye. U.S. treatment of war captives is criticized. New York Times, April 15 2002. http://www.nytimes.com/2002/04/15/world/a-nation-challenged-prisoners-us-treatment-of-war-captives-is-criticized.html.
65. K. Seelye and S. Erlanger. U.S. suspends the transport of terror suspects to Cuba. New York Times, January 24 2002. http://www.nytimes.com/2002/01/24/world/nation-challenged-captives-us-suspends-transport-terror-suspects-cuba.html.
66. A. Singer, D. Hindus, L. Stifelman, and S. White. Tangible progress: less is more in somewire audio spaces. In Proc. of CHI '99, pages 104--111, 1999.
67. J. Steuer. Defining virtual reality: Dimensions determining telepresence. Journal of communication, 42(4):73--93, 1992.
68. C. R. Stevens. Beyond preaching to the choir: Information literacy, faculty outreach, and disciplinary journals. The Journal of Academic Librarianship, 33(2):254 -- 267, 2007.
69. The Editorial Board. The broken promise of closing Guantánamo. New York Times, June 20 2016. http://www.nytimes.com/2016/06/20/opinion/the-broken-promise-of-closing-guantanamo.html.
70. B. Ullmer. Entangling space, form, light, time, computational steam, and cultural artifacts. interactions, 19(4):32--39, July 2012.
71. B. Ullmer and H. Ishii. Emerging frameworks for tangible user interfaces. IBM Systems Journal, 39(3):915--931, 2000.
72. B. Ullmer, A. Siqueira, C. Branton, and M. Konkel. Weaving peripheral interaction within habitable architectures. In S. Bakker, D. Hausen, and T. Selker, editors, Peripheral Interaction. Springer, 2016.
73. U.S. Senate Select Committee on Intelligence. Committee Study of the Central Intelligence Agency's Detention and Interrogation Program, 2012. https://web.archive.org/web/20141209165504/http://www.intelligence.senate.gov/study2014/sscistudy1.pdf.
74. D. Vogel and R. Balakrishnan. Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users. In Proc. of UIST'04, pages 137--146. ACM, 2004.
75. R. Wakkary and M. Hatala. Situated play in a tangible interface and adaptive audio museum guide. Personal and Ubiquitous Computing, 11(3):171--191, 2007.
76. S. Waldman. Personal correspondence. http://www.interfluidity.com, 16.
77. J. Watanabe. VortexBath: study of tangible interaction with water in bathroom for accessing and playing media files. In J. A. Jacko, editor, Proc. of HCII'07, pages 1240--1248, Berlin, Heidelberg, 2007. Springer Berlin Heidelberg.
78. M. Weiser and J. S. Brown. The coming age of calm computing. http://www.ubiq.com/weiser/calmtech/calmtech.htm, 1995.
79. Wikipedia. Garbage collection (computer science). https://en.wikipedia.org/wiki/Garbage_collection_(computer_science).
80. C. Wisneski, H. Ishii, A. Dahley, and et al. Ambient displays: Turning architectural space into an interface between people and digital information. In Proc. of CoBuild'98, pages 22--32, 1998.
81. World Health Organization. Road traffic injuries, May 2016. http://www.who.int/mediacentre/factsheets/fs358/en/.
82. T. S. Writer. Ex-Sen. Hayakawa dies; unpredictable iconoclast. The Los Angeles Times, 1992. http://www.latimes.com/local/obituaries/archives/la-me-si-hayakawa-19920228-story.html.