Abstract
On-screen gamepads are increasingly used as controllers for video games on distant screens, yet lack the typical tactile feedback known from hardware controllers. We conducted a comparative lab study to investigate four smartphone gamepads inspired by traditional game controllers and mobile game controls (directional buttons, directional pad, floating joystick, tilt control). The study consisted of both completing a formal control test as well as controlling two popular video games of different genres (Pac-Man and Super Mario Bros.). The results indicate that the directional buttons require the most attention of the user, however, work precisely for direction-restricted navigational tasks. Directional pad and joystick showed a similar performance, yet they encourage drifting and unintended operations when the user is focused on the remote screen. While currently unfamiliar to many users, the floating joystick can reduce the glances at the device. Tilt turned out to be not sufficiently precise and quick for the investigated tasks. The article concludes with derived design guidelines with easily realizable measures for typical contexts such as casual gaming at home or spontaneous gaming on public displays.
Supplemental Material
Available for Download
Supplemental movie, appendix, image and software files for, Investigating On-Screen Gamepad Designs for Smartphone-Controlled Video Games
- Matthias Baldauf and Peter Fröhlich. 2013. The augmented video wall: multi-user AR interaction with public displays. In Extended Abstracts on Human Factors in Computing Systems (CHI EA'13), ACM, New York, 3015--3018. DOI:http://dx.doi.org/10.1145/2468356.2479599 Google Scholar
Digital Library
- Matthias Baldauf, Peter Fröhlich, Jasmin Buchta, and Theresa Stürmer. 2013. From touchpad to smart lens: A comparative study on smartphone interaction with public displays. Int. J. Mobile HCI 5, 2, 1--20.Google Scholar
- Rafael Ballagas, Jan Borchers, Michael Rohs, and Jennifer G. Sheridan. 2006. The smart phone: A ubiquitous input device. IEEE Pervasive Comput. 5, 1, 70--77. DOI:http://dx.doi.org/10.1109/MPRV.2006.18 Google Scholar
Digital Library
- Matthias Böhmer, Sven Gehring, Markus Löchtefeld, Morin Ostkamp, and Gernot Bauer. 2011. The mighty un-touchables: Creating playful engagement on media facades. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI'11). ACM, New York, 605--610. DOI:http://dx.doi.org/10.1145/2037373.2037468 Google Scholar
Digital Library
- Sebastian Boring, Sven Gehring, Alexander Wiethoff, Anna Magdalena Blöckner, Johannes Schöning, and Andreas Butz. 2011. Multi-user interaction on media facades through live video on mobile devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'11). ACM, New York, 2721--2724. DOI:http://dx.doi.org/10.1145/1978942.1979342 Google Scholar
Digital Library
- Sebastian Boring, Marko Jurmu, and Andreas Butz. 2009. Scroll, tilt or move it: Using mobile phones to continuously control pointers on large public displays. In Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7 (OZCHI'09). ACM, New York, 161--168. DOI:http://dx.doi.org/10.1145/1738826.1738853 Google Scholar
Digital Library
- Michael Brown, Aidan Kehoe, Jurek Kirakowski, and Ian Pitt. 2010. Beyond the gamepad: HCI and game controller design and evaluation. In Evaluating User Experience in Games, Regina Bernhaupt (Ed.), Springer, 209--219. DOI:http://dx.doi.org/10.1007/978-1-84882-963-3_12Google Scholar
- Kevin Browne and Christopher Anand. 2012. An empirical evaluation of user interfaces for a mobile video game. Entertain. Comput. 3, 1, 1--10. DOI:http://dx.doi.org/10.1016/j.entcom.2011.06.001Google Scholar
Cross Ref
- Xiang Cao, Michael Massimi, and Ravin Balakrishnan. 2008. Flashlight Jigsaw: An Exploratory study of an ad-hoc multiplayer game on public displays. In Proceedings of the ACM Conference on Computer Supported Cooperative Work (CSCW'08). ACM, New York, 77--86. DOI:http://dx.doi.org/10.1145/1460563.1460577 Google Scholar
Digital Library
- Fadi Chehimi and Paul Coulton. 2008. Motion controlled mobile 3D multiplayer gaming. In Proceedings of the International Conference on Advances in Computer Entertainment Technology (ACE'08). ACM, New York, 267--270. DOI:http://dx.doi.org/10.1145/1501750.1501813 Google Scholar
Digital Library
- Kimberly Chu, TekYong Lim, CheeWeng Khong, and ChuiYin Wong. 2013. Soft key and hard key mobile input devices on player experience for mobile gaming. In Advances in Visual Informatics, Halimah Badioze Zaman, Peter Robinson, Patrick Olivier, Timothy K. Shih, and Sergio Velastin (Eds.), Lecture Notes in Computer Science, vol. 8237, Springer, 347--357. DOI:http://dx.doi.org/10.1007/978-3-319-02958-0 32 Google Scholar
Digital Library
- Kimberly Chu and Chui Yin Wong. 2011. Mobile input devices for gaming experience. In Proceedings of the International Conference on User Science and Engineering. 83--88. DOI:http://dx.doi.org/10.1109/iUSEr.2011.6150542Google Scholar
Cross Ref
- Sarah A. Douglas, Arthur E. Kirkpatrick, and I. Scott MacKenzie. 1999. Testing pointing device performance and user assessment with the ISO 9241, Part 9 Standard. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'99). ACM, New York, 215--222. DOI:http://dx.doi.org/10.1145/302979.303042 Google Scholar
Digital Library
- Paul M. Fitts. 1954. The information capacity of the human motor system in controlling the amplitude of movement. J. Experimental Psych. 74, 381--391.Google Scholar
Cross Ref
- Paul Gilbertson, Paul Coulton, Fadi Chehimi, and Tamas Vajk. 2008. Using “tilt” as an interface to control “no-button” 3-D mobile games. Comput. Entertain. 6, 3, Article 38, 13 pages. DOI:http://dx.doi.org/10.1145/1394021.1394031 Google Scholar
Digital Library
- Wolfgang Hürst and Hector Cunat Nunez. 2013. Touch me, tilt me: Comparing Interaction modalities for navigation in 2D and 3D worlds on mobiles. In Advances in Computer Entertainment, Dennis Reidsma, Haruhiro Katayose, and Anton Nijholt (Eds.), Lecture Notes in Computer Science, vol. 8253, Springer International Publishing, 93--108. DOI:http://dx.doi.org/10.1007/978-3-319-03161-3_7 Google Scholar
Digital Library
- Mark Joselli, J. R. da Silva, Marcelo Zamith, EstebanWalter Gonzalez Clua, M. Pelegrino, E. Mendonca, and E. Soluri. 2012. An architecture for game interaction using mobile. In Proceedings of the IEEE International Games Innovation Conference. 1--5. DOI:http://dx.doi.org/10.1109/IGIC.2012.6329846Google Scholar
- Nicholas Katzakis and Masahiro Hori. 2010. Mobile devices as multi-DOF controllers. In Proceedings of the IEEE Symposium on 3D User Interfaces. 139--140. DOI:http://dx.doi.org/10.1109/3DUI.2010.5444700 Google Scholar
Digital Library
- Seungyon Lee and Shumin Zhai. 2009. The performance of touch screen soft buttons. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'09). ACM, New York, 309--318. DOI:http://dx.doi.org/10.1145/1518701.1518750 Google Scholar
Digital Library
- Andreas Lorenz and Marc Jentsch. 2010. The ambient media player: A media application remotely operated by the use of mobile devices and gestures. In Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia (MUM'10). ACM, New York, Article 15, 10 pages. DOI:http://dx.doi.org/10.1145/1899475.1899490 Google Scholar
Digital Library
- Kolja Lubitz and Markus Krause. 2012. Exploring User Input Metaphors for Jump and Run Games on Mobile Devices. In Proceedings of the Conference on Entertainment Computing, Marc Herrlich, Rainer Malaka, and Maic Masuch (Eds.). Lecture Notes in Computer Science, Vol. 7522, Springer, 473--475. DOI:http://dx.doi.org/10.1007/978-3-642-33542-6_56 Google Scholar
Digital Library
- Petri Luojus, Jarkko Koskela, Kimmo Ollila, Saku-Matti Mäki, Raffi Kulpa-Bogossia, Tommi Heikkinen, and Timo Ojala. 2013. Wordster: Collaborative versus competitive gaming using interactive public displays and mobile phones. In Proceedings of the 2nd ACM International Symposium on Pervasive Displays (PerDis'13). ACM, New York, 109--114. DOI:http://dx.doi.org/10.1145/2491568.2491592 Google Scholar
Digital Library
- Stephania Medryk and I. Scott MacKenzie. 2013. A comparison of accelerometer and touch-based input for mobile gaming. In Proceedings of the International Conference on Multimedia and Human-Computer Interaction. 117.1--117.8.Google Scholar
- Daniel Natapov, Steven J. Castellucci, and I. Scott MacKenzie. 2009. ISO 9241-9 evaluation of video game controllers. In Proceedings of Graphics Interface 2009 (GI'09). Canadian Information Processing Society, Toronto, ON, Canada, 223--230. http://dl.acm.org/citation.cfm?id=1555880.1555930 Google Scholar
Digital Library
- Masaki Oshita and Hirotaka Ishikawa. 2012. Gamepad vs. touchscreen: A comparison of action selection interfaces in computer games. In Proceedings of the Workshop at SIGGRAPH Asia (WASA'12). ACM, New York, 27--31. DOI:http://dx.doi.org/10.1145/2425296.2425301 Google Scholar
Digital Library
- Umar Rashid, Miguel A. Nacenta, and Aaron Quigley. 2012. The cost of display switching: A comparison of mobile, large display and hybrid ui configurations. In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI'12). ACM, New York, 99--106. DOI:http://dx.doi.org/10.1145/2254556.2254577 Google Scholar
Digital Library
- Jürgen Scheible and Timo Ojala. 2005. MobiLenin: Combining a multi-track music video, personal mobile phones and a public display into multi-user interactive entertainment. In Proceedings of the 13th Annual ACM International Conference on Multimedia (MULTIMEDIA'05). ACM, New York, 199--208. DOI:http://dx.doi.org/10.1145/1101149.1101178 Google Scholar
Digital Library
- Tams Vajk, Paul Coulton, William Bamford, and Reuben Edwards. 2008. Using a mobile phone as a “wii-like” controller for playing games on a large public display. Int. J. Computer Games Tech. http://dblp.uni-trier.de/db/journals/ijcgt/ijcgt2008.html#VajkCBE08. Google Scholar
Digital Library
- Luis Valente, ClarisseSieckenius Souza, and Bruno Feij. 2009. Turn off the graphics: designing non-visual interfaces for mobile phone games. J. Braz. Comput. Soc. 15, 1, 45--58. DOI:http://dx.doi.org/10.1007/BF03192576Google Scholar
Cross Ref
- Chui Yin Wong, Kimberly Chu, Chee Weng Khong, and Tek Yong Lim. 2010. Evaluating playability on haptic user interface for mobile gaming. In Proceedings of the International Symposium on Information Technology, Vol. 3, 1093--1098. DOI:http://dx.doi.org/10.1109/ITSIM.2010.5561513Google Scholar
Cross Ref
- Loutfouz Zaman and I. Scott MacKenzie. 2013. Evaluation of nano-stick, foam buttons, and other input methods for gameplay on touchscreen phones. In Proceedings of the International Conference on Multimedia and Human-Computer Interaction. 69.1--69.8.Google Scholar
- Loutfouz Zaman, Daniel Natapov, and Robert J. Teather. 2010. Touchscreens vs. traditional controllers in handheld gaming. In Proceedings of the International Academic Conference on the Future of Game Design and Technology (Futureplay'10). ACM, New York, 183--190. DOI:http://dx.doi.org/10.1145/1920778.1920804 Google Scholar
Digital Library
Index Terms
Investigating On-Screen Gamepad Designs for Smartphone-Controlled Video Games
Recommendations
Gamepad vs. touchscreen: a comparison of action selection interfaces in computer games
WASA '12: Proceedings of the Workshop at SIGGRAPH AsiaIn this paper, we compare gamepad and touchscreen interfaces for action selection tasks in computer games. Touchscreens are now widely used for computer games on tablets, smartphones and hand-held game consoles. However, in general, game players are ...
Investigating Screen Shifting Techniques to Improve One-Handed Smartphone Usage
NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer InteractionWith increasingly large smartphones, it becomes more difficult to use these devices one-handed. Due to a large touchscreen, users can not reach across the whole screen using their thumb. In this paper, we investigate approaches to move the screen ...
Evaluation of Crosshair-Aided Gyroscope Gamepad Controller
Mobile Web and Intelligent Information SystemsAbstractWith an ever-increasing number of technological tools and gadgets in our life, people have become familiar with multiple kinds of user interaction interfaces and devices. Day in, day out people interact with various devices that follow different ...






Comments