Abstract

Remotely stored user interaction logs, which give access to a wealth of data generated by large numbers of users, have been long used to understand if interactive systems meet the expectations of designers. Unfortunately, detailed insight into users' interaction behaviour still requires a high degree of expertise and domain specific knowledge. We present WevQuery, a scalable system to query user interaction logs in order to allow designers to test their hypotheses about users' behaviour. WevQuery supports this purpose using a graphical notation to define the interaction patterns designers are seeking. WevQuery is scalable as the queries can then be executed against large user interaction datasets by employing the MapReduce paradigm. This way WevQuery provides designers effortless access to harvest users' interaction patterns, removing the burden of low-level interaction data analysis. We present two scenarios to showcase the potential of WevQuery, from the design of the queries to their execution on real interaction data accounting for 5.7m events generated by 2,445 unique users.
- David Akers, Matthew Simpson, Robin Jeffries, and Terry Winograd. 2009. Undo and erase events as indicators of usability problems. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). 659--668. Google Scholar
Digital Library
- James Allen. 1983. Maintaining Knowledge About Temporal Intervals. Commun. ACM 26, 11 (1983), 832--843. Google Scholar
Digital Library
- Morten Andreasen, Henrik Nielsen, Simon Schrøder, and Jan Stage. 2007. What Happened to Remote Usability Testing?: An Empirical Study of Three Methods. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems (CHI'07). 1405--1414. Google Scholar
Digital Library
- Darko Anicic, Paul Fodor, Sebastian Rudolph, and Nenad Stojanovic. 2011. EP-SPARQL: A Unified Language for Event Processing and Stream Reasoning. In Proc. of the 20th International Conference on World Wide Web (WWW '11). 635--644. Google Scholar
Digital Library
- Aitor Apaolaza, Simon Harper, and Caroline Jay. 2013. Understanding Users in the Wild. In Proc. of the 10th International Cross-Disciplinary Conference on Web Accessibility (W4A '13). Article 13, 13:1--13:4 pages. Google Scholar
Digital Library
- Richard Atterer, Monika Wnuk, and Albrecht Schmidt. 2006. Knowing the user's every move: user activity tracking for website usability evaluation and implicit interaction. In Proc. of the 15th International Conference on World Wide Web (WWW '06). 203--212. Google Scholar
Digital Library
- Simon Breslav, Azam Khan, and Kasper Hornbæk. 2014. Mimic: Visual Analytics of Online Micro-interactions. In Proc. of the 2014 International Working Conference on Advanced Visual Interfaces (AVI '14). 245--252. Google Scholar
Digital Library
- Alan Cooper and others. 2004. The inmates are running the asylum. Sams Indianapolis, IN, USA. Google Scholar
Digital Library
- Gianpaolo Cugola and Alessandro Margara. 2010. TESLA: A Formally Defined Event Specification Language. In Proc. of the Fourth ACM International Conference on Distributed Event-Based Systems (DEBS '10). 50--61. Google Scholar
Digital Library
- Gianpaolo Cugola and Alessandro Margara. 2012. Processing Flows of Information: From Data Stream to Complex Event Processing. ACM Comput. Surv. 44, 3, Article 15 (2012), 15:1--15:62 pages. Google Scholar
Digital Library
- Jeffrey Dean and Sanjay Ghemawat. 2008. MapReduce: Simplified Data Processing on Large Clusters. Commun. ACM 51, 1 (2008), 107--113. Google Scholar
Digital Library
- Jerry Alan Fails, Amy Karlson, Layla Shahamat, and Ben Shneiderman. 2006. A visual interface for multivariate temporal data: Finding patterns of events across multiple histories. In IEEE Symposium On Visual Analytics Science And Technology (VAST '06). 167--174.Google Scholar
Cross Ref
- David Hilbert and David Redmiles. 2000. Extracting usability information from user interface events. ACM Comput. Surv. 32, 4 (2000), 384--421. Google Scholar
Digital Library
- Jing Jin and Pedro Szekely. 2009. QueryMarvel: A visual query language for temporal patterns using comic strips. In IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC '09). 207--214. Google Scholar
Digital Library
- Rosie Jones and Kristina Klinkner. 2008. Beyond the Session Timeout: Automatic Hierarchical Segmentation of Search Topics in Query Logs. In Proc. of the 17th ACM Conference on Information and Knowledge Management (CIKM '08). 699--708. Google Scholar
Digital Library
- Jonathan Lazar, Jinjuan Heidi Feng, and Harry Hochheiser. 2010. Research Methods in Human-Computer Interaction. John Wiley & Sons. Google Scholar
Digital Library
- Wanchun Li, Mary Jean Harrold, and Carsten Görg. 2010. Detecting user-visible failures in AJAX web applications by analyzing users' interaction behaviors. In Proc. of the IEEE/ACM International Conference on Automated Software Engineering (ASE '10). 155--158. Google Scholar
Digital Library
- Michael Nebeling, Maximilian Speicher, and Moira C. Norrie. 2013. CrowdStudy: General Toolkit for Crowdsourced Evaluation of Web Interfaces. In Proc. of the 5th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS '13). 255--264. Google Scholar
Digital Library
- Laila Paganelli and Fabio Paternò. 2002. Intelligent analysis of user interactions with web applications. In Proc. of the 7th International Conference on Intelligent User Interfaces (IUI '02). 111--118. Google Scholar
Digital Library
- Fabio Paternò, Antonio Schiavone, and Pierpaolo Pitardi. 2016. Timelines for MobileWeb Usability Evaluation. In Proc. of the International Working Conference on Advanced Visual Interfaces (AVI '16). 88--91. Google Scholar
Digital Library
- Ansgar Scherp, Thomas Franz, Carsten Saathoff, and Steffen Staab. 2009. F--a Model of Events Based on the Foundational Ontology Dolce+DnS Ultralight. In Proc. of the Fifth International Conference on Knowledge Capture (K-CAP '09). 137--144. Google Scholar
Digital Library
- Michael Terry, Matthew Kay, Brad Van Vugt, Brandon Slack, and Terry Park. 2008. Ingimp: introducing instrumentation to an end-user open source application. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). 607--616. Google Scholar
Digital Library
- Paul Thomas. 2014. Using Interaction Data to Explain Difficulty Navigating Online. ACM Trans. Web 8, 4, Article 24 (2014), 24:1--24:41 pages. Google Scholar
Digital Library
- Chad Tossell, Philip Kortum, Ahmad Rahmati, Clayton Shepard, and Lin Zhong. 2012. Characterizing web use on smartphones. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). 2769--2778. Google Scholar
Digital Library
- Markel Vigo and Simon Harper. 2017. Real-time detection of navigation problems on the World "Wild" Web. International Journal of Human-Computer Studies 101 (2017), 1--9. Google Scholar
Digital Library
- Eugene Webb, Donald Campbell, Richard Schwartz, and Lee Sechrest. 2000. Unobtrusive Measures. (second ed.).Google Scholar
- Harald Weinreich, Hartmut Obendorf, and Eelco Herder. 2006. Data Cleaning Methods for Client and Proxy Logs. In Workshop on Logging Traces of Web Activity: The Mechanics of Data Collection.Google Scholar
- Emanuel Zgraggen, Steven Drucker, Danyel Fisher, and Robert DeLine. 2015. (s|qu)Eries: Visual Regular Expressions for Querying and Exploring Event Sequences. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems (CHI '15). 2683--2692. Google Scholar
Digital Library
Index Terms
WevQuery: Testing Hypotheses about Web Interaction Patterns
Recommendations
Comparison between single-touch and multi-touch interaction for older people
ICCHP'12: Proceedings of the 13th international conference on Computers Helping People with Special Needs - Volume Part IThis paper describes a study exploring the multi-touch interaction for older adults. The aim of this experiment was to check the relevance of this interaction versus single-touch interaction to realize object manipulation tasks: move, rotate and zoom. ...
The effects of touch screen technology on the usability of e-reading devices
Although reading is the main function of electronic reading devices (e-readers), previous studies demonstrated that a critical factor for perceived legibility is the usability of the device. If users have problems with the handling of a device, they ...
Evaluation of the users' behavior as they navigate in a 3D environment collaboratively using large displays
IHC '12: Proceedings of the 11th Brazilian Symposium on Human Factors in Computing SystemsA large amount of information has been generated and manipulated in an increasing scale in recent years. One solution for viewing so much information was provided by large displays. However, with the increase of the screens came problems in the user-...






Comments