skip to main content
research-article

WevQuery: Testing Hypotheses about Web Interaction Patterns

Published:30 June 2017Publication History
Skip Abstract Section

Abstract

Remotely stored user interaction logs, which give access to a wealth of data generated by large numbers of users, have been long used to understand if interactive systems meet the expectations of designers. Unfortunately, detailed insight into users' interaction behaviour still requires a high degree of expertise and domain specific knowledge. We present WevQuery, a scalable system to query user interaction logs in order to allow designers to test their hypotheses about users' behaviour. WevQuery supports this purpose using a graphical notation to define the interaction patterns designers are seeking. WevQuery is scalable as the queries can then be executed against large user interaction datasets by employing the MapReduce paradigm. This way WevQuery provides designers effortless access to harvest users' interaction patterns, removing the burden of low-level interaction data analysis. We present two scenarios to showcase the potential of WevQuery, from the design of the queries to their execution on real interaction data accounting for 5.7m events generated by 2,445 unique users.

References

  1. David Akers, Matthew Simpson, Robin Jeffries, and Terry Winograd. 2009. Undo and erase events as indicators of usability problems. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). 659--668. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. James Allen. 1983. Maintaining Knowledge About Temporal Intervals. Commun. ACM 26, 11 (1983), 832--843. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Morten Andreasen, Henrik Nielsen, Simon Schrøder, and Jan Stage. 2007. What Happened to Remote Usability Testing?: An Empirical Study of Three Methods. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems (CHI'07). 1405--1414. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Darko Anicic, Paul Fodor, Sebastian Rudolph, and Nenad Stojanovic. 2011. EP-SPARQL: A Unified Language for Event Processing and Stream Reasoning. In Proc. of the 20th International Conference on World Wide Web (WWW '11). 635--644. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Aitor Apaolaza, Simon Harper, and Caroline Jay. 2013. Understanding Users in the Wild. In Proc. of the 10th International Cross-Disciplinary Conference on Web Accessibility (W4A '13). Article 13, 13:1--13:4 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Richard Atterer, Monika Wnuk, and Albrecht Schmidt. 2006. Knowing the user's every move: user activity tracking for website usability evaluation and implicit interaction. In Proc. of the 15th International Conference on World Wide Web (WWW '06). 203--212. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Simon Breslav, Azam Khan, and Kasper Hornbæk. 2014. Mimic: Visual Analytics of Online Micro-interactions. In Proc. of the 2014 International Working Conference on Advanced Visual Interfaces (AVI '14). 245--252. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Alan Cooper and others. 2004. The inmates are running the asylum. Sams Indianapolis, IN, USA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Gianpaolo Cugola and Alessandro Margara. 2010. TESLA: A Formally Defined Event Specification Language. In Proc. of the Fourth ACM International Conference on Distributed Event-Based Systems (DEBS '10). 50--61. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Gianpaolo Cugola and Alessandro Margara. 2012. Processing Flows of Information: From Data Stream to Complex Event Processing. ACM Comput. Surv. 44, 3, Article 15 (2012), 15:1--15:62 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Jeffrey Dean and Sanjay Ghemawat. 2008. MapReduce: Simplified Data Processing on Large Clusters. Commun. ACM 51, 1 (2008), 107--113. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Jerry Alan Fails, Amy Karlson, Layla Shahamat, and Ben Shneiderman. 2006. A visual interface for multivariate temporal data: Finding patterns of events across multiple histories. In IEEE Symposium On Visual Analytics Science And Technology (VAST '06). 167--174.Google ScholarGoogle ScholarCross RefCross Ref
  13. David Hilbert and David Redmiles. 2000. Extracting usability information from user interface events. ACM Comput. Surv. 32, 4 (2000), 384--421. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Jing Jin and Pedro Szekely. 2009. QueryMarvel: A visual query language for temporal patterns using comic strips. In IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC '09). 207--214. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Rosie Jones and Kristina Klinkner. 2008. Beyond the Session Timeout: Automatic Hierarchical Segmentation of Search Topics in Query Logs. In Proc. of the 17th ACM Conference on Information and Knowledge Management (CIKM '08). 699--708. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Jonathan Lazar, Jinjuan Heidi Feng, and Harry Hochheiser. 2010. Research Methods in Human-Computer Interaction. John Wiley & Sons. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Wanchun Li, Mary Jean Harrold, and Carsten Görg. 2010. Detecting user-visible failures in AJAX web applications by analyzing users' interaction behaviors. In Proc. of the IEEE/ACM International Conference on Automated Software Engineering (ASE '10). 155--158. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Michael Nebeling, Maximilian Speicher, and Moira C. Norrie. 2013. CrowdStudy: General Toolkit for Crowdsourced Evaluation of Web Interfaces. In Proc. of the 5th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS '13). 255--264. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Laila Paganelli and Fabio Paternò. 2002. Intelligent analysis of user interactions with web applications. In Proc. of the 7th International Conference on Intelligent User Interfaces (IUI '02). 111--118. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Fabio Paternò, Antonio Schiavone, and Pierpaolo Pitardi. 2016. Timelines for MobileWeb Usability Evaluation. In Proc. of the International Working Conference on Advanced Visual Interfaces (AVI '16). 88--91. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Ansgar Scherp, Thomas Franz, Carsten Saathoff, and Steffen Staab. 2009. F--a Model of Events Based on the Foundational Ontology Dolce+DnS Ultralight. In Proc. of the Fifth International Conference on Knowledge Capture (K-CAP '09). 137--144. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Michael Terry, Matthew Kay, Brad Van Vugt, Brandon Slack, and Terry Park. 2008. Ingimp: introducing instrumentation to an end-user open source application. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). 607--616. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Paul Thomas. 2014. Using Interaction Data to Explain Difficulty Navigating Online. ACM Trans. Web 8, 4, Article 24 (2014), 24:1--24:41 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Chad Tossell, Philip Kortum, Ahmad Rahmati, Clayton Shepard, and Lin Zhong. 2012. Characterizing web use on smartphones. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). 2769--2778. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Markel Vigo and Simon Harper. 2017. Real-time detection of navigation problems on the World "Wild" Web. International Journal of Human-Computer Studies 101 (2017), 1--9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Eugene Webb, Donald Campbell, Richard Schwartz, and Lee Sechrest. 2000. Unobtrusive Measures. (second ed.).Google ScholarGoogle Scholar
  27. Harald Weinreich, Hartmut Obendorf, and Eelco Herder. 2006. Data Cleaning Methods for Client and Proxy Logs. In Workshop on Logging Traces of Web Activity: The Mechanics of Data Collection.Google ScholarGoogle Scholar
  28. Emanuel Zgraggen, Steven Drucker, Danyel Fisher, and Robert DeLine. 2015. (s|qu)Eries: Visual Regular Expressions for Querying and Exploring Event Sequences. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems (CHI '15). 2683--2692. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. WevQuery: Testing Hypotheses about Web Interaction Patterns

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader
        About Cookies On This Site

        We use cookies to ensure that we give you the best experience on our website.

        Learn more

        Got it!