skip to main content
research-article

Will Too Many Editors Spoil The Tag?: Conflicts and Alignment in Q&A Categorization

Published:01 November 2018Publication History
Skip Abstract Section

Abstract

Q&A websites compile useful knowledge through user-generated questions and responses. Many Q&As use collaborative tagging systems to improve search and discovery while distributing the work of categorizing and organization throughout the community. Although early work on collaborative tagging questioned whether consistent categorization schemes could emerge from large groups with little to no coordination, empirical studies have found surprising coherence among users' tags. We build on this research by testing whether coherence emerges in tag usage on Q&As, a more challenging context, focusing in particular on mismatches in the specificity of tags (basic level disagreement). We found that some users shifted toward more specific tag usage over time slightly increasing conflict, but that moderators were instrumental in helping to resolve some of this conflict. This study highlights the importance of learning and moderation in the development of coherence in collaborative tagging systems.

References

  1. Rabe Abdalkareem, Emad Shihab, and Juergen Rilling. 2017. What Do Developers Use The Crowd For? A Study Using Stack Overflow. IEEE Software 34, 2 (2017), 53--60. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Ashton Anderson, Daniel Huttenlocher, Jon Kleinberg, and Jure Leskovec. 2012. Discovering Value From Community Activity On Focused Question Answering Sites: A Case Study Of Stack Overflow. In Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '12). ACM, New York, NY, USA, 850--858. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Douglas Bates, Martin M"achler, Ben Bolker, and Steve Walker. 2015. Fitting Linear Mixed-Effects Models Using Lme4. , 48 pages.Google ScholarGoogle Scholar
  4. Keith Burghardt, Emanuel F Alsina, Michelle Girvan, William Rand, and Kristina Lerman. 2017. The Myopia Of Crowds: Cognitive Load And Collective Evaluation Of Answers On Stack Exchange. PLoS One 12, 3 (March 2017), e0173610.Google ScholarGoogle ScholarCross RefCross Ref
  5. Moira Burke and Robert Kraut. 2008. Mopping Up: Modeling Wikipedia Promotion Decisions. In Proceedings of the 2008 ACM Conference on Computer Supported Cooperative Work (CSCW '08). ACM, New York, NY, USA, 27--36. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Ciro Cattuto, Dominik Benz, Andreas Hotho, and Gerd Stumme. 2008. Semantic Grounding Of Tag Relatedness In Social Bookmarking Systems. In Proceedings of the 2008 International Semantic Web Conference (ISWC). Springer Berlin Heidelberg, 615--631. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Ciro Cattuto, Vittorio Loreto, and Luciano Pietronero. 2007. Semiotic Dynamics And Collaborative Tagging. Proceedings of the National Academy of Sciences 104, 5 (Jan. 2007), 1461--1464.Google ScholarGoogle ScholarCross RefCross Ref
  8. Joohee Choi and Yla Tausczik. 2017. Content Management Through Distributed Moderation. (2017).Google ScholarGoogle Scholar
  9. Dan Cosley, Dan Frankowski Sara, Sara Kiesler, Loren Terveen, and John Riedl. 2005. How Oversight Improves Member-Maintained Communities. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, New York, NY, USA, 11--20. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Wai-Tat Fu. 2008. The Microstructures Of Social Tagging: A Rational Model. In Proceedings of the 2008 ACM conference on Computer Supported Cooperative Work. ACM, New York, NY, USA, 229--238. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Wai-Tat Fu, Thomas Kannampallil, Ruogu Kang, and Jibo He. 2010. Semantic Imitation In Social Tagging. ACM Transactions on Computer-Human Interaction 17, 3 (July 2010), 12:1--12:37. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Joaqu'in Gair'in-Sall'an, David Rodriguez-G'omez, and Carme Armengol-Aspar'o. 2010. Who Exactly Is The Moderator? A Consideration Of Online Knowledge Management Network Moderation In Educational Organisations. Computers & Education 55, 1 (Aug. 2010), 304--312. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. R Stuart Geiger and David Ribes. 2010. The Work Of Sustaining Order In Wikipedia: The Banning Of A Vandal. In Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work (CSCW '10). ACM, New York, NY, USA, 117--126. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Scott A Golder and Bernardo A Huberman. 2006. Usage Patterns Of Collaborative Tagging Systems. Journal of information science 32, 2 (April 2006), 198--208. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Wael H Gomaa and Aly A Fahmy. 2013. A Survey Of Text Similarity Approaches. International Journal of Computer Applications 68, 13 (2013), 13--18.Google ScholarGoogle ScholarCross RefCross Ref
  16. Harry Halpin, Valentin Robu, and Hana Shepherd. 2007. The Complex Dynamics Of Collaborative Tagging. In Proceedings of the 16th International Conference on World Wide Web (WWW '07). ACM, New York, NY, USA, 211--220. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Andrea Kienle and Carsten Ritterskamp. 2007. Facilitating Asynchronous Discussions In Learning Communities: The Impact Of Moderation Strategies. Behaviour & Information Technology 26, 1 (Jan. 2007), 73--80. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Joy Kim, Justin Cheng, and Michael S Bernstein. 2014. Ensemble: Exploring Complementary Strengths Of Leaders And Crowds In Creative Collaboration. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. ACM, 745--755. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Alexandra Kuznetsova, Per Brockhoff, and Rune Christensen. 2017. Lmertest Package: Tests In Linear Mixed Effects Models. Journal of Statistical Software 82, 13 (2017), 1--26.Google ScholarGoogle ScholarCross RefCross Ref
  20. Haewoon Kwak, Changhyun Lee, Hosung Park, and Sue Moon. 2010. What Is Twitter, A Social Network Or A News Media?. In Proceedings of the 19th international conference on World wide web. AcM, 591--600. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Cliff Lampe and Paul Resnick. 2004. Slash(Dot) And Burn: Distributed Moderation In A Large Online Conversation Space. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '04). ACM, New York, NY, USA, 543--550. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Cliff A C Lampe, Erik Johnston, and Paul Resnick. 2007. Follow The Reader: Filtering Comments On Slashdot. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '07). ACM, New York, NY, USA, 1253--1262. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Jonathan Lazar and Jennifer Preece. 2002. Social Considerations In Online Communities: Usability, Sociability, And Success Factors. In Cognition in a Digital World, H van Oostendorp (Ed.). L. Erlbaum Associates Inc, Hillsdale, NJ, USA.Google ScholarGoogle Scholar
  24. Tobias Ley and Paul Seitlinger. 2015. Dynamics Of Human Categorization In A Collaborative Tagging System: How Social Processes Of Semantic Stabilization Shape Individual Sensemaking. Computers in Human Behavior 51, A (Oct. 2015), 140--151. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Kurt Luther, Casey Fiesler, and Amy Bruckman. 2013. Redistributing Leadership In Online Creative Collaboration. In Proceedings of the 2013 ACM Conference on Computer Supported Cooperative Work (CSCW '13). ACM, New York, NY, USA, 1007--1022. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. George Macgregor and Emma McCulloch. 2006. Collaborative Tagging As A Knowledge Organisation And Resource Discovery Tool. Library review 55, 5 (2006), 291--300.Google ScholarGoogle Scholar
  27. Lena Mamykina, Bella Manoim, Manas Mittal, George Hripcsak, and Bj"orn Hartmann. 2011. Design Lessons From The Fastest Q&A Site In The West. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 2857--2866. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Benjamin Markines, Ciro Cattuto, Filippo Menczer, Dominik Benz, Andreas Hotho, and Gerd Stumme. 2009. Evaluating Similarity Measures For Emergent Semantics Of Social Tagging. In Proceedings of the 18th International Conference on World Wide Web (WWW '09). ACM, New York, NY, USA, 641--650. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Cameron Marlow, Mor Naaman, Danah Boyd, and Marc Davis. 2006. Ht06, Tagging Paper, Taxonomy, Flickr, Academic Article, To Read. In Proceedings of the seventeenth conference on Hypertext and hypermedia. ACM, 31--40. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Michael E McCloskey and Sam Glucksberg. 1978. Natural Categories: Well Defined Or Fuzzy Sets? Memory & Cognition 6, 4 (July 1978), 462--472.Google ScholarGoogle ScholarCross RefCross Ref
  31. Changhoon Oh, Taeyoung Lee, Yoojung Kim, SoHyun Park, and Bongwon Suh. 2016. Understanding Participatory Hashtag Practices On Instagram: A Case Study Of Weekend Hashtag Project. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 1280--1287. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Chris Parnin, Christoph Treude, Lars Grammel, and Margaret-Anne Storey. 2012. Crowd Documentation: Exploring The Coverage And The Dynamics Of API Discussions On Stack Overflow. Technical Report.Google ScholarGoogle Scholar
  33. Denis Parra and Peter Brusilovsky. 2009. Collaborative Filtering For Social Tagging Systems: An Experiment With Citeulike. In Proceedings of the third ACM conference on Recommender systems. ACM, 237--240. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Jenny Preece. 2000. Online Communities: Designing Usability And Supporting Sociability (1st ed.). John Wiley & Sons, Inc., New York, NY, USA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Eleanor Rosch, Carolyn B Mervis, Wayne D Gray, David M Johnson, and Penny Boyes-Braem. 1976. Basic Objects In Natural Categories. Cognitive Psychology 8, 3 (July 1976), 382--439.Google ScholarGoogle ScholarCross RefCross Ref
  36. Daniel M Russell, Mark J Stefik, Peter Pirolli, and Stuart K Card. 1993. The Cost Structure Of Sensemaking. In Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems (CHI '93). ACM, New York, NY, USA, 269--276. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Hinrich Sch"utze and Jan O Pedersen. 1997. A Cooccurrence-Based Thesaurus And Two Applications To Information Retrieval. Information Processing & Management 33, 3 (May 1997), 307--318. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Shilad Sen, Jesse Vig, and John Riedl. 2009. Tagommenders: Connecting Users To Items Through Tags. In Proceedings of the 18th international conference on World wide web. ACM, 671--680. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Fabian M Suchanek, Milan Vojnovic, and Dinan Gunawardena. 2008. Social Tags: Meaning And Suggestions. In Proceedings of the 17th ACM conference on Information and knowledge management. ACM, 223--232. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. James W Tanaka and Marjorie Taylor. 1991. Object Categories And Expertise: Is The Basic Level In The Eye Of The Beholder? Cognitive Psychology 23, 3 (1991), 457--482.Google ScholarGoogle ScholarCross RefCross Ref
  41. Yla R Tausczik, Aniket Kittur, and Robert E Kraut. 2014. Collaborative Problem Solving: A Study Of Mathoverflow. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. ACM, 355--367. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Karl E Weick, Kathleen M Sutcliffe, and David Obstfeld. 2005. Organizing And The Process Of Sensemaking. Organization Science 16, 4 (Aug. 2005), 409--421. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Robert Wetzker, Carsten Zimmermann, Christian Bauckhage, and Sahin Albayrak. 2010. I Tag, You Tag: Translating Tags For Advanced User Models. In Proceedings of the third ACM international conference on Web search and data mining. ACM, 71--80. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Will Too Many Editors Spoil The Tag?: Conflicts and Alignment in Q&A Categorization

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader
        About Cookies On This Site

        We use cookies to ensure that we give you the best experience on our website.

        Learn more

        Got it!