Abstract
Q&A websites compile useful knowledge through user-generated questions and responses. Many Q&As use collaborative tagging systems to improve search and discovery while distributing the work of categorizing and organization throughout the community. Although early work on collaborative tagging questioned whether consistent categorization schemes could emerge from large groups with little to no coordination, empirical studies have found surprising coherence among users' tags. We build on this research by testing whether coherence emerges in tag usage on Q&As, a more challenging context, focusing in particular on mismatches in the specificity of tags (basic level disagreement). We found that some users shifted toward more specific tag usage over time slightly increasing conflict, but that moderators were instrumental in helping to resolve some of this conflict. This study highlights the importance of learning and moderation in the development of coherence in collaborative tagging systems.
- Rabe Abdalkareem, Emad Shihab, and Juergen Rilling. 2017. What Do Developers Use The Crowd For? A Study Using Stack Overflow. IEEE Software 34, 2 (2017), 53--60. Google Scholar
Digital Library
- Ashton Anderson, Daniel Huttenlocher, Jon Kleinberg, and Jure Leskovec. 2012. Discovering Value From Community Activity On Focused Question Answering Sites: A Case Study Of Stack Overflow. In Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '12). ACM, New York, NY, USA, 850--858. Google Scholar
Digital Library
- Douglas Bates, Martin M"achler, Ben Bolker, and Steve Walker. 2015. Fitting Linear Mixed-Effects Models Using Lme4. , 48 pages.Google Scholar
- Keith Burghardt, Emanuel F Alsina, Michelle Girvan, William Rand, and Kristina Lerman. 2017. The Myopia Of Crowds: Cognitive Load And Collective Evaluation Of Answers On Stack Exchange. PLoS One 12, 3 (March 2017), e0173610.Google Scholar
Cross Ref
- Moira Burke and Robert Kraut. 2008. Mopping Up: Modeling Wikipedia Promotion Decisions. In Proceedings of the 2008 ACM Conference on Computer Supported Cooperative Work (CSCW '08). ACM, New York, NY, USA, 27--36. Google Scholar
Digital Library
- Ciro Cattuto, Dominik Benz, Andreas Hotho, and Gerd Stumme. 2008. Semantic Grounding Of Tag Relatedness In Social Bookmarking Systems. In Proceedings of the 2008 International Semantic Web Conference (ISWC). Springer Berlin Heidelberg, 615--631. Google Scholar
Digital Library
- Ciro Cattuto, Vittorio Loreto, and Luciano Pietronero. 2007. Semiotic Dynamics And Collaborative Tagging. Proceedings of the National Academy of Sciences 104, 5 (Jan. 2007), 1461--1464.Google Scholar
Cross Ref
- Joohee Choi and Yla Tausczik. 2017. Content Management Through Distributed Moderation. (2017).Google Scholar
- Dan Cosley, Dan Frankowski Sara, Sara Kiesler, Loren Terveen, and John Riedl. 2005. How Oversight Improves Member-Maintained Communities. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, New York, NY, USA, 11--20. Google Scholar
Digital Library
- Wai-Tat Fu. 2008. The Microstructures Of Social Tagging: A Rational Model. In Proceedings of the 2008 ACM conference on Computer Supported Cooperative Work. ACM, New York, NY, USA, 229--238. Google Scholar
Digital Library
- Wai-Tat Fu, Thomas Kannampallil, Ruogu Kang, and Jibo He. 2010. Semantic Imitation In Social Tagging. ACM Transactions on Computer-Human Interaction 17, 3 (July 2010), 12:1--12:37. Google Scholar
Digital Library
- Joaqu'in Gair'in-Sall'an, David Rodriguez-G'omez, and Carme Armengol-Aspar'o. 2010. Who Exactly Is The Moderator? A Consideration Of Online Knowledge Management Network Moderation In Educational Organisations. Computers & Education 55, 1 (Aug. 2010), 304--312. Google Scholar
Digital Library
- R Stuart Geiger and David Ribes. 2010. The Work Of Sustaining Order In Wikipedia: The Banning Of A Vandal. In Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work (CSCW '10). ACM, New York, NY, USA, 117--126. Google Scholar
Digital Library
- Scott A Golder and Bernardo A Huberman. 2006. Usage Patterns Of Collaborative Tagging Systems. Journal of information science 32, 2 (April 2006), 198--208. Google Scholar
Digital Library
- Wael H Gomaa and Aly A Fahmy. 2013. A Survey Of Text Similarity Approaches. International Journal of Computer Applications 68, 13 (2013), 13--18.Google Scholar
Cross Ref
- Harry Halpin, Valentin Robu, and Hana Shepherd. 2007. The Complex Dynamics Of Collaborative Tagging. In Proceedings of the 16th International Conference on World Wide Web (WWW '07). ACM, New York, NY, USA, 211--220. Google Scholar
Digital Library
- Andrea Kienle and Carsten Ritterskamp. 2007. Facilitating Asynchronous Discussions In Learning Communities: The Impact Of Moderation Strategies. Behaviour & Information Technology 26, 1 (Jan. 2007), 73--80. Google Scholar
Digital Library
- Joy Kim, Justin Cheng, and Michael S Bernstein. 2014. Ensemble: Exploring Complementary Strengths Of Leaders And Crowds In Creative Collaboration. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. ACM, 745--755. Google Scholar
Digital Library
- Alexandra Kuznetsova, Per Brockhoff, and Rune Christensen. 2017. Lmertest Package: Tests In Linear Mixed Effects Models. Journal of Statistical Software 82, 13 (2017), 1--26.Google Scholar
Cross Ref
- Haewoon Kwak, Changhyun Lee, Hosung Park, and Sue Moon. 2010. What Is Twitter, A Social Network Or A News Media?. In Proceedings of the 19th international conference on World wide web. AcM, 591--600. Google Scholar
Digital Library
- Cliff Lampe and Paul Resnick. 2004. Slash(Dot) And Burn: Distributed Moderation In A Large Online Conversation Space. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '04). ACM, New York, NY, USA, 543--550. Google Scholar
Digital Library
- Cliff A C Lampe, Erik Johnston, and Paul Resnick. 2007. Follow The Reader: Filtering Comments On Slashdot. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '07). ACM, New York, NY, USA, 1253--1262. Google Scholar
Digital Library
- Jonathan Lazar and Jennifer Preece. 2002. Social Considerations In Online Communities: Usability, Sociability, And Success Factors. In Cognition in a Digital World, H van Oostendorp (Ed.). L. Erlbaum Associates Inc, Hillsdale, NJ, USA.Google Scholar
- Tobias Ley and Paul Seitlinger. 2015. Dynamics Of Human Categorization In A Collaborative Tagging System: How Social Processes Of Semantic Stabilization Shape Individual Sensemaking. Computers in Human Behavior 51, A (Oct. 2015), 140--151. Google Scholar
Digital Library
- Kurt Luther, Casey Fiesler, and Amy Bruckman. 2013. Redistributing Leadership In Online Creative Collaboration. In Proceedings of the 2013 ACM Conference on Computer Supported Cooperative Work (CSCW '13). ACM, New York, NY, USA, 1007--1022. Google Scholar
Digital Library
- George Macgregor and Emma McCulloch. 2006. Collaborative Tagging As A Knowledge Organisation And Resource Discovery Tool. Library review 55, 5 (2006), 291--300.Google Scholar
- Lena Mamykina, Bella Manoim, Manas Mittal, George Hripcsak, and Bj"orn Hartmann. 2011. Design Lessons From The Fastest Q&A Site In The West. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 2857--2866. Google Scholar
Digital Library
- Benjamin Markines, Ciro Cattuto, Filippo Menczer, Dominik Benz, Andreas Hotho, and Gerd Stumme. 2009. Evaluating Similarity Measures For Emergent Semantics Of Social Tagging. In Proceedings of the 18th International Conference on World Wide Web (WWW '09). ACM, New York, NY, USA, 641--650. Google Scholar
Digital Library
- Cameron Marlow, Mor Naaman, Danah Boyd, and Marc Davis. 2006. Ht06, Tagging Paper, Taxonomy, Flickr, Academic Article, To Read. In Proceedings of the seventeenth conference on Hypertext and hypermedia. ACM, 31--40. Google Scholar
Digital Library
- Michael E McCloskey and Sam Glucksberg. 1978. Natural Categories: Well Defined Or Fuzzy Sets? Memory & Cognition 6, 4 (July 1978), 462--472.Google Scholar
Cross Ref
- Changhoon Oh, Taeyoung Lee, Yoojung Kim, SoHyun Park, and Bongwon Suh. 2016. Understanding Participatory Hashtag Practices On Instagram: A Case Study Of Weekend Hashtag Project. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 1280--1287. Google Scholar
Digital Library
- Chris Parnin, Christoph Treude, Lars Grammel, and Margaret-Anne Storey. 2012. Crowd Documentation: Exploring The Coverage And The Dynamics Of API Discussions On Stack Overflow. Technical Report.Google Scholar
- Denis Parra and Peter Brusilovsky. 2009. Collaborative Filtering For Social Tagging Systems: An Experiment With Citeulike. In Proceedings of the third ACM conference on Recommender systems. ACM, 237--240. Google Scholar
Digital Library
- Jenny Preece. 2000. Online Communities: Designing Usability And Supporting Sociability (1st ed.). John Wiley & Sons, Inc., New York, NY, USA. Google Scholar
Digital Library
- Eleanor Rosch, Carolyn B Mervis, Wayne D Gray, David M Johnson, and Penny Boyes-Braem. 1976. Basic Objects In Natural Categories. Cognitive Psychology 8, 3 (July 1976), 382--439.Google Scholar
Cross Ref
- Daniel M Russell, Mark J Stefik, Peter Pirolli, and Stuart K Card. 1993. The Cost Structure Of Sensemaking. In Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems (CHI '93). ACM, New York, NY, USA, 269--276. Google Scholar
Digital Library
- Hinrich Sch"utze and Jan O Pedersen. 1997. A Cooccurrence-Based Thesaurus And Two Applications To Information Retrieval. Information Processing & Management 33, 3 (May 1997), 307--318. Google Scholar
Digital Library
- Shilad Sen, Jesse Vig, and John Riedl. 2009. Tagommenders: Connecting Users To Items Through Tags. In Proceedings of the 18th international conference on World wide web. ACM, 671--680. Google Scholar
Digital Library
- Fabian M Suchanek, Milan Vojnovic, and Dinan Gunawardena. 2008. Social Tags: Meaning And Suggestions. In Proceedings of the 17th ACM conference on Information and knowledge management. ACM, 223--232. Google Scholar
Digital Library
- James W Tanaka and Marjorie Taylor. 1991. Object Categories And Expertise: Is The Basic Level In The Eye Of The Beholder? Cognitive Psychology 23, 3 (1991), 457--482.Google Scholar
Cross Ref
- Yla R Tausczik, Aniket Kittur, and Robert E Kraut. 2014. Collaborative Problem Solving: A Study Of Mathoverflow. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. ACM, 355--367. Google Scholar
Digital Library
- Karl E Weick, Kathleen M Sutcliffe, and David Obstfeld. 2005. Organizing And The Process Of Sensemaking. Organization Science 16, 4 (Aug. 2005), 409--421. Google Scholar
Digital Library
- Robert Wetzker, Carsten Zimmermann, Christian Bauckhage, and Sahin Albayrak. 2010. I Tag, You Tag: Translating Tags For Advanced User Models. In Proceedings of the third ACM international conference on Web search and data mining. ACM, 71--80. Google Scholar
Digital Library
Index Terms
Will Too Many Editors Spoil The Tag?: Conflicts and Alignment in Q&A Categorization
Recommendations
Dealing with the video tidal wave: the relevance of expertise for video tagging
HT '10: Proceedings of the 21st ACM conference on Hypertext and hypermediaThe vast amounts of video that need to be tagged preclude the exclusive use of professional indexers. Thus a significant amount of video will need to be tagged by non-experts. Are the tags created by experts demonstrably superior to those of non-experts,...
Dynamics of human categorization in a collaborative tagging system
We study how categories people develop in collaborative tagging change over time.Their internal cognitive categories and the tags they use are coordinated.Especially groups converging in the use of terms develop differentiated categories.Social ...
Learning in efficient tag recommendation
RecSys '10: Proceedings of the fourth ACM conference on Recommender systemsThe objective of a tag recommendation system is to propose a set of tags for a resource to ease the tagging process done manually by a user. Tag recommendation is an interesting and well defined research problem. However, while solving it, it is easy to ...






Comments