Abstract
Programming forums are becoming the primary tools for programmers to find answers for their programming problems. Our empirical study of popular programming forums shows that the forum users experience long waiting period for answers and a small number of experts are often overloaded with questions. To improve the usage experience, we have designed and implemented G-Finder, both an algorithm and a tool that makes intelligent routing decisions as to which participant is the expert for answering a particular programming question. Our main approach is to leverage the source code information of the software systems that forums are dedicated to, and discover latent relationships between forums users. Our algorithms construct the concept networks and the user networks from the program source and the forum data.We use programming questions to dynamically integrate these two networks and present an adaptive ranking of the potential experts. Our evaluation of G-Finder, using the data from three large programming forums, takes a retrospective view to check if G-Finder can correctly predict the experts who provided answers to programming questions. The evaluation results show that G-Finder improves the prediction precision by 25% to 74%, compared to related approaches.
- }}J. Anvik, L. Hiew, and G. C. Murphy. Who should fix this bug? In 28th International Conference on Software Engineering (ICSE 2006), Shanghai, China, May 20--28, 2006, pages 361--370. ACM, 2006. ISBN 1-59593-375-1. Google Scholar
Digital Library
- }}K. Balog, L. Azzopardi, and M. de Rijke. Formal models for expert finding in enterprise corpora. In SIGIR '06: Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, pages 43--50, New York, NY, USA, 2006. ACM. ISBN 1-59593-369-7. doi:http://doi.acm.org/10.1145/1148170.1148181. Google Scholar
Digital Library
- }}K. Balog, T. Bogers, L. Azzopardi, M. de Rijke, and A. van den Bosch. Broad expertise retrieval in sparse data environments. In SIGIR '07: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, pages 551--558, New York, NY, USA, 2007. ACM. ISBN 978-1-59593-597-7. doi: http://doi.acm.org/10.1145/1277741.1277836. Google Scholar
Digital Library
- }}D. M. Blei, A. Y. Ng, and M. I. Jordan. Latent dirichlet allocation. J. Mach. Learn. Res., 3:993--1022, 2003. ISSN 1532-4435. doi: http://dx.doi.org/10.1162/jmlr.2003.3.4-5.993. Google Scholar
Digital Library
- }}S. Brin and L. Page. The anatomy of a large-scale hypertextual web search engine. Comput. Netw. ISDN Syst., 30(1-7):107--117, 1998. ISSN 0169-7552. doi:http://dx.doi.org/10.1016/ S0169-7552(98)00110-X. Google Scholar
Digital Library
- }}P. Jurczyk and E. Agichtein. Discovering authorities in question answer communities by using link analysis. In CIKM '07: Proceedings of the sixteenth ACM conference on Conference on information and knowledge management, pages 919--922, New York, NY, USA, 2007. ACM. ISBN 978-1-59593-803-9. doi: http://doi.acm.org/10.1145/1321440.1321575. Google Scholar
Digital Library
- }}J. M. Kleinberg. Authoritative sources in a hyperlinked environment. In SODA '98: Proceedings of the ninth annual ACM-SIAM symposium on Discrete algorithms, pages 668--677, Philadelphia, PA, USA, 1998. Society for Industrial and Applied Mathematics. ISBN 0-89871-410-9. Google Scholar
Digital Library
- }}C. Manning, P. Raghavan, and H. Schtze. Introduction to Information Retrieval. Cambridage University Press, 2008. Google Scholar
Digital Library
- }}D. Mimno and A. McCallum. Expertise modeling for matching papers with reviewers. In KDD '07: Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 500--509, New York, NY, USA, 2007. ACM. ISBN 978-1-59593-609-7. doi: http://doi.acm.org/10.1145/1281192.1281247. Google Scholar
Digital Library
- }}A. Mockus and J. D. Herbsleb. Expertise browser: a quantitative approach to identifying expertise. In Proceedings of the 22rd International Conference on Software Engineering, ICSE 2002, 19-25 May 2002, Orlando, Florida, USA, pages 503--512. ACM, 2002. Google Scholar
Digital Library
- }}D. Petkova and W. B. Croft. Hierarchical language models for expert finding in enterprise corpora. In ICTAI '06: Proceedings of the 18th IEEE International Conference on Tools with Artificial Intelligence, pages 599--608, Washington, DC, USA, 2006. IEEE Computer Society. ISBN 0-7695-2728-0. doi: http://dx.doi.org/10.1109/ICTAI.2006.63. Google Scholar
Digital Library
- }}J. M. Ponte and W. B. Croft. A language modeling approach to information retrieval. In SIGIR '98: Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, pages 275--281, New York, NY, USA, 1998. ACM. ISBN 1-58113-015-5. doi: http://doi.acm.org/10.1145/290941.291008. Google Scholar
Digital Library
- }}G. Salton and C. Buckley. Term weighting approaches in automatic text retrieval. Technical report, Ithaca, NY, USA, 1987. Google Scholar
Digital Library
- }}C. Shah and W. B. Croft. Evaluating high accuracy retrieval techniques. In SIGIR '04: Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, pages 2--9, New York, NY, USA, 2004. ACM. ISBN 1-58113-881-4. doi: http://doi.acm.org/10.1145/1008992.1008996. Google Scholar
Digital Library
- }}E. Voorhees and D. Tice. The trec-8 question answering track evaluation. In Proceedings 8th Text REtrieval Conference (TREC-8), pages 83--105, 1999.Google Scholar
Cross Ref
- }}C. Zhai and J. Lafferty. A study of smoothing methods for language models applied to information retrieval. ACM Trans. Inf. Syst., 22(2):179--214, 2004. ISSN 1046-8188. doi: http://doi.acm.org/10.1145/984321.984322. Google Scholar
Digital Library
- }}J. Zhang, M. S. Ackerman, and L. Adamic. Expertise networks in online communities: structure and algorithms. In WWW '07: Proceedings of the 16th international conference on World Wide Web, pages 221--230, New York, NY, USA, 2007. ACM. ISBN 978-1-59593-654-7. doi: http://doi.acm.org/10.1145/1242572.1242603. Google Scholar
Digital Library
- }}Y. Zhou, G. Cong, B. Cui, C. S. Jensen, and J. Yao. Routing questions to the right users in online communities. In ICDE'09: Proceedings of the 2009 IEEE International Conference on Data Engineering, pages 700--711,Washington, DC, USA, 2009. IEEE Computer Society. ISBN 978-0-7695-3545-6. doi: http://dx.doi.org/10.1109/ICDE.2009.44. Google Scholar
Digital Library
Index Terms
G-Finder: routing programming questions closer to the experts
Recommendations
G-Finder: routing programming questions closer to the experts
OOPSLA '10: Proceedings of the ACM international conference on Object oriented programming systems languages and applicationsProgramming forums are becoming the primary tools for programmers to find answers for their programming problems. Our empirical study of popular programming forums shows that the forum users experience long waiting period for answers and a small number ...
Find an Expert: Designing Expert Selection Interfaces for Formal Help-Giving
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing SystemsA critical aspect of formal help-giving tasks in the enterprise is finding the right expert. We built and evaluated a tool, Find an Expert, to examine what the most important expert selection criteria are for help-seekers and how to represent them in ...
An ontology based model for experts search and ranking
ACIIDS'11: Proceedings of the Third international conference on Intelligent information and database systems - Volume Part IIExperts finding is an important issue for finding potential contributors or expertise in a specific field. In scientific research, researchers often try to find an experts list related to their interest areas to acquire the knowledge about state arts of ...







Comments