Deploying monotrans widgets in the wild

ABSTRACT

In this paper, we report our experience deploying the MonoTrans Widgets system in a public setting. Our work follows a line of crowd-sourced monolingual translation systems, and it is the first attempt to deploy such a system "in the wild". The results are promising, but we also found out that simultaneously drawing from multiple crowds with different expertise and sizes poses unique problems in the design of such crowd-sourcing systems.

References

1. von Ahn, L., Maurer, B., McMillen, C., Abraham, D., and Blum, M. reCAPTCHA: Human-Based Character Recognition via Web Security Measures. Science 321, 5895 (2008), 1465--1468.
2. Dabbadie, M., Hartley, A., King, M., et al. A hands-on study of the reliability and coherence of evaluation metrics. Workshop at the LREC 2002 Conference, (2002), 8.
3. Hu, C., Bederson, B. B., and Resnik, P. Translation by iterative collaboration between monolingual users. Proceedings of Graphics Interface 2010 on Proceedings of Graphics Interface 2010, 39--46.
4. Hu, C., Bederson, B. B., Resnik, P., and Kronrod, Y. MonoTrans2. Proceedings of the 2011 annual conference on Human factors in computing systems CHI '11, (2011), 1133.
5. Law, E. and von Ahn, L. Human Computation. Synthesis Lectures on Artificial Intelligence and Machine Learning 5, 3 (2011), 1--121.
6. Little, G., Chilton, L. B., Goldman, M., and Miller, R. C. Exploring iterative and parallel human computation processes. Proceedings of the ACM SIGKDD Workshop on Human Computation, ACM (2010), 68--76.
7. Morita, D. and Ishida, T. Designing Protocols for Collaborative Translation. In Principles of Practice in Multi-Agent Systems. 2009, 17--32.
8. Zaidan, O. and Callison-Burch, C. Crowdsourcing Translation: Professional Quality from Non-Professionals. Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies (2011), 1220--1229.
9. Documentation University Research Program for Google Translate - Google Research. 2009.

Index Terms

• Human-centered computing