Abstract
Receiving feedback on preliminary work allows content creators to gain insight and improve outcomes. However, a lack of commitment for gathering feedback and experiencing evaluation apprehension can delay feedback seeking. In this paper, we operationalize goal setting theory for planning feedback goals and test the effects on feedback seeking and revision. In an online experiment, participants (N=245) wrote an initial story after planning feedback goals (or not), submitted the story for feedback at a time of their choice, and revised the story based on feedback received. Participants anticipated feedback from a supervisor or peer to induce different levels of evaluation apprehension. We found that participants who planned proximal feedback goals sought feedback when their stories were less developed and revised the stories more after receiving feedback compared to when participants planned distant goals. Additionally, participants who anticipated feedback from a supervisor, regardless of goal planning, improved the quality of their stories the most. We did not find that goal setting or the provider's role affected evaluation apprehension. Our findings indicate that content creators should be guided to plan proximal feedback goals to encourage sharing of early drafts of creative work and receive feedback from someone in a position of higher perceived power to foster the most revision and improvement on those drafts.
- Louise Arnold, Carolyn K. Shue, Barbara Kritt, Shiphra Ginsburg, and David T. Stern. 2005. Medical students' views on peer assessment of professionalism. Journal of General Internal Medicine, Vol. 20, 9 (sep 2005), 819--824. https://doi.org/10.1111/j.1525--1497.2005.0162.xGoogle Scholar
Cross Ref
- S Ashford. 2003. Reflections on the Looking Glass: A Review of Research on Feedback-Seeking Behavior in Organizations. Journal of Management, Vol. 29, 6 (dec 2003), 773--799. https://doi.org/10.1016/S0149-2063(03)00079-5Google Scholar
- Susan J Ashford and L.L. Cummings. 1983. Feedback as an individual resource: Personal strategies of creating information. Organizational Behavior and Human Performance, Vol. 32, 3 (dec 1983), 370--398. https://doi.org/10.1016/0030-5073(83)90156-3Google Scholar
- SUSAN J. ASHFORD and L. L. CUMMINGS. 1985. Proactive feedback seeking: The instrumental use of the information environment. Journal of Occupational Psychology, Vol. 58, 1 (mar 1985), 67--79. https://doi.org/10.1111/j.2044-8325.1985.tb00181.xGoogle Scholar
- Albert Bandura and Daniel Cervone. 1983. Self-evaluative and self-efficacy mechanisms governing the motivational effects of goal systems. Journal of Personality and Social Psychology, Vol. 45, 5 (1983), 1017--1028. https://doi.org/10.1037/0022-3514.45.5.1017Google Scholar
Cross Ref
- Albert Bandura and Dale H Schunk. 1981. Cultivating competence, self-efficacy, and intrinsic interest through proximal self-motivation. Journal of Personality and Social Psychology, Vol. 41, 3 (1981), 586--598. https://doi.org/10.1037/0022--3514.41.3.586Google Scholar
- Aditya Bharadwaj, Pao Siangliulue, Adam Marcus, and Kurt Luther. 2019. Critter. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19. ACM Press, New York, New York, USA, 1--12. https://doi.org/10.1145/3290605.3300769Google Scholar
- Julia Cambre, Scott Klemmer, and Chinmay Kulkarni. 2018. Juxtapeer. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18. ACM Press, New York, New York, USA, 1--13. https://doi.org/10.1145/3173574.3173868Google Scholar
- Kwangsu Cho and Charles MacArthur. 2010. Student revision with peer and expert reviewing. Learning and Instruction, Vol. 20, 4 (2010), 328--338. https://doi.org/10.1016/j.learninstruc.2009.08.006Google Scholar
Cross Ref
- Patrick A. Crain and Brian P. Bailey. 2017. Share Once or Share Often?. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition - C&C '17. ACM Press, New York, New York, USA, 80--92. https://doi.org/10.1145/3059454.3059476Google Scholar
- D. De Stobbeleir, K. E. M., Ashford, S. J., & Buyens. 2011. Self-regulation of creativity at work: The role of feedback-seeking behavior in creative performance. Academy of Management Journal,, Vol. 54, 4 (2011), 811--831.Google Scholar
- Steven P Dow, Anand Kulkarni, Scott R Klemmer, Bjö rn Hartmann, and Stanford Hci Group. 2012. Shepherding the crowd yields better work. Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work - CSCW '12 (2012), 1013. https://doi.org/10.1145/2145204.2145355Google Scholar
Digital Library
- Donald B. Fedor, Walter D. Davis, John M. Maslyn, and Kieran Mathieson. 2001. Performance improvement efforts in response to negative feedback: the roles of source power and recipient self-esteem. Journal of Management, Vol. 27, 1 (feb 2001), 79--97. https://doi.org/10.1177/014920630102700105Google Scholar
Cross Ref
- Eureka Foong, Steven P Dow, Brian P Bailey, and Elizabeth M Gerber. 2017. Online Feedback Exchange. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 4454--4467. https://doi.org/10.1145/3025453.3025791Google Scholar
Digital Library
- Steve Graham, Karen R Harris, and Charles Macarthur. 2018. Self-regulation and writing. In Handbook of Self-Regulation of Learning and Performance 2 ed.),, Dale H. Schunk and Jeffrey A. Greene (Eds.). Routledge, New York, NY, USA, Chapter 9, 138--152.Google Scholar
- Emily Harburg, Daniel Rees Lewis, Matthew Easterday, and Elizabeth M. Gerber. 2018. CheerOn. ACM Transactions on Computer-Human Interaction, Vol. 25, 6 (dec 2018), 1--46. https://doi.org/10.1145/3241043Google Scholar
Digital Library
- John Hattie and Helen Timperley. 2007. The Power of Feedback. Review of Educational Research, Vol. 77, 1 (2007), 81--112. https://doi.org/10.3102/003465430298487Google Scholar
Cross Ref
- Peter A Heslin, Jay B Carson, and Don Vandewalle. 2007. Practical applications of goal setting theory to performance management. February 2016 (2007), 1--15.Google Scholar
- Catherine M Hicks, Vineet Pandey, C Ailie Fraser, and Scott Klemmer. 2016. Framing Feedback. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 458--469. https://doi.org/10.1145/2858036.2858195Google Scholar
Digital Library
- Julie Hui, Amos Glenn, Rachel Jue, Elizabeth Gerber, and Steven Dow. 2015. Using Anonymity and Communal Efforts to Improve Quality of Crowdsourced Feedback. The Third AAAI Conference on Human Computation and Crowdsourcing (HCOMP-15) (2015), 72--82. https://www.aaai.org/ocs/index.php/HCOMP/HCOMP15/paper/viewFile/11580/11428Google Scholar
Cross Ref
- Julie S Hui, Elizabeth M Gerber, and Steven P Dow. 2014. Crowd-based design activities. In Proceedings of the 2014 conference on Designing interactive systems - DIS '14. ACM Press, New York, New York, USA, 875--884. https://doi.org/10.1145/2598510.2598538Google Scholar
Digital Library
- Christopher Hundhausen, Anukrati Agrawal, Dana Fairbrother, and Michael Trevisan. 2009. Integrating pedagogical code reviews into a CS 1 course. ACM SIGCSE Bulletin, Vol. 41, 1 (mar 2009), 291. https://doi.org/10.1145/1539024.1508972Google Scholar
Digital Library
- Avraham N. Kluger and Angelo DeNisi. 1996. The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, Vol. 119, 2 (1996), 254--284. https://doi.org/10.1037/0033--2909.119.2.254Google Scholar
Cross Ref
- Avraham N. Kluger and Angelo DeNisi. 2015. Creating creativity: user interfaces for supporting innovation. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15, Vol. 44, 1 (2015), 487--515. https://doi.org/10.1145/2702123.2702525Google Scholar
- Yasmine Kotturi and McKayla Kingston. 2019. Why do Designers in the "Wild" Wait to Seek Feedback until Later in their Design Process?. In Proceedings of the 2019 on Creativity and Cognition. ACM, New York, NY, USA, 541--546. https://doi.org/10.1145/3325480.3326580Google Scholar
Digital Library
- Markus Krause, Tom Garncarz, Jiao Jiao Song, Elizabeth M. Gerber, Brian P. Bailey, and Steven P. Dow. 2017. Critique style guide: Improving crowdsourced design feedback with a natural language model. Conference on Human Factors in Computing Systems - Proceedings, Vol. 2017-May, May 2018 (2017), 4627--4639. https://doi.org/10.1145/3025453.3025883Google Scholar
- Sneha R. Krishna Kumaran, Deana C. McDonagh, and Brian P. Bailey. 2017. Increasing Quality and Involvement in Online Peer Feedback Exchange. Proceedings of the ACM on Human-Computer Interaction, Vol. 1, CSCW (2017), 1--18. https://doi.org/10.1145/3134698Google Scholar
- Chinmay E. Kulkarni, Michael S. Bernstein, and Scott R. Klemmer. 2015. PeerStudio. In Proceedings of the Second (2015) ACM Conference on Learning @ Scale - [email protected] '15. ACM Press, New York, New York, USA, 75--84. https://doi.org/10.1145/2724660.2724670Google Scholar
Digital Library
- Edwin A. Locke. 1966. Relationship of Task Success to Satisfaction: Further Replication. Psychological Reports, Vol. 19, 3_suppl (dec 1966), 1132--1132. https://doi.org/10.2466/pr0.1966.19.3f.1132Google Scholar
Cross Ref
- Edwin A Locke. 1969. Purpose without Consciousness: A Contradiction. Psychological Reports, Vol. 25, 3 (dec 1969), 991--1009. https://doi.org/10.2466/pr0.1969.25.3.991Google Scholar
Cross Ref
- Edwin A Locke and Gary P Latham. 2002. Building a practically useful theory of goal setting and task motivation: A 35-year odyssey. American Psychologist, Vol. 57, 9 (2002), 705--717. https://doi.org/10.1037/0003-066X.57.9.705Google Scholar
Cross Ref
- Kurt Luther, Jari-lee Tolentino, Wei Wu, Amy Pavel, Brian P Bailey, Maneesh Agrawala, Bjö rn Hartmann, and Steven P Dow. 2015. Structuring, Aggregating, and Evaluating Crowdsourced Design Critique. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing - CSCW '15. ACM Press, New York, New York, USA, 473--485. https://doi.org/10.1145/2675133.2675283Google Scholar
Digital Library
- Mark Matthews, Elizabeth Murnane, and Jaime Snyder. 2017. Quantifying the Changeable Self: The Role of Self-Tracking in Coming to Terms With and Managing Bipolar Disorder. Human-Computer Interaction, Vol. 32, 5--6 (2017), 413--446. https://doi.org/10.1080/07370024.2017.1294983Google Scholar
Digital Library
- Mary L. McHugh. 2012. Interrater reliability: the kappa statistic. Biochem Med (Zagreb), Vol. 22, 3 (2012), 276--282.Google Scholar
Cross Ref
- Gary E. McPherson, Peter Miksza, and Paul Evans. 2017. Self-Regulated Learning in Music Practice and Performance. In Handbook of Self-Regulation of Learning and Performance. Routledge, 181--193. https://doi.org/10.4324/9781315697048-12Google Scholar
- Mark Meyers. 2014. March First Page Picture Prompt. https://kathytemean.wordpress.com/2014/03/14/free-fall-friday-editor-announced/Google Scholar
- Hamideh Mozaffari. 2013. An Analytical Rubric for Assessing Creativity in Creative Writing. Theory and Practice in Language Studies, Vol. 3, 12 (2013), 2214--2219. https://doi.org/10.4304/tpls.3.12.2214-2219Google Scholar
Cross Ref
- Sean Munson and Sunny Consolvo. 2012. Exploring Goal-setting, Rewards, Self-monitoring, and Sharing to Motivate Physical Activity. In Proceedings of the 6th International Conference on Pervasive Computing Technologies for Healthcare. IEEE, 25--32. https://doi.org/10.4108/icst.pervasivehealth.2012.248691Google Scholar
Cross Ref
- Jasper O'Leary, Holger Winnemö ller, Wilmot Li, Mira Dontcheva, and Morgan Dixon. 2018. Charrette. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18. ACM Press, New York, New York, USA, 1--11. https://doi.org/10.1145/3173574.3174109Google Scholar
- Tracey Papinczak, Louise Young, and Michele Groves. 2007. Peer Assessment in Problem-Based Learning: A Qualitative Study. Advances in Health Sciences Education, Vol. 12, 2 (feb 2007), 169--186. https://doi.org/10.1007/s10459-005-5046-6Google Scholar
Cross Ref
- Wei Peng and Gary Hsieh. 2012. The influence of competition, cooperation, and player relationship in a motor performance centered computer game. Computers in Human Behavior, Vol. 28, 6 (nov 2012), 2100--2106. https://doi.org/10.1016/j.chb.2012.06.014Google Scholar
Digital Library
- Babak Raji, Martin Tenpierik, and Andy van den Dobbelsteen. 2017. Early-Stage Design Considerations for the Energy-Efficiency of High-Rise Office Buildings. Sustainability, Vol. 9, 4 (apr 2017), 623. https://doi.org/10.3390/su9040623Google Scholar
- Shalini T. Reddy, Matthew H. Zegarek, H. Barrett Fromme, Michael S. Ryan, Sarah-Anne Schumann, and Ilene B. Harris. 2015. Barriers and Facilitators to Effective Feedback: A Qualitative Analysis of Data From Multispecialty Resident Focus Groups. Journal of Graduate Medical Education, Vol. 7, 2 (jun 2015), 214--219. https://doi.org/10.4300/JGME-D-14-00461.1Google Scholar
- Kelly A Rocca. 2010. Student Participation in the College Classroom: An Extended Multidisciplinary Literature Review. Communication Education, Vol. 59, 2 (apr 2010), 185--213. https://doi.org/10.1080/03634520903505936Google Scholar
Cross Ref
- D. Royce Sadler. 1989. Formative assessment and the design of instructional systems. Instructional Science, Vol. 18, 2 (1989), 119--144. https://doi.org/10.1007/BF00117714Google Scholar
- Jessica Schroeder, Ravi Karkar, Natalia Murinova, James Fogarty, and Sean A. Munson. 2019. Examining Opportunities for Goal-Directed Self-Tracking to Support Chronic Condition Management. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Vol. 3, 4 (dec 2019), 1--26. https://doi.org/10.1145/3369809Google Scholar
Digital Library
- Manya Sleeper, Alessandro Acquisti, Lorrie Faith Cranor, Patrick Gage Kelley, Sean A. Munson, and Norman Sadeh. 2015. I Would Like To..., I Shouldn't..., I Wish I.... In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing - CSCW '15. ACM Press, New York, New York, USA, 1058--1069. https://doi.org/10.1145/2675133.2675193Google Scholar
Digital Library
- Henry L. Tosi, Edwin A. Locke, and Gary P. Latham. 1991. A Theory of Goal Setting and Task Performance. The Academy of Management Review, Vol. 16, 2 (apr 1991), 480. https://doi.org/10.2307/258875Google Scholar
Cross Ref
- Yaacov Trope and Efrat Neter. 1994. Reconciling competing motives in self-evaluation: The role of self-control in feedback seeking. Journal of Personality and Social Psychology, Vol. 66, 4 (1994), 646--657. https://doi.org/10.1037/0022-3514.66.4.646Google Scholar
Cross Ref
- Jeffrey B. Vancouver and Elizabeth Wolfe Morrison. 1995. Feedback Inquiry: The Effect of Source Attributes and Individual Differences. Organizational Behavior and Human Decision Processes, Vol. 62, 3 (jun 1995), 276--285. https://doi.org/10.1006/obhd.1995.1050Google Scholar
- Don VandeWalle. 2003. A goal orientation model of feedback-seeking behavior. Human Resource Management Review, Vol. 13, 4 (dec 2003), 581--604. https://doi.org/10.1016/j.hrmr.2003.11.004Google Scholar
- Vimal Viswanathan and Julie Linsey. 2011. Design Fixation in Physical Modeling: An Investigation on the Role of Sunk Cost. In Volume 9: 23rd International Conference on Design Theory and Methodology; 16th Design for Manufacturing and the Life Cycle Conference, Vol. 9. ASMEDC, 119--130. https://doi.org/10.1115/DETC2011-47862Google Scholar
- Vimal K. Viswanathan and Julie S. Linsey. 2013. Role of Sunk Cost in Engineering Idea Generation: An Experimental Investigation. Journal of Mechanical Design, Vol. 135, 12 (dec 2013), 1--12. https://doi.org/10.1115/1.4025290Google Scholar
Cross Ref
- Helen Wauck, Yu-Chun Yen, Wai-Tat Fu, Elizabeth Gerber, Steven P Dow, and Brian P Bailey. [n.d.]. From in the Class or in the Wild? Peers Provide Better Design Feedback Than External Crowds. ([n.,d.]). https://doi.org/10.1145/3025453.3025477Google Scholar
- Jane R. Williams, Corey E. Miller, Lisa A. Steelman, and Paul E. Levy. 1999. Increasing feedback seeking in public contexts: It takes two (or more) to tango. Journal of Applied Psychology, Vol. 84, 6 (1999), 969--976. https://doi.org/10.1037/0021-9010.84.6.969Google Scholar
Cross Ref
- Y. Wayne Wu and Brian P. Bailey. 2017. Bitter Sweet or Sweet Bitter?. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition. ACM, New York, NY, USA, 137--147. https://doi.org/10.1145/3059454.3059458Google Scholar
- Y. Wayne Wu and Brian P. Bailey. 2018. Soften the Pain, Increase the Gain. Proceedings of the ACM on Human-Computer Interaction, Vol. 2, CSCW (nov 2018), 1--20. https://doi.org/10.1145/3274455Google Scholar
- Anbang Xu, Shih-Wen Huang, and Brian Bailey. 2014. Voyant. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing - CSCW '14. ACM Press, New York, New York, USA, 1433--1444. https://doi.org/10.1145/2531602.2531604Google Scholar
- Yu-chun Grace Yen, Steven P Dow, Elizabeth Gerber, and Brian P Bailey. 2016. Social Network, Web Forum, or Task Market?. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems - DIS '16. ACM Press, New York, New York, USA, 773--784. https://doi.org/10.1145/2901790.2901820Google Scholar
Digital Library
- Yu-Chun Grace Yen, Steven P. Dow, Elizabeth Gerber, and Brian P. Bailey. 2017. Listen to Others, Listen to Yourself. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition. ACM, New York, NY, USA, 158--170. https://doi.org/10.1145/3059454.3059468Google Scholar
- Yu-chun Grace Yen, Joy O Kim, and Brian P Bailey. 2020. Decipher: An Interactive Visualization Tool for Interpreting Unstructured Design Feedback from Multiple Providers. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1--13. https://doi.org/10.1145/3313831.3376380Google Scholar
Digital Library
- Alvin Yuan, Kurt Luther, Markus Krause, Sophie Isabel Vennix, Steven P Dow, and Bjö rn Hartmann. 2016. Almost an Expert: The Effects of Rubrics and Expertise on Perceived Value of Crowdsourced Design Critiques. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing - CSCW '16. ACM Press, New York, New York, USA, 1003--1015. https://doi.org/10.1145/2818048.2819953Google Scholar
Digital Library
- Barry J Zimmerman. 1990. Self-Regulated Learning and Academic Achievement: An Overview. Educational Psychologist, Vol. 25, 1 (jan 1990), 3--17. https://doi.org/10.1207/s15326985ep2501_2 arxiv: arXiv:1011.1669v3Google Scholar
Cross Ref
- Barry J. Zimmerman and Adam R. Moylan. 2009. Self-Regulation: where metacognition and motivation intersect. In Handbook of Metacognition in Education, Douglas J. Hacker, John Dunlosky, and Arthur C Graesser (Eds.). Routledge, New York, New York, USA, Chapter 16, 299--315.Google Scholar
Index Terms
Plan Early, Revise More: Effects of Goal Setting and Perceived Role of the Feedback Provider on Feedback Seeking Behavior
Recommendations
Am I Ready to Get Feedback? A Taxonomy of Factors Creators Consider Before Seeking Feedback on In-Progress Creative Work
C&C '21: Proceedings of the 13th Conference on Creativity and CognitionReceiving feedback on preliminary work allows content creators to gain insight and improve outcomes. However, many creators only share in-progress work at late stages of the creative process and lose opportunities to address conceptual issues in the ...
Easier Said or Easier Done? Exploring the Relative Merits of Common Feedback Presentations
CSCW1Feedback such as rubrics, pre-authored statements, and free-form comments are widely deployed in classrooms and feedback exchange communities. Despite these formats having different levels of detail and requiring different composition processes, little ...
Student Perceptions on the Utilization of Formative Feedback in the Online Environment
This article addresses instructors' formative feedback to graduate student writing. The authors investigated the utilization of a formative feedback option in online master and doctoral degree programs in health education and administration. Two hundred ...






Comments