skip to main content
research-article
Public Access

Plan Early, Revise More: Effects of Goal Setting and Perceived Role of the Feedback Provider on Feedback Seeking Behavior

Authors Info & Claims
Published:22 April 2021Publication History
Skip Abstract Section

Abstract

Receiving feedback on preliminary work allows content creators to gain insight and improve outcomes. However, a lack of commitment for gathering feedback and experiencing evaluation apprehension can delay feedback seeking. In this paper, we operationalize goal setting theory for planning feedback goals and test the effects on feedback seeking and revision. In an online experiment, participants (N=245) wrote an initial story after planning feedback goals (or not), submitted the story for feedback at a time of their choice, and revised the story based on feedback received. Participants anticipated feedback from a supervisor or peer to induce different levels of evaluation apprehension. We found that participants who planned proximal feedback goals sought feedback when their stories were less developed and revised the stories more after receiving feedback compared to when participants planned distant goals. Additionally, participants who anticipated feedback from a supervisor, regardless of goal planning, improved the quality of their stories the most. We did not find that goal setting or the provider's role affected evaluation apprehension. Our findings indicate that content creators should be guided to plan proximal feedback goals to encourage sharing of early drafts of creative work and receive feedback from someone in a position of higher perceived power to foster the most revision and improvement on those drafts.

References

  1. Louise Arnold, Carolyn K. Shue, Barbara Kritt, Shiphra Ginsburg, and David T. Stern. 2005. Medical students' views on peer assessment of professionalism. Journal of General Internal Medicine, Vol. 20, 9 (sep 2005), 819--824. https://doi.org/10.1111/j.1525--1497.2005.0162.xGoogle ScholarGoogle ScholarCross RefCross Ref
  2. S Ashford. 2003. Reflections on the Looking Glass: A Review of Research on Feedback-Seeking Behavior in Organizations. Journal of Management, Vol. 29, 6 (dec 2003), 773--799. https://doi.org/10.1016/S0149-2063(03)00079-5Google ScholarGoogle Scholar
  3. Susan J Ashford and L.L. Cummings. 1983. Feedback as an individual resource: Personal strategies of creating information. Organizational Behavior and Human Performance, Vol. 32, 3 (dec 1983), 370--398. https://doi.org/10.1016/0030-5073(83)90156-3Google ScholarGoogle Scholar
  4. SUSAN J. ASHFORD and L. L. CUMMINGS. 1985. Proactive feedback seeking: The instrumental use of the information environment. Journal of Occupational Psychology, Vol. 58, 1 (mar 1985), 67--79. https://doi.org/10.1111/j.2044-8325.1985.tb00181.xGoogle ScholarGoogle Scholar
  5. Albert Bandura and Daniel Cervone. 1983. Self-evaluative and self-efficacy mechanisms governing the motivational effects of goal systems. Journal of Personality and Social Psychology, Vol. 45, 5 (1983), 1017--1028. https://doi.org/10.1037/0022-3514.45.5.1017Google ScholarGoogle ScholarCross RefCross Ref
  6. Albert Bandura and Dale H Schunk. 1981. Cultivating competence, self-efficacy, and intrinsic interest through proximal self-motivation. Journal of Personality and Social Psychology, Vol. 41, 3 (1981), 586--598. https://doi.org/10.1037/0022--3514.41.3.586Google ScholarGoogle Scholar
  7. Aditya Bharadwaj, Pao Siangliulue, Adam Marcus, and Kurt Luther. 2019. Critter. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19. ACM Press, New York, New York, USA, 1--12. https://doi.org/10.1145/3290605.3300769Google ScholarGoogle Scholar
  8. Julia Cambre, Scott Klemmer, and Chinmay Kulkarni. 2018. Juxtapeer. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18. ACM Press, New York, New York, USA, 1--13. https://doi.org/10.1145/3173574.3173868Google ScholarGoogle Scholar
  9. Kwangsu Cho and Charles MacArthur. 2010. Student revision with peer and expert reviewing. Learning and Instruction, Vol. 20, 4 (2010), 328--338. https://doi.org/10.1016/j.learninstruc.2009.08.006Google ScholarGoogle ScholarCross RefCross Ref
  10. Patrick A. Crain and Brian P. Bailey. 2017. Share Once or Share Often?. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition - C&C '17. ACM Press, New York, New York, USA, 80--92. https://doi.org/10.1145/3059454.3059476Google ScholarGoogle Scholar
  11. D. De Stobbeleir, K. E. M., Ashford, S. J., & Buyens. 2011. Self-regulation of creativity at work: The role of feedback-seeking behavior in creative performance. Academy of Management Journal,, Vol. 54, 4 (2011), 811--831.Google ScholarGoogle Scholar
  12. Steven P Dow, Anand Kulkarni, Scott R Klemmer, Bjö rn Hartmann, and Stanford Hci Group. 2012. Shepherding the crowd yields better work. Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work - CSCW '12 (2012), 1013. https://doi.org/10.1145/2145204.2145355Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Donald B. Fedor, Walter D. Davis, John M. Maslyn, and Kieran Mathieson. 2001. Performance improvement efforts in response to negative feedback: the roles of source power and recipient self-esteem. Journal of Management, Vol. 27, 1 (feb 2001), 79--97. https://doi.org/10.1177/014920630102700105Google ScholarGoogle ScholarCross RefCross Ref
  14. Eureka Foong, Steven P Dow, Brian P Bailey, and Elizabeth M Gerber. 2017. Online Feedback Exchange. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 4454--4467. https://doi.org/10.1145/3025453.3025791Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Steve Graham, Karen R Harris, and Charles Macarthur. 2018. Self-regulation and writing. In Handbook of Self-Regulation of Learning and Performance 2 ed.),, Dale H. Schunk and Jeffrey A. Greene (Eds.). Routledge, New York, NY, USA, Chapter 9, 138--152.Google ScholarGoogle Scholar
  16. Emily Harburg, Daniel Rees Lewis, Matthew Easterday, and Elizabeth M. Gerber. 2018. CheerOn. ACM Transactions on Computer-Human Interaction, Vol. 25, 6 (dec 2018), 1--46. https://doi.org/10.1145/3241043Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. John Hattie and Helen Timperley. 2007. The Power of Feedback. Review of Educational Research, Vol. 77, 1 (2007), 81--112. https://doi.org/10.3102/003465430298487Google ScholarGoogle ScholarCross RefCross Ref
  18. Peter A Heslin, Jay B Carson, and Don Vandewalle. 2007. Practical applications of goal setting theory to performance management. February 2016 (2007), 1--15.Google ScholarGoogle Scholar
  19. Catherine M Hicks, Vineet Pandey, C Ailie Fraser, and Scott Klemmer. 2016. Framing Feedback. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 458--469. https://doi.org/10.1145/2858036.2858195Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Julie Hui, Amos Glenn, Rachel Jue, Elizabeth Gerber, and Steven Dow. 2015. Using Anonymity and Communal Efforts to Improve Quality of Crowdsourced Feedback. The Third AAAI Conference on Human Computation and Crowdsourcing (HCOMP-15) (2015), 72--82. https://www.aaai.org/ocs/index.php/HCOMP/HCOMP15/paper/viewFile/11580/11428Google ScholarGoogle ScholarCross RefCross Ref
  21. Julie S Hui, Elizabeth M Gerber, and Steven P Dow. 2014. Crowd-based design activities. In Proceedings of the 2014 conference on Designing interactive systems - DIS '14. ACM Press, New York, New York, USA, 875--884. https://doi.org/10.1145/2598510.2598538Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Christopher Hundhausen, Anukrati Agrawal, Dana Fairbrother, and Michael Trevisan. 2009. Integrating pedagogical code reviews into a CS 1 course. ACM SIGCSE Bulletin, Vol. 41, 1 (mar 2009), 291. https://doi.org/10.1145/1539024.1508972Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Avraham N. Kluger and Angelo DeNisi. 1996. The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, Vol. 119, 2 (1996), 254--284. https://doi.org/10.1037/0033--2909.119.2.254Google ScholarGoogle ScholarCross RefCross Ref
  24. Avraham N. Kluger and Angelo DeNisi. 2015. Creating creativity: user interfaces for supporting innovation. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15, Vol. 44, 1 (2015), 487--515. https://doi.org/10.1145/2702123.2702525Google ScholarGoogle Scholar
  25. Yasmine Kotturi and McKayla Kingston. 2019. Why do Designers in the "Wild" Wait to Seek Feedback until Later in their Design Process?. In Proceedings of the 2019 on Creativity and Cognition. ACM, New York, NY, USA, 541--546. https://doi.org/10.1145/3325480.3326580Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Markus Krause, Tom Garncarz, Jiao Jiao Song, Elizabeth M. Gerber, Brian P. Bailey, and Steven P. Dow. 2017. Critique style guide: Improving crowdsourced design feedback with a natural language model. Conference on Human Factors in Computing Systems - Proceedings, Vol. 2017-May, May 2018 (2017), 4627--4639. https://doi.org/10.1145/3025453.3025883Google ScholarGoogle Scholar
  27. Sneha R. Krishna Kumaran, Deana C. McDonagh, and Brian P. Bailey. 2017. Increasing Quality and Involvement in Online Peer Feedback Exchange. Proceedings of the ACM on Human-Computer Interaction, Vol. 1, CSCW (2017), 1--18. https://doi.org/10.1145/3134698Google ScholarGoogle Scholar
  28. Chinmay E. Kulkarni, Michael S. Bernstein, and Scott R. Klemmer. 2015. PeerStudio. In Proceedings of the Second (2015) ACM Conference on Learning @ Scale - [email protected] '15. ACM Press, New York, New York, USA, 75--84. https://doi.org/10.1145/2724660.2724670Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Edwin A. Locke. 1966. Relationship of Task Success to Satisfaction: Further Replication. Psychological Reports, Vol. 19, 3_suppl (dec 1966), 1132--1132. https://doi.org/10.2466/pr0.1966.19.3f.1132Google ScholarGoogle ScholarCross RefCross Ref
  30. Edwin A Locke. 1969. Purpose without Consciousness: A Contradiction. Psychological Reports, Vol. 25, 3 (dec 1969), 991--1009. https://doi.org/10.2466/pr0.1969.25.3.991Google ScholarGoogle ScholarCross RefCross Ref
  31. Edwin A Locke and Gary P Latham. 2002. Building a practically useful theory of goal setting and task motivation: A 35-year odyssey. American Psychologist, Vol. 57, 9 (2002), 705--717. https://doi.org/10.1037/0003-066X.57.9.705Google ScholarGoogle ScholarCross RefCross Ref
  32. Kurt Luther, Jari-lee Tolentino, Wei Wu, Amy Pavel, Brian P Bailey, Maneesh Agrawala, Bjö rn Hartmann, and Steven P Dow. 2015. Structuring, Aggregating, and Evaluating Crowdsourced Design Critique. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing - CSCW '15. ACM Press, New York, New York, USA, 473--485. https://doi.org/10.1145/2675133.2675283Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Mark Matthews, Elizabeth Murnane, and Jaime Snyder. 2017. Quantifying the Changeable Self: The Role of Self-Tracking in Coming to Terms With and Managing Bipolar Disorder. Human-Computer Interaction, Vol. 32, 5--6 (2017), 413--446. https://doi.org/10.1080/07370024.2017.1294983Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Mary L. McHugh. 2012. Interrater reliability: the kappa statistic. Biochem Med (Zagreb), Vol. 22, 3 (2012), 276--282.Google ScholarGoogle ScholarCross RefCross Ref
  35. Gary E. McPherson, Peter Miksza, and Paul Evans. 2017. Self-Regulated Learning in Music Practice and Performance. In Handbook of Self-Regulation of Learning and Performance. Routledge, 181--193. https://doi.org/10.4324/9781315697048-12Google ScholarGoogle Scholar
  36. Mark Meyers. 2014. March First Page Picture Prompt. https://kathytemean.wordpress.com/2014/03/14/free-fall-friday-editor-announced/Google ScholarGoogle Scholar
  37. Hamideh Mozaffari. 2013. An Analytical Rubric for Assessing Creativity in Creative Writing. Theory and Practice in Language Studies, Vol. 3, 12 (2013), 2214--2219. https://doi.org/10.4304/tpls.3.12.2214-2219Google ScholarGoogle ScholarCross RefCross Ref
  38. Sean Munson and Sunny Consolvo. 2012. Exploring Goal-setting, Rewards, Self-monitoring, and Sharing to Motivate Physical Activity. In Proceedings of the 6th International Conference on Pervasive Computing Technologies for Healthcare. IEEE, 25--32. https://doi.org/10.4108/icst.pervasivehealth.2012.248691Google ScholarGoogle ScholarCross RefCross Ref
  39. Jasper O'Leary, Holger Winnemö ller, Wilmot Li, Mira Dontcheva, and Morgan Dixon. 2018. Charrette. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18. ACM Press, New York, New York, USA, 1--11. https://doi.org/10.1145/3173574.3174109Google ScholarGoogle Scholar
  40. Tracey Papinczak, Louise Young, and Michele Groves. 2007. Peer Assessment in Problem-Based Learning: A Qualitative Study. Advances in Health Sciences Education, Vol. 12, 2 (feb 2007), 169--186. https://doi.org/10.1007/s10459-005-5046-6Google ScholarGoogle ScholarCross RefCross Ref
  41. Wei Peng and Gary Hsieh. 2012. The influence of competition, cooperation, and player relationship in a motor performance centered computer game. Computers in Human Behavior, Vol. 28, 6 (nov 2012), 2100--2106. https://doi.org/10.1016/j.chb.2012.06.014Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Babak Raji, Martin Tenpierik, and Andy van den Dobbelsteen. 2017. Early-Stage Design Considerations for the Energy-Efficiency of High-Rise Office Buildings. Sustainability, Vol. 9, 4 (apr 2017), 623. https://doi.org/10.3390/su9040623Google ScholarGoogle Scholar
  43. Shalini T. Reddy, Matthew H. Zegarek, H. Barrett Fromme, Michael S. Ryan, Sarah-Anne Schumann, and Ilene B. Harris. 2015. Barriers and Facilitators to Effective Feedback: A Qualitative Analysis of Data From Multispecialty Resident Focus Groups. Journal of Graduate Medical Education, Vol. 7, 2 (jun 2015), 214--219. https://doi.org/10.4300/JGME-D-14-00461.1Google ScholarGoogle Scholar
  44. Kelly A Rocca. 2010. Student Participation in the College Classroom: An Extended Multidisciplinary Literature Review. Communication Education, Vol. 59, 2 (apr 2010), 185--213. https://doi.org/10.1080/03634520903505936Google ScholarGoogle ScholarCross RefCross Ref
  45. D. Royce Sadler. 1989. Formative assessment and the design of instructional systems. Instructional Science, Vol. 18, 2 (1989), 119--144. https://doi.org/10.1007/BF00117714Google ScholarGoogle Scholar
  46. Jessica Schroeder, Ravi Karkar, Natalia Murinova, James Fogarty, and Sean A. Munson. 2019. Examining Opportunities for Goal-Directed Self-Tracking to Support Chronic Condition Management. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Vol. 3, 4 (dec 2019), 1--26. https://doi.org/10.1145/3369809Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Manya Sleeper, Alessandro Acquisti, Lorrie Faith Cranor, Patrick Gage Kelley, Sean A. Munson, and Norman Sadeh. 2015. I Would Like To..., I Shouldn't..., I Wish I.... In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing - CSCW '15. ACM Press, New York, New York, USA, 1058--1069. https://doi.org/10.1145/2675133.2675193Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Henry L. Tosi, Edwin A. Locke, and Gary P. Latham. 1991. A Theory of Goal Setting and Task Performance. The Academy of Management Review, Vol. 16, 2 (apr 1991), 480. https://doi.org/10.2307/258875Google ScholarGoogle ScholarCross RefCross Ref
  49. Yaacov Trope and Efrat Neter. 1994. Reconciling competing motives in self-evaluation: The role of self-control in feedback seeking. Journal of Personality and Social Psychology, Vol. 66, 4 (1994), 646--657. https://doi.org/10.1037/0022-3514.66.4.646Google ScholarGoogle ScholarCross RefCross Ref
  50. Jeffrey B. Vancouver and Elizabeth Wolfe Morrison. 1995. Feedback Inquiry: The Effect of Source Attributes and Individual Differences. Organizational Behavior and Human Decision Processes, Vol. 62, 3 (jun 1995), 276--285. https://doi.org/10.1006/obhd.1995.1050Google ScholarGoogle Scholar
  51. Don VandeWalle. 2003. A goal orientation model of feedback-seeking behavior. Human Resource Management Review, Vol. 13, 4 (dec 2003), 581--604. https://doi.org/10.1016/j.hrmr.2003.11.004Google ScholarGoogle Scholar
  52. Vimal Viswanathan and Julie Linsey. 2011. Design Fixation in Physical Modeling: An Investigation on the Role of Sunk Cost. In Volume 9: 23rd International Conference on Design Theory and Methodology; 16th Design for Manufacturing and the Life Cycle Conference, Vol. 9. ASMEDC, 119--130. https://doi.org/10.1115/DETC2011-47862Google ScholarGoogle Scholar
  53. Vimal K. Viswanathan and Julie S. Linsey. 2013. Role of Sunk Cost in Engineering Idea Generation: An Experimental Investigation. Journal of Mechanical Design, Vol. 135, 12 (dec 2013), 1--12. https://doi.org/10.1115/1.4025290Google ScholarGoogle ScholarCross RefCross Ref
  54. Helen Wauck, Yu-Chun Yen, Wai-Tat Fu, Elizabeth Gerber, Steven P Dow, and Brian P Bailey. [n.d.]. From in the Class or in the Wild? Peers Provide Better Design Feedback Than External Crowds. ([n.,d.]). https://doi.org/10.1145/3025453.3025477Google ScholarGoogle Scholar
  55. Jane R. Williams, Corey E. Miller, Lisa A. Steelman, and Paul E. Levy. 1999. Increasing feedback seeking in public contexts: It takes two (or more) to tango. Journal of Applied Psychology, Vol. 84, 6 (1999), 969--976. https://doi.org/10.1037/0021-9010.84.6.969Google ScholarGoogle ScholarCross RefCross Ref
  56. Y. Wayne Wu and Brian P. Bailey. 2017. Bitter Sweet or Sweet Bitter?. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition. ACM, New York, NY, USA, 137--147. https://doi.org/10.1145/3059454.3059458Google ScholarGoogle Scholar
  57. Y. Wayne Wu and Brian P. Bailey. 2018. Soften the Pain, Increase the Gain. Proceedings of the ACM on Human-Computer Interaction, Vol. 2, CSCW (nov 2018), 1--20. https://doi.org/10.1145/3274455Google ScholarGoogle Scholar
  58. Anbang Xu, Shih-Wen Huang, and Brian Bailey. 2014. Voyant. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing - CSCW '14. ACM Press, New York, New York, USA, 1433--1444. https://doi.org/10.1145/2531602.2531604Google ScholarGoogle Scholar
  59. Yu-chun Grace Yen, Steven P Dow, Elizabeth Gerber, and Brian P Bailey. 2016. Social Network, Web Forum, or Task Market?. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems - DIS '16. ACM Press, New York, New York, USA, 773--784. https://doi.org/10.1145/2901790.2901820Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. Yu-Chun Grace Yen, Steven P. Dow, Elizabeth Gerber, and Brian P. Bailey. 2017. Listen to Others, Listen to Yourself. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition. ACM, New York, NY, USA, 158--170. https://doi.org/10.1145/3059454.3059468Google ScholarGoogle Scholar
  61. Yu-chun Grace Yen, Joy O Kim, and Brian P Bailey. 2020. Decipher: An Interactive Visualization Tool for Interpreting Unstructured Design Feedback from Multiple Providers. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1--13. https://doi.org/10.1145/3313831.3376380Google ScholarGoogle ScholarDigital LibraryDigital Library
  62. Alvin Yuan, Kurt Luther, Markus Krause, Sophie Isabel Vennix, Steven P Dow, and Bjö rn Hartmann. 2016. Almost an Expert: The Effects of Rubrics and Expertise on Perceived Value of Crowdsourced Design Critiques. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing - CSCW '16. ACM Press, New York, New York, USA, 1003--1015. https://doi.org/10.1145/2818048.2819953Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Barry J Zimmerman. 1990. Self-Regulated Learning and Academic Achievement: An Overview. Educational Psychologist, Vol. 25, 1 (jan 1990), 3--17. https://doi.org/10.1207/s15326985ep2501_2 arxiv: arXiv:1011.1669v3Google ScholarGoogle ScholarCross RefCross Ref
  64. Barry J. Zimmerman and Adam R. Moylan. 2009. Self-Regulation: where metacognition and motivation intersect. In Handbook of Metacognition in Education, Douglas J. Hacker, John Dunlosky, and Arthur C Graesser (Eds.). Routledge, New York, New York, USA, Chapter 16, 299--315.Google ScholarGoogle Scholar

Index Terms

  1. Plan Early, Revise More: Effects of Goal Setting and Perceived Role of the Feedback Provider on Feedback Seeking Behavior

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader
        About Cookies On This Site

        We use cookies to ensure that we give you the best experience on our website.

        Learn more

        Got it!