skip to main content
research-article

Eliciting Sketched Expressions of Command Intentions in an IDE

Published:04 November 2020Publication History
Skip Abstract Section

Abstract

Software engineers routinely use sketches (informal, ad-hoc drawings) to visualize and communicate complex ideas for colleagues or themselves. We hypothesize that sketching could also be used as a novel interaction modality in integrated software development environments (IDEs), allowing developers to express desired source code manipulations by sketching right on top of the IDE, rather than remembering keyboard shortcuts or using a mouse to navigate menus and dialogs. For an initial assessment of the viability of this idea, we conducted an elicitation study that prompted software developers to express a number of common IDE commands through sketches. For many of our task prompts, we observed considerable agreement in how developers would express the respective commands through sketches, suggesting that further research on a more formal sketch-based visual command language for IDEs would be worthwhile.

References

  1. Robin Andersson, Jonas Berglund, Aykut Coskun, Morten Fjeld, and Mohammad Obaid. 2017. Defining Gestural Interactions for Large Vertical Touch Displays. In Human-Computer Interaction - INTERACT 2017 - 16th IFIP TC 13 International Conference, Mumbai, India, September 25--29, 2017, Proceedings, Part I (Lecture Notes in Computer Science, Vol. 10513), Regina Bernhaupt, Girish Dalvi, Anirudha Joshi, Devanuj K. Balkrishan, Jacki O'Neill, and Marco Winckler (Eds.). Springer, 36--55. https://doi.org/10.1007/978--3--319--67744--6_3Google ScholarGoogle Scholar
  2. Caroline Appert and Shumin Zhai. 2009. Using Strokes As Command Shortcuts: Cognitive Benefits and Toolkit Support. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI '09). ACM, New York, NY, USA, 2289--2298. https://doi.org/10.1145/1518701.1519052Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Uday Athavankar. 1997. Mental Imagery as a Design Tool. Cybernetics and Systems, Vol. 28, 1 (1997), 25--42. https://doi.org/10.1080/019697297126236 https://doi.org/10.1561/1100000012Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Eliciting Sketched Expressions of Command Intentions in an IDE

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in

            Full Access

            • Article Metrics

              • Downloads (Last 12 months)29
              • Downloads (Last 6 weeks)3

              Other Metrics

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader
            About Cookies On This Site

            We use cookies to ensure that we give you the best experience on our website.

            Learn more

            Got it!