Richard A. Bolt
ABSTRACT
Recent technological advances in connected-speech recognition and position sensing in space have encouraged the notion that voice and gesture inputs at the graphics interface can converge to provide a concerted, natural user modality.
The work described herein involves the user commanding simple shapes about a large-screen graphics display surface. Because voice can be augmented with simultaneous pointing, the free usage of pronouns becomes possible, with a corresponding gain in naturalness and economy of expression. Conversely, gesture aided by voice gains precision in its power to reference.
- 1.Negroponte, N The Media Room. Report for ONR and DARPA. MIT, Architecture Machine Group, Cambridge, MA, December 1978.Google Scholar
- 2.Bolt, R.A. Spatial Data-Management. DARPA Report. MIT, Architecture Machine Group, Cambridge, MA, March 1979.Google Scholar
- 3.Reddy, D.R. Speech recognition by machine: a review. Proceeding of the IEEE, 64, 4 (April 1976), 501-531.Google ScholarCross Ref
- 4.Robinson, A.L. More people are talking to computers as speech recognition enters the real world. (Research News) (First of two articles) Science, 203, (16 February 1979), 634-638.Google Scholar
- 5.Sondeheimer, N.K. Spatial reference and natural-language machine control. International Journal of Man-Machine Studies, 8, (1976), 329-336.Google ScholarCross Ref
- 6.Winston, P. Learning structural descriptions from examples. MIT Project MAC, TR-76, 1970. Google ScholarDigital Library
- 7.Olson, D.R. Language and thought: Aspects of a cognitive theory of semantics. Psychological Review, 77, (1970), 257-273.Google ScholarCross Ref
Index Terms
“Put-that-there”: Voice and gesture at the graphics interface
Recommendations
“Put-that-there”: Voice and gesture at the graphics interface
Recent technological advances in connected-speech recognition and position sensing in space have encouraged the notion that voice and gesture inputs at the graphics interface can converge to provide a concerted, natural user modality.
The work described ...
“Put-that-there”: voice and gesture at the graphics interface
Readings in intelligent user interfacesOn the feasibility of voice input to an on-line computer processing system
An on-line digital computer processing system is considered in which an ordinary telephone is the complete terminal device, input to the computer being provided as a sequence of spoken words, and output to the user being audio responses from the ...
Comments