Segmentation and Alignment of Speech and Sketching in a Design Environment

Title: en_US Segmentation and Alignment of Speech and Sketching in a Design Environment
Creator: en_US Adler, Aaron D.
Date: 2004-10-20T20:31:48Z
Date Available: 2004-10-20T20:31:48Z
Date Issued: en_US 2003-02-01
Identifier: en_US AITR-2003-004
uri: http://hdl.handle.net/1721.1/7103
Abstract: en_US Sketches are commonly used in the early stages of design. Our previous system allows users to sketch mechanical systems that the computer interprets. However, some parts of the mechanical system might be too hard or too complicated to express in the sketch. Adding speech recognition to create a multimodal system would move us toward our goal of creating a more natural user interface. This thesis examines the relationship between the verbal and sketch input, particularly how to segment and align the two inputs. Toward this end, subjects were recorded while they sketched and talked. These recordings were transcribed, and a set of rules to perform segmentation and alignment was created. These rules represent the knowledge that the computer needs to perform segmentation and alignment. The rules successfully interpreted the 24 data sets that they were given.
Extent: en_US 193 p.; 34430522 bytes; 46149955 bytes
Format: application/postscript; application/pdf
Language: en_US
Relation: en_US AITR-2003-004
Subject: en_US AI; en_US sketch; en_US design; en_US multimodal; en_US disambiguation; en_US segmentation; en_US alignment