• Open Daily: 10am - 10pm
    Alley-side Pickup: 10am - 7pm

    3038 Hennepin Ave Minneapolis, MN
    612-822-4611

Open Daily: 10am - 10pm | Alley-side Pickup: 10am - 7pm
3038 Hennepin Ave Minneapolis, MN
612-822-4611
Multimodal Interaction with Mobile Devices: Fusing a Broad Spectrum of Modality Combinations

Multimodal Interaction with Mobile Devices: Fusing a Broad Spectrum of Modality Combinations

Paperback

Series: Dissertations in Artificial Intelligence, Book 305

Networking

Currently unavailable to order

ISBN10: 1586037129
ISBN13: 9781586037123
Publisher: Sage Publications, Inc
Published: Dec 1 2006
Pages: 276
Weight: 0.73
Height: 0.58 Width: 5.83 Depth: 8.27
Language: English

This publication presents a multimodal architecture for use in mobile scenarios such as shopping and navigation. It also analyses a wide range of feasible modality input combinations for these contexts. For this purpose, two interlinked demonstrators were designed for stand-alone use on mobile devices. Of particular importance was the design and implementation of a modality fusion module capable of combining input from a range of communication modes like speech, handwriting, and gesture. The implementation is able to account for confidence value biases arising within and between modalities and also provides a method for resolving semantically overlapped input. Tangible interaction with real-world objects and symmetric multimodality are two further themes addressed in this work. This work concludes with the results from two usability field studies that provide insight on user preference and modality intuition for different modality combinations, as well as user acceptance for anthropomorphized objects.

Also in

Networking