µuSE (Multidimensional, User-Oriented Synthetic Environment): a Functionality-based, Human Computer Interface

Abstract

The Multidimensional User-oriented Synthetic Environment, µuSE, is an open-ended software shell that provides a new approach to interacting with computer-based information. By using a real-time, device-independent software design and incorporating both cognitive and experiential models of human perception, µuSE greatly enhances a person's ability to examine, interact with, and understand relationships in complex information space. A µuSE shell may be wrapped around data, models, simulations or even complete programs. Using a new design approach, based on human functionality, it provides tools for the presentation, exploration, navigation, manipulation, and examination of information. Users experience a highly interactive environment, capable of dynamically mapping information into visual, auditory or kinesthetic representations. By eliminating the necessity for application programs to directly interact with devices, and by providing standard functional channels for user communication, the software environment significantly reduces and simplifies application code development. puSE also permits both multiprocessor operations and distributed network-based, heterogeneously shared environments. The system currently supports flat screen, stereo, and VR operation (with full head-tracking), voice recognition, sound synthesis, data sonification, and a variety of commercial interactive devices.