Proceedings of the International Conference on Auditory Display April 2 - 5, 2000 Georgia Institute of Technology Atlanta, Georgia, USA Perry R. Cook, Editor Copyright (c) 2000 by the ICAD Contributors All rights reserved. Copyright remains with the individual authors. No part of this publication can be reproduced, stored in a retrieval system, or transmitted in any form by any means, electronic, mechanical, photocopying, recording, or otherwise without the prior written permission of the individual authors. Printed in the United States of America. Production Editing: Perry R. Cook Additional ICAD information and publications can be found at http://www.icad.org Published by the International Community for Auditory Display ISBN: 0-9670904-1-5 Corporate Support ICAD 2000 gratefully acknowledges the support of: Microsoft Corporation Nippon Columbia (DENON) Georgia Center for Advanced Telecommunications Technology, Dr. Mike Cummins, CEO Georgia Institute of Technology, Dr. G. Wayne Clough, President Georgia Tech College of Architecture, Dr. Thomas Galloway, Dean Department of Music, Prof. Bucky Johnson, Department Head Conference Committee Conference Chair James Oliverio Program Chair Perry Cook Demos and Posters Contact Russell Storms Tutorials and Workshops Contact Jarrell Pair Conference Registration Carol Whitescarver, Romas Mills Georgia Tech Office of Continuing Education From the Conference Chair Welcome to ICAD 2000! We are pleased that researchers and professionals from around the world have come together here in Atlanta to share knowledge and develop common interests in the rapidly advancing field of audio. This year's conference seeks to combine both technological and research advances with creative and novel applications of audio in areas ranging from Assistive Technologies to Psychoacoustics, from Sonification to Immersive Environments. We have programmed a special concert that will introduce a number of music and audio technologies to the ICAD Community, including some exciting music interface developments. We are very pleased to have two distinguished keynote speakers; visionaries who have helped to shape not only their own primary fields of endeavor, but through their unique and multifaceted vision, have aided substantially in the growth and advancement of numerous other disciplines as well. R. Murray Schafer, internationally known as a composer, educator, environmentalist, scholar and provocateur, has had an enormous effect on several generations. In addition to a decade of teaching in the experimental Communications Centre at Simon Fraser University, Schafer founded the World Soundscape Project, documented in his book "The Tuning of the World." In this seminal writing, Schafer united the social, scientific and artistic aspects of sound and introduced the concept of acoustic ecology. Schafer was the first winner of the prestigious Glenn Gould Prize for Music and Communication as well as the Molson Award for his distinctive service. Dr. James Foley is well known in the Computer Graphics world, co-authoring three landmark books and serving in editorial capacities for the ACM Transactions on Graphics, Computers and Graphics and Presence. The Founding Director of the interdisciplinary Graphics, Visualization and Usability Center in Georgia Tech's College of Computing, Foley later joined Mitsubishi Electric as Director of MERL and became Chairman and CEO of Mitsubishi Electric Information Technology Center America in 1998. He is currently Executive Director and the State of Georgia's Yamacraw Project and Professor at the Georgia Institute of Technology. We are very fortunate to have the support and encouragement of Dr. Michael Cummins, CEO of GCATT, and his excellent staff and facilities team. Additionally the support and cooperation of the Georgia Institute of Technology, its College of Architecture and Department of Music have made it possible for the ICAD Community to gather here in Atlanta. Further thanks to the Atlanta audio community and the panelists who have agreed to share their time and expertise with ICAD. On behalf of all of us who have worked behind the scenes to forge ICAD 2000, I wish you a most empowering and enjoyable ICAD Conference experience. James Oliverio From the Program Chair It has been a distinct honor to serve as program chair for ICAD 2000. The task of collecting, distributing, and selecting papers, posters, and demos for presentation was somewhat daunting. This is partially because of the quality of the research covered by the authors who submitted abstracts. It is also because of the breadth and scope of the research areas covered under the ICAD umbrella. But the pleasure of bringing engineers, programmers, scientists, doctors, military officers, musicians, and designers together to discuss the common area of sound at the human interface makes it worthwhile indeed. I wish to thank James Oliverio, Russell Storms, Jarell Pair, and James Ballas for their help in putting together the program. I also thank the ICAD board and the sponsors of the conference. I thank the paper reviewers for rendering their honest and helpful comments on the submitted papers. Finally, I thank the ICAD community for submitting material and presentations, and for their attendance at this year's conference. Perry R. Cook About the Paper Selection Process Extended abstracts (four-six pages) of papers were submitted electronically in four categories of short paper, long paper, poster, or demonstration. All papers were reviewed by four expert reviewers (familiar with the subject area and keywords of the paper). They were asked to evaluate based on the following criteria: Is the work new and important? Is it best presented at ICAD (as opposed to another forum)? Are the relevent references cited? Is the paper well written and formatted well? Rank the paper from 1 (do not accept) to 5 (must accept). Scores were tabulated and used to determine the papers which were accepted for presentation at ICAD 2000. Final Selection Panel: Perry R. Cook, Chair James Ballas Russell Storms Jarrell Pair James Oliverio Reading/Reviewing Panel: Jim Alty Marybeth Back James Ballas Stephen Barrass Meera Blattner Stephen Brewster Dick Duda Georg Essl Hesham Fouad Steven Frysinger Greg Kramer Suresh Lodha Beth Mynatt Jarrell Pair Barbara Shinn-Cunningham Eric Somers Russell Storms George Tzanetakis Paul Vickers Beth Wenzel Proceedings of the International Conference on Auditory Display April 2-5, 2000 Georgia Institute of Technology Table of Contents Corporate Support i Conference Committee ii From the Conference Chair iii From the Program Chair iv Paper Selection Process, Committee, and Reviewers iv Paper Session 1: Audio in Assistive Technologies Teaching Orientation and Mobility Skills to Blind Children Using . . . . . . . . 1 Computer Generated 3-D Sound Environments Dean P. Inman, Ken Loge, Aaron Cram WebSound: a Generic Web Sonification Tool, and its Application to an Auditory Web Browser for Blind and Visually Impaired Users . . . . . 6 Lori Stefano Petrucci, Eric Harth, Patrick Roth, André Assimacopoulos, Thierry Pun Auditory WWW Search Tools . . . . . . . . . . . . . . . . . . . . . . . 10 Alex Ferworn, Richard Bodner, Mark H. Chignell An Auditory Display System for Aiding Interjoint Coordination . . . . . . . . . 16 Claude Ghez, Thanassis Rikakis, R. Luke Dubois, Perry R. Cook Paper Session 2: Technologies for Interfaces and Systems Contact Interaction with Integrated Audio and Haptics . . . . . . . . . . . . . 22 Derek DiFilippo, Dinesh K. Pai Robotic Measurement and Modeling of Contact Sounds . . . . . . . . . . . . 28 Joshua L. Richmond, Dinesh K. Pai An Extensible Toolkit for Creating Virtual Sonic Environments . . . . . . . . . 32 Hesham Fouad, James A. Ballas, Derek Brock Demo/Poster Session I Mobile Audio and Multiple Speaker Panning using VAS . . . . . . . . . . . . 38 Hesham Fouad, James A. Ballas, Derek Brock Tools for Auditory Display Research . . . . . . . . . . . . . . . . . . . . 39 Timothy Tucker, David Mann, Willard Wilson The NAVE: Design and Implementation of a 3D Audio System for a Low Cost Spatially Immersive Display . . . . . . . . . . . . . . . 40 Jeff Wilson, Jarrell Pair Auditory-Visual Cross-Modal Perception . . . . . . . . . . . . . . . . . . 41 Russell L. Storms Sonification of Heart Rate Variability Data . . . . . . . . . . . . . . . . . 42 Mark Ballora, Bruce Pennycook, Leon Glass Paper Session: Design, Spaces, and Games Sleuth: An Audio Experience . . . . . . . . . . . . . . . . . . . . . . . 43 Thomas M. Drewes, Elizabeth D. Mynatt, Marybeth Gandy Abstract Sound Objects to Expand the Vocabulary of Sound Design for Visual and Theatrical Media . . . . . . . . . . . 49 Eric Somers Guided by Voices: An Audio Augmented Reality System . . . . . . . . . . . . 57 Kent Lyons, Maribeth Gandy, Thad Starner Hear&There: An Augmented Reality System of Linked Audio . . . . . . . . . 63 Joseph Rozier, Karrie Karahalios, Judith Donath Visiphone: Connecting Domestic Spaces with Audio . . . . . . . . . . . . . . 68 Judith Donath, Karrie Karahalios, Fernanda Viégas Paper Session: Sonification 1 Responsive Sonification of Well-Logs . . . . . . . . . . . . . . . . . . . . 72 Stephen Barrass, Björn Zehner Principal Curve Sonification . . . . . . . . . . . . . . . . . . . . . . . 81 Thomas T. Hermann, P. Meinicke, H. Ritter Sonification of Particle Systems via deBroglie's Hypothesis . . . . . . . . . . . 87 Bob L. Sturm Paper Session: Psychoacoustics, Perceptual Models, and Ability Sonification and the Interaction of Perceptual Dimensions: Can the Data Get Lost in the Map? . . . . . . . . . . . . . . . . 93 John G. Neuhoff, Gregory Kramer, Joseph Wayand Psychophysical Scaling of Sonification Mappings . . . . . . . . . . . . . . . 99 Bruce N. Walker, Gregory Kramer, David M. Lane A Model for Interaction in Exploratory Sonification Displays . . . . . . . . . . 105 Sigurd Saue Experiments in Computer-Assisted Annotation of Audio . . . . . . . . . . . . 111 George Tzanetakis, Perry R. Cook Development of a Standard Test of Musical Ability for Participants in Auditory Interface Testing . . . . . . . . . . . . . 116 Alistair D. N. Edwards, Ben P. Challis, John C. K. Hankinson, Fiona L. Pirie Demo/Poster Session 2 Haptic Music: Non-Musicians Collaboratively Creating Music . . . . . . . . . 121 Maribeth Gandy, Andrew Quay Sleuth: An Audio Experience . . . . . . . . . . . . . . . . . . . . . . . 122 Thomas M. Drewes, Elizabeth D. Mynatt, Maribeth Gandy Spatial Auditory Displays for use within Attack Rotary Wing Aircraft . . . . . . 123 Russell D. Shilling, Tomasz Letowski, Russell Storms Subjective Testing of the Performance of Reverberation Enhancement Using Virtual Reality Environments . . . . . . . . . . . . . . . . . 124 Pontus Larsson, Mendel Kleiner, Daniel Västfjäll, Conny Olsson, Bengt-Inge Dalenbäck Music Monitor: Dynamic Data Display . . . . . . . . . . . . . . . . . . . 125 Quan T. Tran, Elizabeth Mynatt Paper Session: 3D Sound and Immersive Environments Learning Reverberation: Considerations for Spatial Auditory Displays . . . . . . 126 Barbara Shinn-Cunningham A Tool for Volumetric Visualization and Sonification of Head-Related Transfer Functions (HRTF's) . . . . . . . . . . . . . 135 Cory I. Cheng, Gregory H. Wakefield Active Sensory Tuning for Immersive Spatialized Audio . . . . . . . . . . . . 141 Paul Runkle, Anastasia Yendiki, Gregory H. Wakefield A Case Study of Auditory Navigation in Virtual Acoustic Environments . . . . . 145 Tapio Lokki, Matti Gröhn, Lauri Savioja, Tapio Takala A Software-Based System for Interactive Spatial Sound Synthesis . . . . . . . . 151 Elizabeth M. Wenzel, Joel D. Miller, Jonathan S. Abel Paper Session: Sonification 2 Musical Program Auralisation: Empirical Studies . . . . . . . . . . . . . . 157 Paul Vickers, James L. Alty Analysis and User Evaluation of a Musical-Visual System: Does music make any difference? . . . . . . . . . . . . . . . . . . 167 Suresh K. Lodha, Doug Whitmore, Marc Hansen, Eric Charp A Sonification Enhanced Navigation Tool . . . . . . . . . . . . . . . . . . 173 Andreas Dieberger Paper Session: Earcons and Auditory Icons The Effect of Earcons on Reaction Times and Error-Rates in a Dual-Task vs. a Single-Task Experiment . . . . . . . . . . . . . . . 177 Paul M.C. Lemmens, Myra P. Bussemakers, Abraham de Haan When it Sounds like a Duck and it Looks like a Dog . . . Auditory icons vs. Earcons in Multimedia Environments . . . . . . . . 184 Myra P. Bussemakers, Ab de Haan Designing Non-Speech Sounds to Support Navigation in Mobile Phone Menus . . . . . . . . . . . . . . . . . . . . . . . 190 Grégory Leplâtre, Stephen Brewster Musical Phrase-Structured Audio Communication . . . . . . . . . . . . . . 200 John C. K. Hankinson, Alistair D. N. Edwards Author Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 206 Keyword Paper Index . . . . . . . . . . . . . . . . . . . . . . . . . . . 208 i ii iii iv