Simulating cognitive feedback in the context of binaural scene analysis

Dynamic auditory scene analysis (DASA) requires decisions on a cognitive level, for example, when assigning meaning to scene elements and/or interpreting scenes to induce appropriate actions. To this end, feedback from the cognitive level to the auditory-signal processing level has to be considered. In our talk, a software system is described to be used to develop and test actions of robots in search-and-rescue (SAR) scenarios. In these scenarios a victim in a (moderately) complex environment has to be identified and localized. The actions are predominantly based on binaural cues, derived from the ear signals of a head-and-torso simulator (dummy head) that can actively move about in the scene to be explored. Data that cannot yet be acquired from the auralized scenario at the current state of development of our system, are emulated to enable demonstration of system functionality. Further, visual cues may be employed for assistance if necessary, since the virtual dummy head is equipped with a stereo camera....