Overview
Project Overview¶
CHAIS: Crossmodal Human-AI Collaboration for Selective Hearing Assistance
[!note] Project Proposal CHAIS.pdf
The CHAIS project is about developing bio-inspired crossmodal Speech Enhancement algorithms to address the Cocktail Party Problem. This should be showcased in prototypical smart Glasses that support humans during selective hearing tasks. The speech enhancement should utilize mechanisms informed by cognitive speech processing in humans to (1) potentially improve real-time speech enhancement and (2) gain further insights into how these mechanisms improve speech comprehension.
The project is a cooperation between three Project Partners:
| Partner | Focus |
|---|---|
| Human-Computer Interaction | Develop human-usable assistive glasses, based on user needs and feedback. |
| Signal Processing | Improve AI-based real-time speech enhancement for hearing assistance in humans. |
| Neuronal Information Processing & Computational Neuroscience | Apply and gain insights into cognitive mechanisms in speech processing. |
Table of Contents¶
Knowledge¶
- Cocktail Party Problem Problem definition, psychoacoustic basis (PASO), and the phase-locking mechanism underlying binaural unmasking.
Methodology¶
- Assisted Listening Technology Candidate glasses hardware
- Existing Research The existing commercial/academic technology landscape,
- Research Plan Phased research plan, CPP-Testbed VR application (incl. dataset and user study plans
Orga¶
- Project Orga Project partners' expectations, available resources, and contact persons.
- Reading List Relevant papers for research projects that have not been reviewed yet.
Roadmap¶
Key Milestones¶
| Month | Milestone |
|---|---|
| 6 | Requirement Analysis (Documentation and Verification) |
| 12 | First models of neural architectures for speech processing (Oscillatory and Topology) |
| 12 | First evaluations of bio-inspired neural networks |
| 14 | Companion App / VR Testbed |
| 18 | Early demonstrator of Smart [[Research Glasses|Glasses]] |
| 24 | Neural architectures are integrated in crossmodal speech signal processing |
| 30 | Summative evaluation of Glasses |
| 36 | Final demonstrator and project finalization |
The detailed phased research plan (Phase 1–3) lives in Research Plan.