Skip to content

Glasses

Overview on auditive assistive glasses for solving Cocktail Party Problem.

Considerations

Glasses for Development

Potentially suited glasses for development are… - Meta Project Aria (optimal candidate?) - Magic Leap - Zinn Labs DK1 Evaluation Kit (doesn't seem currently available) - Pupil Labs Neon (no speakers) - BrillianLabs Halo (no eye tracking) - Tobii Pro Glasses (single mic, no speakers) - Apple Vision Pro (requires Apple ecosystem) - Hololense (eye tracking?) - Quest Pro (only "see-through" mode, but probably easiest to develop) - Meta Ray-Ban (limited access through Meta account, latency due to Bluetooth streaming)

Perception

  • 6dB emphasize on focused speaker
    • Perceived halving of distance to speaker
    • Question: Emphasize via additive interference or resynthesis?
  • Real-time requirement
    • Look-ahead techniques (~5ms?)
  • Delay on switching focus?
    • Inertia to steering vector
  • Attenuation of real speaker/other speakers?
  • Increase speech brightness for better intelligibility (see #Meta Ray-Ban Glasses)

Interaction

  • How to control intensity of speaker enhancement
  • How to activate and deactivate
    • automatic depending on environment?