SBIR Phase I: Synchrony Loop Networks: a groundbreaking neuromorphic approach for live, unsupervised, one-shot source separation and diarization in complex auditory scenes

The broader impact/commercial potential of this Small Business Innovation Research (SBIR) Phase I project is to develop a new technology with smart filtering functionality that separates each individual sound and voice in the acoustic field, and gives individuals easy control over which sound sources to attend to. The key innovation brought by this project is a new kind of algorithm that learns sounds and voices on its own within seconds of encountering them. This Small Business Innovation Research (SBIR) Phase I project brings to bear a new artificial learning technique designed for live, unsupervised, zero-shot sound source identification and separation. The two core innovations of this approach are a novel neural learning rule that combines elements of local Hebbian learning with additional features that promote global network coordination; and a heterogeneous network architecture with specialized layers for acoustic feature extraction, short-term auditory scene memory, and long-term sound characterization. These advancements enable rapid and complex real-time sensory learning, a core feature of biological systems which has been an intractable problem for artificial intelligence (AI) that hampers AI usefulness for edge device applications. The Phase I project focuses on expanding and refining the network’s speech characterization and tracking layers to handle multi-speaker situations, as well as developing prototype user controls for selecting sounds and voices to filter or follow. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.