jewels2001 / coglog Goto Github PK

A brain-to-data platform by .

For natHACKS 2023 focused on brain-to-text and speech-to-text capabilities.

/// Intro • How to Use • Future • Contributors • Links • Resources

Brain-Computer Interface (BCI) equipment allows people to connect with their environment and other people with greater awareness and capability. CogLog has produced a SAAS called Cerecode that leverages BCI technology to convert brain wave readings into spoken speech. This gives people who have limited or decreasing speech capabilities a way to communicate more clearly with those around them. More specifically, Cerecode utilizes models from the open-source dataset associated with "A high-performace speech neruprosthesis" which focuses on decoding phonemes from intracortical microelectrode arrays.

Client-Side:

npm install

npm run dev

Decoder Model:

• Follow instructions from speechBCI repo.

Gateway Service:

go run server.go

We can improve upon our SAAS by providing a fully functioning platform, and implementing tools such as wearables and mobile apps. This could also lead to the ability to make a natural recording of one's thoughts, such as live note-taking (during lectues or meetings) or an idea journal. We could also personalize this usecase, by providing support for multiple voices and enable real time decoding of brain data. Further, we could improve upon our decoding performace, possibly writing our own BCI decoder model fromm scratch with a larger and more robust dataset.

• Ali Amusat: Neuroscience Specialist, Graphic and UI/UX Designer
• Rozella Ricci Dagta: Graphic and UI/UX Designer, Full Stack
• Alex Hughes: Business Strategist, Frontend
• Dustin Ward: Backend, Full Stack
• Julie Wojtiw-Quo: ML Specialist, Full Stack

• Devpost
• UI Blueprint and Planning
• Slide Deck
• Video

• Dataset
• Dataset's associated codebase
• KARA One study and dataset