OpenAI Realtime Meeting Assistant
https://github.com/openai/openai-realtime-meeting-assistant- Category
- AI Agents
- Rank
- No. 1396Tools index
Previous survey · No. 1401 ·
- Listed in
- #5 Capture meetings
- Pricing
- Open Source
- Type
- AGENT
- Builder
- openai
- GitHub
- 267 stars
- Date
About
Example AI meeting assistant using the OpenAI Realtime API — listens to a call and updates a Kanban board live.
What it does
A self-hosted standup room where several browser participants share audio, video, and a task board. The server combines their speech, sends it to a realtime model, converts recognized work updates into structured card actions, and broadcasts the resulting board state to everyone.
Why it's ranked here
This is a strong reference implementation for voice-driven collaborative software. It demonstrates the difficult plumbing, including WebRTC signaling, audio mixing, Opus conversion, model tool use, and synchronized browser updates. Its demo status and open room security keep it from being a ready production service.
What's good
The assistant supports a useful action set: creating, moving, editing, tagging, and deleting cards. It can ignore conversational filler instead of forcing every utterance into a mutation. Multiple participants receive shared updates, while visible status messages, card animations, comment previews, and completion confetti make model actions easy to notice.
Tradeoffs
There is no built-in authentication or access control, and the WebSocket origin check accepts every origin. Anyone who can reach the application can enter the room. Echo and background sound may be interpreted as task changes. A missing API key or failed model connection leaves the room usable but disables assistant updates.
How to use it well
Use it as a working reference for engineers prototyping voice-controlled shared applications, especially standups with a small Kanban workflow. Run it in a controlled environment, use headphones, and adapt the model instructions and exposed actions. It does not cover production identity, authorization, access isolation, or broader project management needs.
Technical notes+
main.go serves index.html, handles WebSocket signaling, fans WebRTC tracks among peers, and periodically requests video keyframes. audio_mixer.go decodes participant Opus tracks into 48 kHz stereo PCM, averages ready sources every 20 milliseconds, and forwards the mix to registered sinks. opus_decoder.go and opus_encoder.go bind libopus through cgo and pkg-config. kanban.go creates a separate Pion WebRTC peer, posts SDP and session configuration to the Realtime calls API, sends mixed Opus audio, receives events through the oai-events data channel, and applies function-call results to synchronized card state. Configuration includes OPENAI_API_KEY, OPENAI_REALTIME_MODEL, PION_NAT1TO1_IP, and the -addr flag.
Observed
- License
- MIT License
- Primary language
- Go
- Install surface
- Go module requiring Go 1.24 or newer, plus libopus available through pkg-config
- Interface
- Self-hosted browser application with HTTP, WebSocket, WebRTC, and OpenAI Realtime API integration
- Platform requirements
- Requires a system with Go, cgo support, libopus, pkg-config, and browser camera and microphone access
- Frontend structure
- The browser interface is contained in a single HTML document with embedded styling and client behavior
Read from README.md, go.mod, main.go, kanban.go, audio_mixer.go, opus_decoder.go, opus_encoder.go, LICENSE, index.html.
What it can do
Listen to meeting audio in real-time
Live audio stream from meeting or call → Processed audio data for analysis
Transcribe spoken conversations
Meeting audio → Text transcription of speech
Extract action items from meeting discussions
Meeting transcription and audio → Identified tasks and action items
Update Kanban board automatically
Extracted action items and meeting context → New cards or updates on Kanban board
Categorize tasks by priority or type
Meeting-derived action items → Organized tasks in appropriate board columns
Track meeting progress live
Ongoing meeting audio and discussion → Real-time updates to project management board
Tags
Tech Stack
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.