Soundmap
soundmap.darebuild.com- Category
- Other
- Type
- APP
- Interfaces
- Web
- Date
About
Soundmap overlays real-time sound source localization onto a live camera feed, letting users visually see where noises are coming from. It supports multiple input methods including a tracked iPhone plus webcam, motion-based microphone estimation, stereo microphone direction, and full ambisonic B-format (AmbiX/FuMa) capture, with calibration settings for mic spacing, camera field of view, and rotation offsets.
What it can do
Overlay real-time sound source localization onto a live camera feed
Audio input and camera feed → Visual overlay showing sound source location
Track sound direction using a tracked iPhone paired with a webcam
iPhone tracking data and webcam feed → Sound source position on camera feed
Estimate sound source location using motion-based microphone tracking
Microphone motion data → Estimated sound source direction
Determine sound direction using a stereo microphone
Stereo microphone audio → Sound direction data
Capture full ambisonic sound field in B-format
Ambisonic microphone audio (AmbiX/FuMa) → B-format ambisonic capture
Calibrate microphone spacing settings
Mic spacing value → Calibrated localization accuracy
Calibrate camera field of view settings
Camera FOV value → Adjusted overlay alignment
Calibrate rotation offset settings
Rotation offset value → Adjusted sound-to-camera alignment
Tags
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.