Ondéon
Ondéon uses Apple Vision hand tracking to control pitch and volume. Its virtual MIDI output can play instruments in Logic, MainStage, Ableton, or another music application.
- Role
- Product and engineering
- Format
- Native macOS application
Track the hand, send MIDI
The camera tracks hand position and maps it to pitch, volume, tuning, and MIDI CC controls. A virtual MIDI port sends the result to a separate instrument.
Current prototype
Hand tracking, MIDI output, tuners, and control mappings are working in the native app. I am still refining how the instrument should feel to play.