Creative coding · Case study

Robotic hands that play any MIDI file on a piano in real time

An open-source three.js piece built with Opus 5.5: two robotic hands play any MIDI file on an upright piano under a cinematic camera. Fingering follows Parncutt's research, inverse kinematics positions the joints, and animation is deterministic so a song can be scrubbed. Post-processing adds per-pixel motion blur, depth of field, god rays, bloom and colour grading, and Claude also generated the hands and piano in Blender. Live demo linked.

Read at source
Back to the reading room