The Wearable Orchestra: Music Through Gesture

The Mechanical Musical Arm is a visionary project that explores the intersection of human kinetics and electronic sound. By turning the wearer's fingers into "keys" of a digital instrument, this device allows for the performance of complex melodies using a miniaturized interface. Drawing inspiration from traditional Indian musical scales (Sur), the arm provides a platform for both artistic expression and wearable haptic research.

Binary Finger Logic: 3 Fingers, 8 States

The most innovative aspect of the project is its control scheme. Instead of having one button per note, it uses Binary Combinatorial Logic:

• 7 Surs + 1 Stop: By detecting the state of just 3 fingers on the hand, the controller can identify 8 unique combinations ($2^3=8$). Each combination is mapped to one of the 7 classic notes (Sa, Re, Ga, Ma, Pa, Dha, Ni).
• Efficient Fingering: This allows a musician to play a full octave while keeping their hand in a relaxed, compact position, mimicking the efficiency of a woodwind instrument like a flute or clarinet but in a wearable format.

Our project focuses on an arm which can do different things with the use of only 3 fingers. These 3 fingers can control up to 8 functions (7 different functions + 1 to turn it off), by making different combinations.

In the presented model we have taken an example of a music instrument. As we know there are basically 7 sur, so we have assigned a combination to a tone of music. When the user wears and initiates that combination, the frequency assigned to each sur is played.

The Architecture: Dual Processing and Data Logging

To handle the complexity of real-time audio generation and data storage, the project utilizes a sophisticated hardware stack:

1. Dual Arduino Setup: Two Arduino Uno boards work in tandem—one focused on gesture recognition and tone generation, while the other manages peripheral communications.
2. Time-Stamped Compositions: The inclusion of an RTC (Real Time Clock) allows every note performed to be accurately time-stamped.
3. SD Record & Play: Using a Pmod SD module, the arm can record a sequence of played notes into a text file or audio log. If you create a unique melody, you can save its "characteristics" and replay it later, making the arm a portable recording studio.

Also when connected with RTC (Real time clock) and SD card module which can store the tune if you like a tone you made and want to know it’s characteristics.

Prototyping and Wearable Design

The project utilizes the RobotGeek Sensor Shield to simplify the connection between the sensors and the Arduinos, ensuring high-reliability signal transfer even when the performer is moving. Housed on a custom-fitted substrate that attaches to the forearm, this device points toward a future where musical instruments are no longer heavy objects we carry, but lightweight extensions of our own bodies.