As part of the individual project for the Intelligent Interactive Products course (DBB220) at TU/e, I have developed a Human Interaction Device (HID) that interprets hand movements and finger positions, allowing the user to play guitar chords as if it they were a real guitar.
This uses the Ultrakill board that I have developed, alongside two flex sensors and a MPU6050 inertial measurement unit. It connects via a Bluetooth virtual serial port to a computer, where a Processing script powered by Weka4P interprets the measurements and classifies the different chords being played.
Do note that the OLED screen flickers due to the shutter speed of my camera. In person, it looks responsive and informative. It had to choose between this or a blurry image. Furthermore, it seems that the STM 50mm f1.8 lens that I have used is not that silent during autofocusing. Whoops.
