Visualize sound using Fast Fourier Transform(FFT), then calculate Loudness
Posts by Norihito Yuki:
We used a pulse sensor Julie bought at Maker Fair. Pulse sensor consists of a led and a photocell as a detector. You can see how a pulse sensor works from this site.
We applied these sample codes. We downloaded “P_PulseSensor_06.zip” and PulseSensorAmpd_Arduino_01.zip .
I made this animation inspired by a piano piece “Hibari” played by Ryuichi Sakamoto. In the music, you hear the repetition of a small phrase and subtle use of dissonance and that make the piece distinguished. In this animation, I adopted pendulum waves as an analogy for the music. Harmonic oscillations in the animation correspond to the harmony in the music and the discords of the waves correlate to the dissonance in the sound.
The note above shows how I calculated the angles of each pendulum. I also referred to the site below to determine the lengths of the strings.