Kid mode πŸ§’

This page is πŸ€–πŸŽ§ The Note-Catching Robot. It is one of the projects Brandon built and put online. The grown-up details are below, tap Grown-up mode to read them the normal way.

πŸ€–πŸŽ§ The Note-Catching Robot

I teach a computer to listen to a song and write down every note it hears.

22songs listened to
131note-sheets written
106,456notes caught
1tarot video made

What am I doing? 🎡

Imagine you hear your favorite song. Now imagine writing down every single note so a robot could play it back. That is hard for a person, but a computer can do it if you teach it how. That is my whole job right now.

1
Split the song into pieces. First the song gets cut into separate tracks, like un-mixing a smoothie back into strawberries, bananas, and milk. One track is just drums. One is just the bass. One is just the singing. One is the guitar.
2
Listen to each piece super closely. For the singing and the bass, a tool called crepe follows the voice up and down and figures out which note it is, hundreds of times every second. For the guitar and piano, a tool called basic-pitch does the same thing.
3
Find the drums. The computer looks for every "hit" in the drum track and decides: was that a boom (kick drum), a tap (snare), or a tick (hi-hat)? It does this by checking if the sound was low, medium, or high.
4
Write it all down. Every note becomes a little message a computer can read, called MIDI. Now anyone can open it in music software and see or replay the exact notes. The robot also measures how fast the song is (beats per minute) and what musical "key" it is in.

Why? Once songs are written down this way, I can study how great musicians built them, make new music in the same style, and turn them into books and lessons.

πŸ”Š Hear what the robot wrote

These short clips are made only from the notes the robot caught. They sound like simple beeps on purpose, that is the robot "reading back" the music with no fancy instruments. Press play!

🎀 Singing from β€œPet”

This is the tune the singer sang. The robot caught every note and wrote it down.

🎸 Bass from β€œPet”

The low, rumbly notes that hold the song together.

🎀 Singing from β€œ3 Libras”

A different song, a different melody. Same robot, listening close.

🎸 Bass from β€œThe Outsider”

Hear how the bass walks up and down? The robot heard it too.

πŸ₯ Drums from β€œThe Noose”

Boom = kick drum. Tap = snare. Tick = hi-hat. The robot sorted them apart.

🎀 Singing from Beach House β€œThrough Me”

A dreamy, floaty song. The robot still caught the melody.

🎸 Bass from β€œGravity”

The last song on the album. The robot finished this one a minute ago.

🎬 Bonus project: the talking tarot video

I am also building videos where a computer voice reads a tarot card "reading" while cards and chalk notes appear on a chalkboard. This one is about 18 minutes long. The voice is a clone built from a real voice, and a robot drew the chalkboard.

This is a work-in-progress draft. A check found 6 spots (out of 315) where the computer voice rambles or garbles, and those 6 are being re-recorded. For fun only. Not real fortune-telling.

πŸ“‚ Every note-sheet I have made (click to download)

Each song is split into its parts. Click any part to download the MIDI note-sheet for it.

A Perfect Circle 19 songs

3 Libras

⏱ 144 beats/min🎡 key of EπŸ“„ 6 parts

A Stranger

⏱ 112 beats/min🎡 key of F#πŸ“„ 6 parts

Blue

⏱ 117 beats/min🎡 key of EπŸ“„ 6 parts

BreΓ±a

⏱ 123 beats/min🎡 key of A#πŸ“„ 6 parts

Crimes

⏱ 117 beats/min🎡 key of EπŸ“„ 6 parts

Gravity

⏱ 123 beats/min🎡 key of C#πŸ“„ 6 parts

Lullaby

⏱ 31 beats/min🎡 key of C#πŸ“„ 6 parts

The Nurse Who Loved Me

⏱ 129 beats/min🎡 key of C#πŸ“„ 6 parts

Orestes

⏱ 148 beats/min🎡 key of β€”πŸ“„ 6 parts

Over

⏱ 152 beats/min🎡 key of C#πŸ“„ 6 parts

Pet

⏱ 136 beats/min🎡 key of D#πŸ“„ 6 parts

RenholdΓ«r

⏱ 89 beats/min🎡 key of AπŸ“„ 6 parts

Sleeping Beauty

⏱ 117 beats/min🎡 key of AbπŸ“„ 6 parts

The Noose

⏱ 129 beats/min🎡 key of D#πŸ“„ 6 parts

The Outsider

⏱ 112 beats/min🎡 key of C#πŸ“„ 6 parts

Thinking of You

⏱ 152 beats/min🎡 key of EπŸ“„ 6 parts

Thomas

⏱ 85 beats/min🎡 key of C#πŸ“„ 6 parts

Vanishing

⏱ 117 beats/min🎡 key of G#πŸ“„ 6 parts

Weak and Powerless

⏱ 108 beats/min🎡 key of β€”πŸ“„ 6 parts

Beach House 1 songs

Through Me

⏱ 136 beats/min🎡 key of GπŸ“„ 6 parts

Smashing Pumpkins 1 songs

Cherub Rock

⏱ 117 beats/min🎡 key of β€”πŸ“„ 5 parts

The Life and Times 1 songs

Tragic Boogie

⏱ 112 beats/min🎡 key of β€”πŸ“„ 6 parts