📈 GH Trending Explorer 🎲 Surprise me

← all repos

DamRsn / NeuralNote

git clone https://github.com/DamRsn/NeuralNote.git v2.1.0 · 7d ago 🔥 on GitHub Trending today

Audio Plugin for Audio to MIDI transcription using deep learning.

—
stars, 24h
+145
stars, 7 days · #367
—
stars, 30 days
3.3k
★ total · +5% this week
236
forks · 31 open issues

Star history starts 2026-10-20; the chart appears after the second daily snapshot.

LanguageC++
LicenseApache-2.0
Created2023-03-03 (3y ago)
Last push2d ago
Watchers63
OwnerUser

Seen on GitHub Trending

  • 2026-10-20 — #4 weekly in c++ · +145 ★

GitHub topics

Links

README excerpt
# NeuralNote 
NeuralNote is the audio plugin that brings **state-of-the-art audio-to-MIDI transcription** into your favorite Digital
Audio Workstation. See the website.
> [!NOTE]
> 🎉 **NeuralNote v2 is out!** Download it from the website or the releases page.
>
> Testing so far covers only a few machines and GPUs. Whether something breaks or works great on your hardware,
> please tell us in GitHub issues (see Hardware).
## What's new in v2
- **A new, much more capable transcription model.** v2 replaces Spotify's Basic Pitch with
 MuScriptor, from Kyutai and Mirelo
 (paper, blog post,
 checkpoints). It is a transformer with 103M to 1.4B parameters, compared with
 fewer than 17K for Basic Pitch.
- **Multi-instrument transcription.** Transcribe full mixes, not just one instrument at a time, with notes
 grouped by instrument.
- **A built-in multi-instrument synth.** Listen to every transcribed instrument, with per-instrument gain, mute and
 solo.
- **A new, modern UI.**
- **Still fully local.** Transcription runs on your machine, on the GPU or the CPU, and your audio never leaves it.
 NeuralNote only goes online to download models and to check for updates.
## Install
Download the latest release for your platform from the website or 
releases page.
- **macOS:** `NeuralNote_Installer_Mac_arm64.pkg` for Apple Silicon, `NeuralNote_Installer_Mac_x64.pkg` for Intel Macs.
 Both install the Standalone app, VST3 and AU, and are signed and notarized.
- **Windows (x64):** `NeuralNote_Installer_Windows_x64.exe` installs the Standalone app and VST3. It is not code signed,
 so Windows may warn you before running it for the first time.
- **Linux:** prebuilt binaries are coming soon. In the meantime, you can build from source.
The transcription model is not included. Download it from within NeuralNote the first time you open it (see
Models and performance).
## Usage
NeuralNote is a simple AudioFX plugin (VST®3/AU/Standalone app) that you apply to the track you want to transcribe.
- Gather some audio:
 - Click record. This works both when recording live and when playing the track in your DAW.
 - Or drop an audio file on the plugin (.wav, .aiff, .flac, .mp3 and .ogg (vorbis) are supported).
- Select the instruments to transcribe in the left panel, or select `Automatic` to let the model detect them.
 - Transcriptions tend to be better when the model is given the correct set of instruments.
- Click `Transcribe`. The transcription runs in the background, and the MIDI fills into the piano roll as it is
 decoded. A progress bar is shown while it runs.
 - Pause it with the button next to the progress bar, and resume it later from where it stopped, even after closing
 and reopening the plugin or your DAW session. The bin button discards the transcription.
- Click play to listen to the result without waiting for the transcription to finish. Only the part decoded so far
 plays.
 - Adjust the mix between the source audio and the synthesized transcription.
 - Adjust the level of