I Built a Real-Time VST3 Host That Runs Waves & Auto-Tune — With 100% AI-Generated Code
#cpp#opensource#audio#ai
Trần Vĩnh Trí

Trần Vĩnh Trí @devcodewithai

About: I can’t code... but my AI can. Together we built a full plugin host from scratch. You’re using React? I’m using JUCE and voodoo.

Location:
Vĩnh Long, Việt Nam
Joined:
Jul 7, 2025

I Built a Real-Time VST3 Host That Runs Waves & Auto-Tune — With 100% AI-Generated Code

Publish Date: Jul 7
0 0

🎤 How I Built a Real-Time Plugin Host That Runs Waves & Auto-Tune

with JUCE, C++, and a little help from AI (actually... all the code)

Hi, I'm Trí — a system designer and indie developer from Vietnam.

I never studied programming in school. I didn’t even finish high school.

But I built a real-time plugin host — and it actually works.

In fact, 100% of the code was written by AI, based on my ideas, designs, and logic.

🎧 What is idolLiveAudio?

idolLiveAudio is an open-source audio plugin host built with JUCE and C++20, designed specifically for idol livestreamers who sing and perform live on platforms like TikTok, YouTube, Facebook, and more.

It runs Waves, Auto-Tune Pro, and most VST3 plugins with low latency.

Think of it as a mini-DAW — but lightweight, fast, and laser-focused on live vocals.

screenshot

🔧 Why I built this?

Because most DAWs are overkill for livestream use.

And most free plugin hosts? Either unstable, bloated, or can’t handle complex plugins like Waves or Antares.

idolLiveAudio is designed to:

  • Be dead simple to use
  • Load professional plugins like CLA Vocals, Auto-Tune Pro
  • Sync playback with RAW vocal recordings
  • Support real-time effects like Reverb, Delay, EQ
  • Prevent disasters on stage or livestream (with Safety Lock mode)

⚙️ Tech Stack

  • JUCE (C++ framework for audio)
  • C++20 (compiled with Visual Studio)
  • WavesShell support with plugin extraction logic
  • Real-time audio pipeline with FX routing per track
  • AI-assisted architecture planning (ChatGPT + Gemini)
  • Full plugin scanning, loading, playback, and preset systems

🧪 What was hard?

  1. Waves Plugin Shells — They're tricky. Most hosts can't scan or load them correctly. I built a custom WavesShellManager to detect and extract actual plugins from .vst3 containers.

  2. Plugin crash protection — Some plugins crash if you breathe wrong. So I wrapped all state loading and playback in try–catch blocks to keep the app alive even when a plugin dies.

  3. Synchronized multi-track playback — idolLiveAudio records unprocessed input from both vocal and music channels, then plays them back in sync using custom transport logic.

  4. Making it “idiot-proof” — Since many users are non-tech idols, I built a “Safety Lock” feature to freeze settings during livestream — no more accidental disasters.

🚀 Features in v1.1.0

  • ✅ Runs Waves and Auto-Tune Pro plugins
  • 🎙️ Multi-track RAW recording (vocal + music input)
  • 🎧 Per-track FX chains, recorders, and players
  • 🔊 Soundboard for triggering effects live
  • 🟢 Real-time bypass, gain, mute, and RMS meters
  • 🔒 Safety Lock to prevent misclicks mid-show
  • 💾 Save/Load complete plugin presets with state recall

💡 Final Thoughts

I may not be a professional developer by degree —

but with the right tools, system logic, and a bit of AI magic, you can create something real.

🎯 My mission is simple:

Make high-end vocal processing accessible to non-technical performers — especially livestreaming idols.

Check out the project:

👉 https://github.com/DEVCodeWithAI/idolLiveAudio

Thanks for reading!

Feel free to connect if you're also building tools for creators, or using AI to code crazy things.

🛠️ 100% AI-generated code. Human-designed. Field-tested.

🎤 Built for live performers — not just developers.

Comments 0 total

    Add comment