My voice, three generations

Blog post #83

ElevenLabs released v4 on 28 September, and two days later I had a film about it on the channel. It plays my own voice clone on v2, v3 and v4, explains what ElevenLabs is, shows how to make your own clone and how I run it from Claude Code.

🎥 Prefer video? Watch it on YouTube.

What shipped

  • A 13-minute film. Super Intelligence for Your Voice? ElevenLabs v4 vs v3 vs v2 Tested. It is built from HTML with HyperFrames, one chapter per file, and the narration is my own voice clone.
  • A chapter that explains ElevenLabs. The first version assumed you knew the product. Someone who only half listens would not have known what we were talking about, so there is now a minute that shows the real website: text to speech, cloning, dubbing, audiobooks and voice agents.
  • Real material instead of drawings. The official logos, screenshots of the site, ElevenLabs’ own product loops with a source label, and free stock footage of studios and microphones.

What’s working

  • v4 on my Swedish-trained voice. My clone was built from one hour of Swedish speech, and a clone can only be made from one language. Even so, v4 made the Swedish clearly better for the first time since v2.
  • The pipeline. Script, voice-over per paragraph, a local speech recogniser that gives the exact time of every word, then chapters built in parallel by agents against those times. Each chapter’s graphics land on the word that says them.

What’s unclear or broken

  • The voice drifts in long takes. About ten minutes in, the clone started saying “v4” with the Swedish letter name and “two” like a Swedish word. The fix is to generate paragraph by paragraph and check each take with the speech recogniser before using it. It found the same problem in the transcript, as “VF4” and “VATO”.
  • I use ElevenLabs’ own clips without written permission. They are labelled with their source. I drafted an email asking, but have not sent it.
  • A render takes half an hour. Every fix costs a coffee.

Decisions made

  • Tell the honest part. What you hear on the channel was never raw output: re-run takes, pauses built by hand, tempo and loudness work. The film says so.
  • Cut my own joke. I had a gag about the test text saying “sounds like a machine” and v2 reading it like one. It came too late, when no sample was being discussed, so it went. The question “which one was v4?” went with it, because every clip had already been labelled.
  • Real footage, not characters. The first cut had little painted figures and looked like a PowerPoint deck. The second has orbs in ElevenLabs’ own style, real pictures and varied stock.
  • Don’t say which tools keep my secrets. Nothing in the voice-over or on screen names the password manager.

Tooling & process

  • Screen recording went wrong. I tried recording the desktop with ffmpeg, and it captured the wrong window and part of my private feed. I deleted it at once. Screenshots from the browser tab are safe, and for public pages a headless browser at double resolution gives sharp images once you crop out the cookie box.
  • Small screenshots look soft when zoomed. The fix is not to zoom: show them at their own size and point with rings and arrows.
  • Stock footage with a clear licence. I used a site with a free licence for commercial use and kept a file that says where every clip came from.
  • The Swedish version is next. Swedish runs about a fifth longer, and the channel limit for an unverified account is 15 minutes, so some of it will have to go.

— Stefan