‹ BackHN Continuity

Thread

Gemini 3.8 text-to-speech

330 points · 152 comments · swolpers

  1. thangalin · · focus · HN ↗
    Here's a video of my Emotive Audiobook Creator, KeenLore, a locally hosted web app:

    <a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=WAeHgE94rVo" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=WAeHgE94rVo

    No cloud, no tokens to pay. Reads a book using a full cast of characters. Quotation attribution detection (for my novel) is at 97.2% accuracy (485&#x2F;499 quotes identified and assigned correctly). The autofill of character voice descriptions uses the prose to determine how the character sounds.

    Employs Gemma 4[1] for the prose analysis (voice fills, quotation detection) and Qwen3 TTS Voice Design[2] for creating voice samples. Runs on an 8GB NVIDIA T1000 GPU card, 96 GB RAM, and a AMD Ryzen 5 7600.

    [1]: <a href="https:&#x2F;&#x2F;deepmind.google&#x2F;models&#x2F;gemma&#x2F;gemma-4&#x2F;" rel="nofollow">https:&#x2F;&#x2F;deepmind.google&#x2F;models&#x2F;gemma&#x2F;gemma-4&#x2F;

    [2]: <a href="https:&#x2F;&#x2F;huggingface.co&#x2F;spaces&#x2F;Qwen&#x2F;Qwen3-TTS-Voice-Design" rel="nofollow">https:&#x2F;&#x2F;huggingface.co&#x2F;spaces&#x2F;Qwen&#x2F;Qwen3-TTS-Voice-Design

    1. eru · · focus · HN ↗
      Awesome! I had been meaning to build something like this for a while now, but never got around to it.

      Is it possible to annotate your text with extra &#x27;stage directions&#x27; that influence how the book is read out?

      1. thangalin · · focus · HN ↗
        &gt; annotate your text with extra &#x27;stage directions&#x27;

        Good idea, not something I&#x27;ve considered yet. Wouldn&#x27;t take much to add it since there&#x27;s already a feature for selecting a quotation and assigning it an intonation. Same infrastructure could be reused to select arbitrary text and assign stage directions.

        1. eru · · focus · HN ↗
          Nice! One suggestion: don&#x27;t just make this apply to text, but also to a specific cursor position (you could say a zero-length text selection where start=end). That&#x27;s natural if you eg want to say that between one sentence and the next, or one word and the next, you want to insert the sound of a train arriving or a sigh.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.