‹ BackHN Continuity

Thread

WangNet – 1.8 MB, zero-dependency Numberwang adjudication in 11 languages

182 points · 63 comments · Liogra123

  1. Liogra123 · · focus · HN ↗
    Try it in the browser (the forward pass is plain JS, nothing leaves the page): <a href="https:&#x2F;&#x2F;huggingface.co&#x2F;spaces&#x2F;graafhenk&#x2F;numberwang-demo" rel="nofollow">https:&#x2F;&#x2F;huggingface.co&#x2F;spaces&#x2F;graafhenk&#x2F;numberwang-demo

    What it is: a character-level CNN with 80,804 parameters. The weights are a 1.79 MB JSON file and inference is about 100 lines of Python standard library — no PyTorch, no NumPy. It runs on a Pi Zero. It accepts digits, number words in eleven languages, arithmetic (&quot;96 divided by 2&quot;, &quot;deux fois trois&quot;), Roman numerals, ordinals, clock times, currency, and fictional numbers (&quot;shinty-six&quot;). Anything with no numeric content is correctly ruled out as never able to be Numberwang. Whatever comes to 1 or 44 is Wangernumb and you rotate the board.

    Held-out accuracy is 88.9% on 486 probes reserved from training by construction. The ceiling is ~98%, because roughly 2% of training labels are inverted at compilation time, in accordance with long-standing adjudication practice.

    For comparison I ran Qwen3-1.7B on the same suite with the four verdicts as a constrained multiple choice: 51.9%, which is 2.3 points above answering &quot;Numberwang&quot; to everything. It answers &quot;Numberwang&quot; to 93% of inputs and never once identifies a Wangernumb. So the accuracy table has a verdict-distribution column, since one number can&#x27;t tell a model that decides from one that agrees.

    Honest weak spot: arithmetic is memorised, not computed. A conv net can&#x27;t add. On operands reserved from training it gets 60% on symbolic expressions and 44% on foreign-language ones.

    Dataset (185k adjudicated utterances), training script, evaluation harness and benchmark are all in the repo and reproduce from a fixed seed. Model card on HF: <a href="https:&#x2F;&#x2F;huggingface.co&#x2F;graafhenk&#x2F;numberwang" rel="nofollow">https:&#x2F;&#x2F;huggingface.co&#x2F;graafhenk&#x2F;numberwang

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.