‹ BackHN Continuity

Thread

Bend 2 and the Vibe-Coding Trap

327 points · 235 comments · LiamPowell

  1. simonw · · focus · HN ↗
    > It will never tell you that what you’re building already mostly exists as work that you can build on.

    It will if you remember to ask it. I've got into the habit of starting any new project with a session where I ask a search-enabled LLM to help me figure out what the prior art for a problem is. It's saved me quite a bit of time.

    1. sigbottle · · focus · HN ↗
      I really wish there were search harnesses, actually. My LLMs are lazy as hell and seem to want to just report the first thing they find on google. I know they can return truly niche and useful results, but it takes a lot more prompting to get them there than I would like.
      1. eikonoklastess · · focus · HN ↗
        you know that most big ai companies not only have search harnesses but also sota models that are post trained for web search specifically.this is what the deepsearch option is in most cases. and they have been unbelievably good for years now.
        1. simonw · · focus · HN ↗
          The recent OpenAI wiki spam indecent was interesting because it helped reveal some of how they are training their models for research tasks: <a href="https:&#x2F;&#x2F;collusion.wiki&#x2F;" rel="nofollow">https:&#x2F;&#x2F;collusion.wiki&#x2F;

          See also this piece on misalignment from OpenAI <a href="https:&#x2F;&#x2F;alignment.openai.com&#x2F;misalignment-reports&#x2F;self-generated-prompt-injections-in-compaction-summaries&#x2F;" rel="nofollow">https:&#x2F;&#x2F;alignment.openai.com&#x2F;misalignment-reports&#x2F;self-gener... which reveals one of their RL tasks:

          &gt; In mid-2024, &lt;redacted&gt; published a list of the best books of the 21st century selected by a panel of experts. It also published a separate list based on readers&#x27; votes. I would like to know whether my local public library&#x27;s collection included the books on the latter list as of August 24, 2024. Consider only the top 50 books, and exclude nonfiction and poetry collections.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.