‹ BackHN Continuity

Thread

Faster prompt lookup drafting in llama.cpp

89 points · 12 comments · pptadversary

  1. jadidbourbaki · · focus · HN ↗
    Btw, if anyone has experience with the open source community in general and llama.cpp in specific, I would greatly appreciate some advice. I’m facing a bit of an interpersonal issue that I really hope is resolved without any ill will. Here is the context:

    <a href="https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;LocalLLaMA&#x2F;comments&#x2F;1wr5ylm&#x2F;comment&#x2F;pca06t5&#x2F;?context=3" rel="nofollow">https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;LocalLLaMA&#x2F;comments&#x2F;1wr5ylm&#x2F;comment...

    Any advice for what I can do? Due to this, I cannot create a PR or issue in the llama.cpp repository. However, I am worried about bothering the maintainers on other channels in case it aggravates them further. Thank you for your help!

    1. embedding-shape · · focus · HN ↗
      &gt; Any advice for what I can do?

      Email that author (email can usually be found via GitHub, or contact via other private way they&#x27;ve shared somewhere) and explain the situation, don&#x27;t lambast them publicly on social media or similar ways. If that doesn&#x27;t work, do the same but for another maintainer. Don&#x27;t spam all of them straight up, wait a week or something before contacting someone else.

      1. netburst · · focus · HN ↗
        That would be inadvisable as the maintainer (?) in question&#x27;s GitHub bio states:

        &gt; Emailing me about a temporary ban will result in a permanent one instead.

        As far as I can tell the ban was given based on a single accidental ping to the maintainer, who then reviewed the draft PR before realizing it was not for the mainline llama.cpp repo.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.