A Privacy Analysis of Web and Mobile Conversational AI Agents [pdf]
Thread
Unofficial Hacker News client; not affiliated with Y Combinator.
A Privacy Analysis of Web and Mobile Conversational AI Agents [pdf]
Unofficial Hacker News client; not affiliated with Y Combinator.
pbasista · · focus · HN ↗
I have recently noticed that e.g. ChatGPT, when used from a web browser, periodically sends unfinished prompts to their servers, namely to the `conversation/prepare` endpoint, without waiting for the user to actually send it.
This partial prompt data might potentially be used to "pre-warm" some kind of cache.
But it may also be used to track the user's writing cadence, error correction style and evolution of their stub ideas as they are being formulated into a prompt. I would assume that such data could also be sold to the advertisers.
ShinyLeftPad · · focus · HN ↗
jwstillwater · · focus · HN ↗
OpenAI’s statements in response to the Millenium Prize (and related) disputes I think are a pretty obvious example of this in practice. One man’s “user prompts” is not another’s “reasoning trace scratchpad”.
This comment by Falserum on the mathematics research post articulates it well:
<a href="https://news.ycombinator.com/item?id=49649992">https://news.ycombinator.com/item?id=49649992
kridsdale1 · · focus · HN ↗
derefr · · focus · HN ↗
I'm pretty sure it is used for this; but rather than for anything nefarious, my guess is that this info is then fed to a classifier model to ensure that users of ChatGPT-the-service (as opposed to the OpenAI inference API) are actual humans, rather than agents trying to circumvent having to pay API pricing.
sroussey · · focus · HN ↗
port11 · · focus · HN ↗
Sounds good.
broken-kebab · · focus · HN ↗
sroussey · · focus · HN ↗
port11 · · focus · HN ↗
broken-kebab · · focus · HN ↗
[dead]