This is an excellent use case for completely local, small model inference, yet for inexplicable reasons Mozilla wants to normalize uploading your entire private browsing history to a cloud.
These (Mistral's and Mozilla's) marketing pages aren't candid enough to clearly explain the difference between local and cloud inference, and that they're asking you to consent to enabling the latter. I'd call that the bare minimum of ethics. If you're in a position of authority over your less technical users, you are ethically obligated to give them the full picture of what are you doing and why they should consent.
(Aside to any Mozilla people who might be reading HN, your page here[0] has an oversight, it advertises this model as "Mistral Small 4" but the hyperlink is to OpenAI's model card for gpt-oss-120b).
The privacy policy for Smart Window[1] indicates that prompts are not only sent to an LLM provider (Mistral in this case), but also to Mozilla servers first.
> The assistant sends the full prompt (including your query, any relevant Memories, and any additional relevant browsing context) to a Mozilla server.
>
> Upon receipt, Mozilla forwards the request to a third-party large language model (LLM) on your behalf. The LLM receives the request from Mozilla, not directly from you, and sees a Mozilla IP address rather than your own. The request includes only the information needed to generate a response or perform the requested action.
Where they do use an on-device model is for the initial query classification:
> When you submit a query in the Smart Bar, the assistant uses a local (on-device) intent classification model to determine whether the query is best addressed by a chat or a search.
> Smart Window infers information about you based on your interactions with the assistant and your Firefox browsing activity, including websites you have visited. This may include activity outside of Smart Window (such as in classic windows)...
Privacy-minded users who want to try this feature would need to create a totally separate browser profile to avoid data leaks.
peri-cl · · focus · HN ↗
These (Mistral's and Mozilla's) marketing pages aren't candid enough to clearly explain the difference between local and cloud inference, and that they're asking you to consent to enabling the latter. I'd call that the bare minimum of ethics. If you're in a position of authority over your less technical users, you are ethically obligated to give them the full picture of what are you doing and why they should consent.
(Aside to any Mozilla people who might be reading HN, your page here[0] has an oversight, it advertises this model as "Mistral Small 4" but the hyperlink is to OpenAI's model card for gpt-oss-120b).
[0] <a href="https://support.mozilla.org/en-US/kb/smart-window-models" rel="nofollow">https://support.mozilla.org/en-US/kb/smart-window-models
julenx · · focus · HN ↗
mossTechnician · · focus · HN ↗
wky · · focus · HN ↗
SahAssar · · focus · HN ↗