This is an excellent use case for completely local, small model inference, yet for inexplicable reasons Mozilla wants to normalize uploading your entire private browsing history to a cloud.
These (Mistral's and Mozilla's) marketing pages aren't candid enough to clearly explain the difference between local and cloud inference, and that they're asking you to consent to enabling the latter. I'd call that the bare minimum of ethics. If you're in a position of authority over your less technical users, you are ethically obligated to give them the full picture of what are you doing and why they should consent.
(Aside to any Mozilla people who might be reading HN, your page here[0] has an oversight, it advertises this model as "Mistral Small 4" but the hyperlink is to OpenAI's model card for gpt-oss-120b).
> This is an excellent use case for completely local, small model inference,
How small is this 'small model' inference?
Browsers especially are expected to operate on a very wide number of devices. It makes perfect sense to me to start off with a cloud driven approach and later allow people to configure it to run locally if they have the hardware to do so. Anyone with the hardware to do so is already signaling that they'd have the technical interest to make that change while having the default 'works for everyone' mode be one that doesn't require a powerful local device.
I say this as someone using a 6 year old computer and only upgraded to 8GB of ram when the latest WoW expansion was released.
peri-cl · · focus · HN ↗
These (Mistral's and Mozilla's) marketing pages aren't candid enough to clearly explain the difference between local and cloud inference, and that they're asking you to consent to enabling the latter. I'd call that the bare minimum of ethics. If you're in a position of authority over your less technical users, you are ethically obligated to give them the full picture of what are you doing and why they should consent.
(Aside to any Mozilla people who might be reading HN, your page here[0] has an oversight, it advertises this model as "Mistral Small 4" but the hyperlink is to OpenAI's model card for gpt-oss-120b).
[0] <a href="https://support.mozilla.org/en-US/kb/smart-window-models" rel="nofollow">https://support.mozilla.org/en-US/kb/smart-window-models
forgotaccount3 · · focus · HN ↗
How small is this 'small model' inference?
Browsers especially are expected to operate on a very wide number of devices. It makes perfect sense to me to start off with a cloud driven approach and later allow people to configure it to run locally if they have the hardware to do so. Anyone with the hardware to do so is already signaling that they'd have the technical interest to make that change while having the default 'works for everyone' mode be one that doesn't require a powerful local device.
I say this as someone using a 6 year old computer and only upgraded to 8GB of ram when the latest WoW expansion was released.