New Mozilla AI project. Put “trust” and “privacy” in the title and subtile but doesn’t support locally hosted model.
Exists as an add-on today. Model is Mistral 7B hosted by Mozilla in GCP. Claims won’t save data long term. Promises won’t use personal information to train models and not share queries with Mistral or any other services.
Am I going to use it? No. Not without local model supported.
Note: the mobile version of the page is broken (lack of many content). Best to view the desktop version for complete details.
Neat project, but it’s a bit odd that this extension that’s focused on privacy doesn’t allow you to use your own local LLM instead of connectign to their servers.
Edit: added a couple things to enable it on desktop (Linux)
Go to:
about:configSet
browser.ml.enable truebrowser.ml.chat.enabled truebrowser.ml.chat.hideLocalhost falseThen go to:
about:inferenceYou can set the endpoint to your localhost or any server.
Open sidebar and select AI chatbot. Select localhost option and follow prompts
Note: I will never use this, I just wanted to know. Anyway, here are the docs
https://firefox-source-docs.mozilla.org/toolkit/components/ml/index.html
https://firefox-source-docs.mozilla.org/toolkit/components/ml/api.html
screenshots This is on nightly on mobile
Awesome, thank you