- cross-posted to:
- news@lemmy.linuxuserspace.show
- cross-posted to:
- news@lemmy.linuxuserspace.show
- no account or login required.
- it’s an addon (and one you have to go get), not baked-in.
- limited to queries about content you’re currently looking at.
(it’s not a general ‘search’ or queries engine) - llm is hosted by mozilla, not a third party.
- session histories are not retained or shared, not even with mistral (it’s their model).
- user interactions are not used to train.
Thanks for the summary. So it still sends the data to a server, even if it’s Mozillas. Then I still can’t use it for work, because the data is private and they wouldn’t appreciate me sending their data toozilla.
In such scenario you need to host your choice of LLM locally.
does the addon support usage like that?
No, but the “AI” option available on Mozilla Lab tab in settings allows you to integrate with self-hosted LLM.
I have this setup running for a while now.
Which model you are running? Who much ram?
My (docker based) configuration:
Software stack: Linux > Docker Container > Nvidia Runtime > Open WebUI > Ollama > Llama 3.1
Hardware: i5-13600K, Nvidia 3070 ti (8GB), 32 GB RAM
Docker: https://docs.docker.com/engine/install/
Nvidia Runtime for docker: https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html
Open WebUI: https://docs.openwebui.com/
Technically it’s a server operated by Google, leased by Mozilla. Mistral 7b could technically work locally, if Mozilla cared about doing such a thing.
I guess you can basically use the built-in AI chatbot functionality Mozilla rushed out the door, enable a secret setting, and use Mistral locally, but what a missed opportunity from the Privacy Browser Company
According to Microsoft, you can safely send your work related stuff to Copilot. Besides, most companies already use a lot of their software and cloud services, so LLM queries don’t really add very much. If you happen to be working for one of those companies, MS probably already knows what you do for a living, hosts your meeting notes, knows your calendar etc.
If you’re working for Purism, RedHat or some other company like that, you might want to host your own LLM instead.
That’s really cool to see. A trusted hosted open source model is really missing in the ecosystem to me. I really like the idea of web centric integration too.
deleted
I want to point out that by downvoting this, you’re reducing the visibility of the post for other people, therefore making less people informed of the change.
My thoughts exactly.
However, I always found upvotes and downvotes a bit confusing because upvote is almost synonymous with “like” and downvote with “don’t like”. With upvote, that assumption isn’t that problematic but with downvote it is, like in this case where post will have less chance of being seen.
no, i don’t want to meet orbit, thank you very much.
I appreciate the option to not install it.
Now if only Mozilla could migrate their built-in AI stuff to this optional extension so it doesn’t come pre-installed, that’d be great
The built-in AI staff,you referred to, is nothing but an accelerator to integrate with 3rd-party or self-hosted LLMs. It’s quite similar to choosing a search engine in settings. This feature itself is lightweight and can be disabled in settings if not required.
The built-in AI staff [sic]… is… an accelerator to integrate with 3rd-party or self-hosted LLMs.
Users are only shown Big Tech “3rd-party” options. Mozilla made this choice intentionally.
Since Mozilla is clearly capable of developing an add-on that is not forcefully installed on user’s devices, they should remove the built-in thing that endorses the highly unethical chatbots run by Google, OpenAI, etc.
Users are only shown Big Tech “3rd-party” options. Mozilla made this choice intentionally.
Well, how many users really have LLM local-hosted?
So we agree Mozilla only chose to promote Big Tech options.
No thanks, I’ll pass.
Firefox, tell your creepy little friend he can get the fuck off my property!
It’s an add-on, not something baked-in the browser. It’s not on your property at the first place, unless you choose to install it 🙂
For now, but one day Firefox will try sneak him into my house and hide him in a cupboard untill squatters rights kick in.
Even they choose to do so in future, usually there always is a about:config entry to disable it.
I can’t wait for Firefox to Starr putting product recommendations on all web pages
I’m starting to warm up to this stuff. There is a future rapidly hurtling towards us where, if you take the time to read and think for yourself, you will become a genius. It was happening already in some stem fields where people used GUI tools without ever reading what the buttons did, and if you took the time to read the manuals and the underlying methods, you could become vastly more competent than anybody else in your team. This “AI” bullshit is just extending the lazy culture out to every piece of information on the web, where average Joe is already unable to concentrate beyond 140 characters. Those that take the time to learn the fundamentals and read deeply will have vastly superior knowledge of any subject, while the majority will be spoon fed superficial summaries filled with errors and no way of realising.
That was written by an AI, wasn’t it?
If anything brings me around on AI, it’ll be the “kids these days and their dang quill and parchment, the chisel and stone tablet was good enough for me so it should be good enough for everyone” argument.Thank you for illustrating my point!
This is why I don’t use direct Firefox. I use soft forks like Librewolf, Mull and now Fennec
This is just an add-on BTW. It’s completely up to you to decide if you need this.
For now
that’s an awful argument, are you worried that mozilla is also gonna start censoring swear words in firefox?
deleted by creator
the ‘ai chatbot’ in the ‘lab’ is different.
the chatbot is just basically an optional conduit between you and and a third party ai-powered ‘search’/‘chat’ service, so that you can use firefox to access it.
you’re still subject to any rules, policies, costs, account requirements, usage limits, etc. set by those third-parties.
BTW, Lab option works better privacy wise (than Add-on) if you have LLM running locally, IMO.