Which open-source LLM do I pick if I want to run on-prem or in my own cloud?
Llama, Mistral and Qwen are the three families that matter for SMB. For general Dutch and English work the larger variants are close to commercial quality, but the choice mostly depends on license, hardware and the language area you serve.
Try this first
- 1Llama (Meta): good quality, decent multilingual, generous but not free license. Read the license carefully if you build commercial AI for customers, some variants have usage caps.
- 2Mistral (Mistral AI): EU company, strong performance, models like Mistral Large and open Mixtral variants. A real reason for SMBs where EU data location is a hard requirement.
- 3Qwen (Alibaba): very strong, especially in multilingual and code, Apache 2.0 on open variants. Be aware of geopolitical perception with commercial customers who treat that as a showstopper.
- 4Match to hardware: a 7B runs on a good laptop, 32B needs a workstation, 70B+ needs a real GPU server or a cloud instance with A100/H100. Compute first, choose second.
- 5Test on your own Dutch content. Benchmarks are often English-only and miss the picture. Twenty real questions compared takes an hour and tells more than any leaderboard.
When to bring us in
Want us to test three candidates on your hardware and content head to head, we can set up the bench in half a day.
See also
- Can I paste a customer file or email into ChatGPT?Depends on the account and settings. Free ChatGPT and a Team tenant behave very differently from what most people assume.
- I want a one-page AI policy for my teamA real one-pager beats a thick document nobody reads. Four headers and concrete examples.
- How do I tell if an AI answer is made up?Models sound confident even when they are wrong. A few habits catch most mistakes.
None of the above fits?
Describe your situation below. We pass your input plus the steps you already saw to our AI and return tailored next-step advice. If it's too risky to DIY, we'll say so.
Or skip the DIY entirely
Our Managed IT clients do not look these things up. One point of contact, a fixed monthly price, resolved within working hours.