Language models
Open weightsOpen-source language models for businesses
Open-source language models – or more precisely, open-weight models – are AI models whose weights have been published and which can therefore be operated on your own hardware or in a German data center. Depending on the task, we use models such as Llama, Qwen, Mistral or gpt-oss so that sensitive data does not go to US cloud services and you are not tied to a provider.
- Licence
- depending on the model (e.g. Apache 2.0)
- Operation
- Locally, in Germany or via API
- Official website
- ollama.com
What we use Open-source language models for
Local AI for sensitive data
Personnel, health or client data is processed by a model that runs in your company or in Germany.
Suitable model for each task
Small models for classification and data extraction, larger ones for sophisticated texts – this saves costs.
Operation with Ollama
With Ollama, models run on their own hardware and are addressed via a uniform interface.
Basis for chat and agents
The models power Open WebUI, document search, and n8n workflows.
Why Open-source language models?
Data sovereignty
No text leaves the infrastructure you set.
No lock-in
Models can be replaced when a better one appears – without rebuilding the application.
Plannable costs
If you run your own business, there are no fees per request, but costs for hardware or hosting.
Auditable
Open weights and model cards make it easy to see what you're working with.
What we take care of with Open-source language models
- Selection and testing of suitable models with your real tasks
- Operation locally (e.g. with Ollama), in a German data center or via the IONOS AI Model Hub
- Hardware advice if you want to run it yourself
- Integration with Open WebUI, document search and workflows
- License Exam for Commercial Use
Implementation and consulting can often be subsidised through German BAFA or INQA funding.
What it is not meant for
"Open source" is not uniform when it comes to language models: Some models are under Apache 2.0, others under their own licenses with restrictions (such as the Llama license). And the largest commercial models are still stronger in some tasks – we are honest about when an open model is enough and when it is not.
Our solutions with Open-source language models
Frequently asked questions about Open-source language models
What are open source language models?
+−
AI language models whose model weights are publicly available. They can be downloaded and operated on your own hardware or at a hoster of your choice. Technically correct, one usually speaks of open-weight models.
Which open source models are suitable for companies?
+−
Models from the Llama, Qwen, Mistral and gpt-oss families are often used. Which one fits depends on the language, task, hardware and license – we will test this with your examples.
Do you need expensive hardware for local AI?
+−
For small models, a server with a good graphics card is often sufficient. Large models need significantly more; then a German provider like the IONOS AI Model Hub is often more economical.
Are open source models as good as ChatGPT?
+−
For many business tasks such as summarizing, reading data or answers from documents, current open models are close at hand. For very complex tasks, commercial top models can be ahead.
Is it allowed to use open source models commercially?
+−
Mostly yes, but the conditions differ: Apache 2.0 models are largely free, other licenses contain conditions. We check this for every model used.
Go deeper
- AI consultancy
- Choosing an open-source language model for German: How to test correctly
- Open Weight or Open Source? AI Model Licenses for Companies Explained
- gpt-oss: What OpenAI's open model means for companies
- Open-source AI models for businesses: the key models at a glance (as of October 2026)
- Ollama explained simply: running AI models in your own company
- Local AI vs. ChatGPT & Co.: A comparison of data protection, costs and performance
- Hosting AI models in Germany in compliance with the GDPR: options and providers
- AI agents in the company with open source: What is already possible today
Works together with
Product names and logos mentioned are trademarks of their respective owners. bettersorted uses this software and operates it for clients; there is no official partnership.
A 30-minute conversation, free of charge.
A 30-minute consultation, free of charge. We’ll take a look at your processes and give you our honest opinion on whether automation is worthwhile.