Skip to content
Mardi Gras Developers
Menu+

Private AI platform

A private AI platform inside the EU, under your own control

A private AI platform gives your organisation its own AI environment: a chat interface for staff, a gateway that decides which model gets which task, and hard guarantees about where data is processed. We design and build that environment, including EU routing, fallback routes, document processing and masking of personal data.

Updated

When to call us

  • Staff use public AI tools with company or customer data.
  • You fall under GDPR, DORA or sector rules and must show where data is processed.
  • You want to use several models without being tied to one vendor.
  • You want control over AI cost per team or per task.

49% of Dutch companies that considered AI but do not use it name privacy as a reason. Another 42% name uncertainty about the legal consequences, such as liability for damage.

Source: Statistics Netherlands (CBS), ICT use by companies 2025

Not the right fit. Not needed if your organisation handles no sensitive data and a standard business AI subscription is enough.

TaskEU modelEU fallback
  1. Fast and interactivesmall model, answers within a secondEUEU
  2. Everyday workcheap model for bulkEUEU
  3. Background taskscheap model, no user waitingEUEU
  4. Generalbroadly usable modelEUoutageEU
  5. Codemodel with a large context windowEUEU
  6. Decisions involving personal dataheavy model, strictest routeEUEU
  7. Deep analysisheaviest model, maximum reasoningEUEU
Seven tiers, each with its own model and a fallback route at a second European provider.

What you get

  • Model gateway with tiers

    One entry point with models per task: fast for interaction, cheap for bulk, heavy for analysis. Every tier has a fallback route.

  • EU routing that fails closed

    Requests only travel through European endpoints. If a model has no EU endpoint, the request goes to an EU alternative or is refused.

  • Documents and search

    Processing of PDFs and office files, vector search in PostgreSQL and a private search engine of your own for web sources.

  • Masking of personal data

    Structured data is replaced deterministically; free text passes PII detection before a model sees it.

How we approach it

Technology

  • Open WebUI
  • LiteLLM
  • OpenRouter EU
  • Amazon Bedrock EU
  • PostgreSQL + pgvector
  • Redis
  • Presidio
  • Docling
  • Apache Tika
  • SearXNG
  • Docker Compose
  • Cloudflare Zero Trust
  1. 01

    Record the decisions

    For every choice (model, provider, region, retention) we record what we choose and why, so compliance can read along.

  2. 02

    Build on pinned versions

    Every component runs on a pinned version. An upgrade is a deliberate, reviewed change.

  3. 03

    Shield and deliver

    Users only get in through Cloudflare Zero Trust with single sign-on; the AI services publish no ports to the internet themselves.

Proof from our own work

Frequently asked questions

Does our data really stay inside the EU?

In our setup prompts and completions are processed only through European endpoints, and routing refuses requests for which that is not possible. Per provider we record what is and is not covered by that guarantee, for example billing and account data.

Can we use open-source models?

Yes, provided they run on European infrastructure. We distinguish data residency from suitability: a model can be hosted safely and still be unsuitable for, say, credit decisions.

What happens when an AI provider goes down?

Every model tier has a fallback route to a second provider inside the EU. Users see a different model at most; the service stays up.

Contact

Book a 30-minute intro call

Describe your question in a few sentences. Kevin or Pascal replies personally.