# Should You Use RAG, Fine-Tuning or Pretraining?

Canonical source: [https://isaiuseful.com/training-models](https://isaiuseful.com/training-models)

<a id="main-content"></a>

- [Guides](https://isaiuseful.com/guides.html.md)

· Model adaptation · checked 27 July 2026

Start with the measured failure, then choose the lightest intervention that can fix it. Most organisations need retrieval or a focused tune—not a foundation model trained from scratch.

- [Choose an intervention](#chooser)

- [Follow the evaluation loop](#loop)

- [Plan compute](#planner)

**4**

distinct intervention routes
RETRIEVAL TO PRETRAINING
**1**

measured gap before training
BENCHMARK THE BASELINE
**0**

evaluation gates skipped
TEST EVERY CHECKPOINT

<a id="chooser"></a>

Interactive decision tree

## When should you use RAG instead of fine-tuning?

Select every gap that applies. The recommendation can combine retrieval and training because production assistants usually need more than one layer.

Start with RAG

### Give the model governed access to current knowledge.

Index the allowed documents, retrieve evidence into context and require citations. Measure that baseline before changing weights.

RAG
Fine-tune
Continue
Scratch
Retrieval does not fix deep language fluency or reliably teach a new output protocol.

The four rungs

## “Our own data” can mean four different systems.

The more of the foundation you change, the more data rights, compute, evaluation and rollback discipline you inherit.

01 · Inference layer

### [RAG + prompting](https://isaiuseful.com/rag.html.md)

Retrieve documents at run time. Best for changing facts, private records and answers that need citations.

**Data: governed documents**

Does not place the knowledge reliably inside the weights.

02 · Post-training

### SFT / LoRA / preference tuning

Train on demonstrations or preference pairs to change format, tone, policies and task behavior.

**Data: labelled examples**

Can overfit style or damage other capabilities without a regression suite.

03 · Foundation adaptation

### Continued pretraining

Resume the next-token objective on a licensed language or domain corpus, then post-train again.

**Data: large raw corpus**

Useful for vocabulary and cultural grounding; materially harder than SFT.

04 · Full foundation

### Training from scratch

Design the tokenizer and recipe, initialize weights and pretrain across a massive balanced corpus.

**Data: foundation-scale mix**

Only justified when sovereignty and underrepresentation outweigh the programme risk.

Method boundaries draw on [Meta’s Llama 3 report](https://ai.meta.com/research/publications/the-llama-3-herd-of-models/) , [Google’s Gemma tuning guidance](https://ai.google.dev/gemma/docs/tune) , the [InstructGPT paper](https://arxiv.org/abs/2203.02155) and public adaptation reports for [ALLaM](https://arxiv.org/abs/2407.15390) , [NorwAI](https://arxiv.org/abs/2601.03034) and [EuroLLM-22B](https://arxiv.org/abs/2602.05879) .

Model architecture

## Another scaling axis: reuse depth.

A looped or recurrent-depth Transformer stores fewer unique layers and applies some of them repeatedly. The proposition is fewer unique weights, with more sequential computation available for a problem.

Conventional Transformer
**Layer 1 *→* Layer 2 *→* Layer 3 *→* Layer 4**

Each layer normally owns a separate set of parameters.

Looped Transformer
**Prelude *→* [shared block × several passes] *→* Coda**

The hidden state is refined by repeatedly applying some of the same parameters.

Unique parameters **+** training data **+** recurrent computation

The recurrence is latent computation inside one model computation. It is not the model printing a longer chain of thought.

Why it is interesting

### Effective depth without storing every layer.

Weight tying can reduce weight memory versus an equally deep untied model. Iterative refinement may suit reasoning and algorithmic tasks; implementations with variable passes can expose adaptive test-time compute. That is worth testing on memory-constrained local or edge systems.

What it costs

### Memory saved is not compute saved.

Extra passes usually add latency and accelerator work. Fewer unique weights may hold less factual capacity, gains can plateau, and training stability, halting, KV-cache design and serving support remain active engineering problems. A model that fits can still run slowly.

What it does not replace

### Architecture is only one system layer.

Recurrence does not replace retrieval, tools, memory, agents or post-training. A national-language model still needs strong language, culture, instruction and evaluation data; the architecture choice is separate from the language-data strategy.

Three different loops

### Ask what repeats—and where.

1 · Neural recurrence

### Looped Transformer

The model reapplies shared neural-network blocks during one forward computation.

`hidden state → shared block→ refined state → shared block → output`

2 · Generated reasoning

### Reasoning-token loop

A conventional autoregressive model emits extra reasoning or scratchpad tokens before the answer.

`token → token → token → answer`

3 · Product orchestration

### Agent loop

An external harness calls a model, tools and memory repeatedly. Its persistence says nothing conclusive about recurrent blocks inside the model.

`plan → act → observe → update→ verify → repeat`

Research checkpoints you can run

### Study the architecture before betting a product on it.

Most approachable

### Ouro

`ByteDance/Ouro-1.4B` and `ByteDance/Ouro-1.4B-Thinking` are open Looped Language Models pretrained for iterative latent computation; official 2.6B base and Thinking variants are also public. Treat them as research models and compare against a mature conventional model at similar runtime cost.

- [Inspect the official checkpoints →](https://huggingface.co/collections/ByteDance/ouro)

Variable depth

### Huginn

`tomg-group-umd/huginn-0125` is an approximately 3.5B-parameter recurrent-depth proof of concept. Its official implementation exposes recurrence depth, making it useful for architecture experiments—not a polished default local assistant.

- [Inspect Huginn and its usage notes →](https://huggingface.co/tomg-group-umd/huginn-0125)

Paper only · checked 27 July

### Loopie

The July 2026 paper reports layer-level recurrence in MoE models with 6B total / approximately 0.6B active parameters and 20B total / approximately 2B active. No official weights or serving code were linked or discoverable at this check, so this is a significant research result—not yet a deployment recommendation.

- [Read the Loopie paper →](https://arxiv.org/abs/2607.16051)

**Does Fable or Mythos use recurrent depth?**

**It is not publicly known.** Anthropic describes Claude Fable 5 and Claude Mythos 5 as the same underlying model with different safeguards and access arrangements, and reports unusually strong long-horizon autonomy. Anthropic has not publicly identified a Looped Transformer, recurrent-depth block, OpenMythos-style recurrence or another hidden-state looping design. The observed persistence can also come from long-horizon training, adaptive reasoning effort, an agent harness, context compaction, persistent files and notes, sub-agents, repeated verification and training to recover after failures.

[OpenMythos](https://github.com/kyegomez/OpenMythos) describes itself as an independent, community-built theoretical reconstruction based on public research and speculation. It is not leaked Anthropic code and is not evidence of Anthropic’s architecture.

**Behaviour can suggest an architectural hypothesis, but persistence observed through an agent product is not enough to reverse-engineer the neural architecture underneath it.**

Training decision

### Fine-tuning usually cannot create native recurrent depth.

| Intervention | What it can do | Architecture boundary |
| --- | --- | --- |
| [RAG](https://isaiuseful.com/rag.html.md) | Supply current or private evidence at inference time. | Does not change model depth. |
| LoRA / SFT | Specialise the behaviour of a looped checkpoint. | Normally does not convert a conventional Transformer into native recurrent depth. |
| Continued pretraining | Adapt an existing looped checkpoint to a language or domain. | Preserves the checkpoint’s basic architecture. |
| Training from scratch | Design and pretrain a genuinely new recurrent architecture. | The cleanest route—and the highest programme burden. Retrofitting recurrence into pretrained models exists, but remains experimental. |

**Decision rule**

**Start with an existing looped checkpoint when studying the architecture.** Do not redesign a national or enterprise model around recurrence until it beats a conventional baseline on the same data, compute, latency and task suite.

Bounded experiment

### Compare completed work, not parameter labels.

1. **Pair the models.** Use Ouro 1.4B Thinking and a mature conventional 1–4B model at comparable precision and on the same hardware.
2. **Test the work.** Measure arithmetic and algorithms, multi-step instructions, retrieval-grounded QA, Estonian quality and tool-call formatting.
3. **Measure operations.** Record completed-task accuracy, latency, peak memory and total compute or energy where measurable.
4. **Vary depth carefully.** Change recurrent passes only where the official implementation supports it; record where quality improves, plateaus or falls.

**Evidence boundary.** Research indicates recurrent depth can add useful latent computation without proportional growth in stored parameters. It does not establish that every task benefits, that a small looped model universally equals a much larger conventional one, or that recurrent depth is the successor to ordinary Transformers. The 2018 Universal Transformer is an important predecessor; current systems extend the idea with modern pretraining, variable depth and serving research.

- [Read the Ouro paper →](https://arxiv.org/abs/2510.25741)

- [Read the Huginn paper →](https://arxiv.org/abs/2502.05171)

- [Read Universal Transformers →](https://arxiv.org/abs/1807.03819)

- [Review experimental retrofitting →](https://arxiv.org/abs/2605.23872)

- [Read Anthropic’s Fable/Mythos disclosure →](https://www.anthropic.com/news/claude-fable-5-mythos-5)

Sub-1B specialization

## Small models become useful when the job becomes specific.

A sub-1B model is rarely convincing as a miniature general-purpose chatbot. It can be a credible, cheap language-processing component inside ordinary software.

**Useful mental model**

**Large models solve unfamiliar problems. Micro-models perform familiar jobs extremely cheaply.** The smaller the model, the narrower and better-tested its contract should be.

Understand

### Turn messy language into known fields.

Classify intent or documents, rewrite a query, and extract entities, requirements or metadata filters.

Intent
Entities
Filters

Route

### Connect language to deterministic software.

Select a search path, API or internal function; rerank a small candidate set; and emit a validated JSON plan.

Tools
Reranking
JSON

Present + guard

### Finish a bounded, grounded artifact.

Write a short cited summary or template, flag spam or sensitive content, and support local or offline actions where the device permits.

Templates
Moderation
Local

**Architectural correction**

**Fine-tune the behavior; retrieve the facts.** Teach customer language, intent labels, filter schemas, tool traces, output contracts and tone. Keep prices, policies, compatibility rules and catalogue content in pages, databases, APIs or search indexes, then retrieve verified passages at run time.

> Visual: Reference micro-model search and document workflow

**Visual reading order:**
1. **01** **Ask** Receive the customer’s natural-language question.
2. **02** **Interpret** Classify intent, extract filters and write a search plan.
3. **03** **Retrieve** Use lexical search for exact matches and vectors for semantic candidates.
4. **04** **Rerank** Select the few passages that best support the requested decision.
5. **05** **Compose** Give the model only allowlisted evidence and stable source IDs.
6. **06** **Validate** Check schema, claims, calculations and permissions before rendering.

**Browser delivery boundary**

In-browser inference removes the server inference queue and can keep text on the device, but it shifts model download, memory, battery and compatibility costs to the visitor. Make a substantial download explicit and keep a WASM, server or non-AI fallback.

| Parameter band | 4-bit weights-only floor | Practical public-website boundary |
| --- | --- | --- |
| Up to 150M | Up to ≈75 MB | Easy to justify for classifiers, embeddings, entity extraction and specialized transformations when the measured feature earns the download. |
| 270M–360M | ≈135–180 MB | Reasonable for an explicit AI-powered feature after opt-in, progress feedback and testing on representative phones and laptops. |
| Around 500M | ≈250 MB | Viable for a valuable local feature, but the visitor should knowingly start the download and have a graceful fallback. |
| Around 1B | ≈500 MB | Technically possible, but usually too heavy for an invisible enhancement on a normal public site. |

The size column is arithmetic, not a package quote: four-bit weights require roughly 0.5 bytes per parameter. Tokenizers, metadata and runtime files increase the download; activations and the KV cache increase working memory. Real speed, memory pressure and output quality depend on the exact model, quantization, context, browser and device.

**What the sources establish.** Google describes FunctionGemma as a specialized 270M function-calling base intended for further workflow-specific tuning and local agents; its own guide says smaller models need tuning to learn intent reliably. The original RAG paper separates parametric model memory from retrieved non-parametric memory. Transformers.js documents browser pipelines for classification, token classification, feature extraction, generation and summarization; ONNX Runtime Web documents WASM and WebGPU execution; WebLLM documents browser-side decoder-model inference and caching. These capabilities make the architecture feasible—not automatically accurate on your workflow.

- [Inspect FunctionGemma’s 270M design →](https://ai.google.dev/gemma/docs/functiongemma)

- [Read Google’s tuning boundary →](https://ai.google.dev/gemma/docs/functiongemma/finetuning-with-functiongemma)

- [Read the original RAG paper →](https://papers.neurips.cc/paper_files/paper/2020/hash/6b493230205f780e1bc26945df7481e5-Abstract.html)

- [Build a retrieval system →](https://isaiuseful.com/rag.html.md)

- [Review Transformers.js task support →](https://huggingface.co/docs/transformers.js/main/pipelines)

- [Review ONNX Runtime Web →](https://onnxruntime.ai/docs/tutorials/web/)

- [Review WebLLM’s browser runtime →](https://github.com/mlc-ai/web-llm)

<a id="loop"></a>

Workflow loop

## A useful model programme is an evaluation loop.

The deploy gate is not the end. Production failures become new tests; they do not flow directly into training data.

01
**Define the workflow**

Owner, boundary, critical failures

02
**[Benchmark the base](https://isaiuseful.com/benchmarks.html.md#database)**

Public + local gold set

03
**Curate lawful data**

Rights, provenance, deduplication

04
**Adapt one rung**

Version every recipe and artifact

05
**Evaluate regressions**

Quality, safety, cost, latency

06
**Red-team tools**

Permissions, injection, exfiltration

07
**Pilot behind a gate**

Human review and rollback

08
**Monitor drift**

Log misses; curate the next set

Inference engineering

## Training is only half the model programme.

Products, evaluations, synthetic-data generation and reinforcement-learning rollouts all run inference. They do not share the same latency, throughput, cost or reproducibility target.

Online serving

### Protect user latency under load.

Measure time to first token, inter-token latency, p95/p99 tails, throughput per accelerator, errors and cost per accepted result with realistic prompt lengths, output lengths and concurrency.

TTFT + ITL
Tail latency
Availability

Evals + synthetic data

### Maximize useful, reproducible output.

Offline generation can trade single-request latency for batching and aggregate throughput. Pin the model, dataset, prompt template, sampler and engine, then retain outputs so a score or corpus can be reproduced.

Batch throughput
Cost
Reproducibility

RL + post-training

### Treat rollout as a distributed data path.

Rollout workers must serve the intended policy and reward models, refresh weights safely and return versioned trajectories. Slow or unstable inference can idle the rest of the training loop.

Rollouts
Weight updates
Fault recovery

| Layer | Learn first | Working proof |
| --- | --- | --- |
| 1 · Model foundation | Modern Python, PyTorch tensor execution and Transformer anatomy: attention, feed-forward or expert blocks, tensor shapes, dtypes and memory use. | Load a pinned model and reproduce reference outputs and numerical tolerances. |
| 2 · Serving engines | SGLang and vLLM request paths; prefill versus decode; KV-cache allocation; continuous batching; prefix caching; structured output and speculative decoding. | Serve the same supported model through both engines, preserve the API contract and compare TTFT, inter-token latency and throughput. |
| 3 · Performance | Profiling, roofline reasoning, GPU memory and bandwidth, kernel launches and synchronization. Add CUDA or Triton for kernel work and C++ for native extensions, bindings and framework internals. | Locate one measured bottleneck, change one variable and keep correctness within an explicit tolerance. |
| 4 · Distributed scale | Processes, queues, backpressure and failure recovery; collectives and tensor, pipeline, data or expert parallelism; NCCL plus the role of NVLink and InfiniBand. | Explain when the run is compute-, memory- or communication-bound, then demonstrate multi-GPU scaling and restart behavior. |
| 5 · Production evidence | Load generation, request tracing, numerical-stability tests, regression suites, admission control, observability, release pinning and rollback. | Publish a workload-specific service target and a benchmark report with model, engine, hardware, quantization, traffic shape and failure tests. |

**Do you need C++?**

Not to begin. Python, PyTorch, Transformer inference math and disciplined benchmarking are the entry layer. C++ becomes important when you change native framework code, bindings, memory movement or kernel launch paths; CUDA or Triton matters when you change the GPU kernels themselves. An application developer consuming an inference API may never need that depth, while an inference-framework engineer eventually will.

**Start from systems mechanics, then learn an engine.** SGLang and vLLM are production-oriented serving frameworks, not substitutes for understanding prefill, decode, memory and communication. Exact model, hardware, quantization and feature support changes quickly, so pin the tested releases and compare them on your own traffic.

- [Study the systems view of model scaling →](https://jax-ml.github.io/scaling-book/)

- [Read the SGLang architecture and guides →](https://docs.sglang.io/)

- [Use SGLang’s serving benchmark guide →](https://docs.sglang.io/docs/developer_guide/bench_serving)

- [Read the vLLM documentation →](https://docs.vllm.ai/en/stable/)

- [See where PyTorch C++/CUDA extensions fit →](https://docs.pytorch.org/tutorials/advanced/cpp_extension.html)

- [Compare the serving-tool records →](https://isaiuseful.com/tools.html.md#tools-run-models-locally)

Language + culture

## A national model is more than fluent output.

It should work across local language, institutions, culture, safety norms and actual public or enterprise tasks—and preserve evidence of where its data came from.

Foundation corpus

### Language and world model

Licensed web, books, news, archives, Wikipedia, parliamentary and legal text, science, maths and code.

Parallel corpus

### Cross-language coverage

Translation memories, bilingual text and careful translation of high-value material for lower-resource coverage.

Instruction set

### Useful behavior

Local QA, summarisation, public-service workflows, document work, coding and structured-output demonstrations.

Preference + safety

### Boundaries

Ranked answers, refusal edge cases, abuse prompts, jailbreaks and culturally grounded safety judgments.

Tool traces

### Actions

Function-call schemas, tool results, recovery paths and multi-step workflow traces with permission boundaries.

Evaluation sets

### Anti-self-deception

Held-out local tests for idioms, geography, institutions, law, culture, safety, cost and production tasks.

**Open-data example · checked 14 August 2026.** [OpenWALDO](https://openwaldo.org/) is developing a public corpus and training toolchain that carries source, license, count and hash records from selected data into model artifacts. It is worth inspecting if “open weights” are not enough for your definition of open AI; its license identifiers are assertions, not legal proof, and the resulting model still needs independent quality and safety evaluation.

**European starting point**

[EuroLLM-22B](https://arxiv.org/abs/2602.05879) covers all 24 official EU languages plus 11 additional languages, including Estonian. That makes it a relevant base or benchmark candidate—not automatic proof that it passes your local tasks.

<a id="planner"></a>

Interactive compute + memory planner

## See the order of magnitude before the purchase order.

The compute estimate uses the common dense-transformer heuristic of roughly 6 × parameters × training tokens. It is planning math—not a quote or a promise.

Total accelerator-hours
**—**

Idealized elapsed time
**—**

Compute rental
**—**

Accelerator electricity
**—**

Approximate memory per model replica
**—**

Planning estimate
Base weights
**—**

Train state
**—**

Activations/runtime
**—**

This excludes data engineering, storage, networking, checkpoints, failed runs, evaluation, staff and serving.
The memory visual assumes a 4-bit base plus 15% load overhead for QLoRA, a BF16 base for LoRA, and about 16 bytes per parameter before activation reserve for full Adam-style training. Sharding changes per-device fit; long sequences and large batches can make activation memory much higher.

Public scale references

## The final run is not the programme.

Published disclosures show orders of magnitude, not transferable price quotes. Different architectures, data mixes and clusters make direct cost comparisons approximate.

> Visual: Log-scale comparison of selected published training workloads

**Visual entries (display order):**
- Focused instruct tuning **NorwAI · 7.5B** **38.4 H100-hours**
- Continued pretraining **NorwAI disclosed runs** **4.4K–31.1K H100-hours**
- Final foundation run **BLOOM · 176B** **1.083M A100-hours**
- Wider research programme **BigScience / BLOOM** **3.46M GPU-hours**

Sources: [NorwAI technical report](https://arxiv.org/abs/2601.03034) ; [BLOOM carbon and training disclosure](https://jmlr.org/papers/volume24/23-0069/23-0069.pdf) ; and the wider programme accounting in [Estimating the Carbon Footprint of BLOOM](https://arxiv.org/abs/2211.02001) . Accelerator generations and accounting boundaries differ.

<a id="evaluation"></a>

Evaluation contract

## A tuned model can improve and still be worse.

Ship only when the target gain survives general capability, safety, cost and production-like checks.

Target

### Did the intended task improve?

Held-out local prompts, exact output contract and representative languages.

Regression

### What did the model forget?

General reasoning, multilingual performance, calibration and base-model strengths.

Safety

### Did refusals or tool behavior move?

Injection, sensitive data, dangerous requests, permissions and false tool calls.

Operations

### Can you afford the new behavior?

Tokens, latency, memory, energy, concurrency, retries and human review time.

Release

### Can you reproduce and roll back?

Data manifest, code, base hash, adapter, hyperparameters, eval artifacts and owner.

- [Choose a public benchmark and build a local set →](https://isaiuseful.com/benchmarks.html.md)

- [Use the NIST AI RMF measure and governance outcomes →](https://airc.nist.gov/airmf-resources/airmf/5-sec-core/)

What failed

## Six ways a model programme goes wrong.

These are not arguments against training. They are reasons to preserve evidence, human data, rollback paths and a cheaper baseline.

Wrong intervention

### Fine-tuning was used as a database.

Facts still became stale, citations disappeared and each update required another training run.

**Recovery: retrieval first; tune behavior only.**

Synthetic recursion

### The model learned from its descendants.

Nature experiments found that indiscriminate recursive training on model-generated data loses distribution tails and degrades later models.

- [Read the primary study →](https://www.nature.com/articles/s41586-024-07566-y)

Budget fiction

### Only the successful run was costed.

BLOOM’s final run used about 1.08M A100-hours; the wider project accounted for 3.46M GPU-hours.

- [Inspect the accounting boundary →](https://arxiv.org/abs/2211.02001)

Leaderboard overfit

### The public score rose; the local task did not.

Prompt templates, contamination and harness choices can move scores without improving the production distribution.

- [Review benchmark traps →](https://isaiuseful.com/benchmarks.html.md#failure-modes)

Rights afterthought

### The corpus could not be documented or reused.

Unclear copyright, personal-data basis or source provenance can stop release after compute has already been spent.

**Recovery: make the data manifest a release artifact.**

Serving blind spot

### The model trained successfully and failed economically.

A larger model or longer reasoning trace raised latency, memory and review cost beyond the workflow’s value.

**Recovery: benchmark total cost per accepted result.**

Open models + distillation

## Jensen Huang’s case—and the boundary around it.

Huang argues that learning from other systems is fundamental. The legal and operational question is not whether distillation exists, but what data, contract, privacy and intellectual-property permissions govern a specific use.

- [Video: Axios interview with NVIDIA CEO Jensen Huang](https://www.youtube.com/watch?v=fr1IQspixmM)

Axios · 22 July 2026

### “Learning from AI … is fundamental to intelligence.”

Huang said AI systems will increasingly learn from other AI-generated knowledge and argued that policy should target contract, privacy or other misconduct rather than prohibit the technique broadly.

- [Read Axios’s report →](https://www.axios.com/2026/07/22/nvidia-jensen-huang-china-open-source-ai)

Open-weights letter · 24 July 2026
“The world needs both frontier closed models and frontier open models.”

NVIDIA joined 26 other named organizations in a letter arguing that open weights expand access, competition, control, safety research and sovereignty. The letter also acknowledges that released weights are hard to trace or reverse and calls for targeted legal and commercial treatment of unlawful extraction.

This is an advocacy position signed by NVIDIA and others—not neutral evidence that every open release is safe or lawful.

- [Open Jensen Huang’s post →](https://x.com/JensenHuang/status/2080643682408321103)

- [Read the signed three-page letter →](https://isaiuseful.com/downloads/Open-Weights-and-American-AI-Leadership.pdf)

Technique
**Teacher outputs improve a student**

Distillation can compress capability, create training examples, evaluate or validate another model.

Permission
**A specific use is authorized**

Terms, access controls, privacy, copyright, trade-secret and competition rules still apply to the actual collection and use.

Edge cases + obligations

## The hard costs sit outside the training script.

This is operational guidance, not legal advice. Scope obligations with qualified counsel and the competent authority for the actual provider, model, system and market.

EU GPAI · provider

### Document the model and training content.

EU guidance says GPAI providers must maintain technical documentation, support downstream providers, implement a Union-copyright policy and publish a sufficiently detailed training-content summary.

- [Read Commission guidance →](https://digital-strategy.ec.europa.eu/en/faqs/guidelines-obligations-general-purpose-ai-providers)

EU Article 50 · provider + deployer

### Make AI interaction and generated content legible.

From 2 August 2026, covered providers and deployers face transparency duties including disclosure of AI interaction, machine-readable marking and notices for specified deepfakes or public-interest content.

- [Open the July 2026 guidelines →](https://digital-strategy.ec.europa.eu/en/news/commission-publishes-guidelines-transparency-obligations-providers-and-deployers-certain-ai-systems)

Personal data

### A model is not anonymous by assertion.

The EDPB says anonymity and legitimate-interest analysis are case-specific, including whether people can be identified or personal data extracted by querying the model.

- [Read Opinion 28/2024 →](https://www.edpb.europa.eu/documents/opinion-of-the-board-art-64/opinion-282024-on-certain-data-protection-aspects-related-to_en)

Copyright + provenance

### Track rights before tokenization.

The EU AI Act keeps training-content summary and copyright-policy duties relevant even for many open-weight routes. Store source, licence, collection date, restrictions and transformations.

- [Read the AI Act →](https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=celex:32024R1689)

Energy

### Measure experiments and serving, not just the final run.

NIST calls for documented energy, water and emissions impacts. The IEA reports that AI-focused data-centre electricity use grew 50% in 2025 while per-task efficiency improved rapidly.

- [Read IEA 2026 analysis →](https://www.iea.org/reports/key-questions-on-energy-and-ai/executive-summary)

Integration

### The model is not the product.

Budget corpus pipelines, evaluation, retrieval, serving, tool permissions, observability, security review, incident response, user support and model retirement.

- [Map the lifecycle with NIST →](https://airc.nist.gov/airmf-resources/airmf/5-sec-core/)

2 Aug 2025
**GPAI duties started applying**

2 Aug 2026
**Commission enforcement + Article 50 transparency**

2 Aug 2027
**Training summaries due for covered pre-Aug-2025 GPAI models**

The Commission’s training-content template FAQ says failure to publish a required summary can trigger enforcement from 2 August 2026, with potential fines up to 3% of prior-year worldwide turnover or €15 million, whichever is higher. [Check the official scope, transition and penalty guidance](https://digital-strategy.ec.europa.eu/en/faqs/template-general-purpose-ai-model-providers-summarise-their-training-content) .

Who builds what

## Four teams, four definitions of progress.

A model programme fails when every team thinks the deliverable is “the model.”

Managers

### Fund a measured workflow.

- [Baseline RAG](https://isaiuseful.com/rag.html.md#evaluate) before approving training.
- Choose one sovereign or language-sensitive use case.
- Own rights, risk appetite and the deploy gate.

Developers

### Own behavior and reproducibility.

- Datasets → Transformers → PEFT / TRL → evals.
- Version prompts, data, adapters and output contracts.
- Hand the inference track a representative workload, not a demo prompt.

Platform teams

### Operate an AI factory, not a GPU rack.

- Storage, network, scheduler and checkpoint recovery.
- Isolate training from production inference.
- Measure utilization, energy and cost per accepted output.

Partners

### Buy speed without surrendering evidence.

- Require exportable weights or adapters where promised.
- Keep your data manifest and evaluation set.
- Separate service claims from reproducible artifacts.

### European commercial route

Mistral markets customisation, self-hosting and work from fine-tuning through pretraining. Use it to buy delivery speed while negotiating data, evaluation, portability and operating boundaries.

- [Review Mistral custom model training →](https://mistral.ai/solutions/custom-model-training/)

### Ecosystem route

EuroLLM, Hugging Face, public corpora, universities, national libraries, media archives and design partners build more internal capability—but require stronger programme ownership.

- [Hugging Face documentation →](https://huggingface.co/docs)

- [EuroLLM model organization →](https://huggingface.co/utter-project)

<a id="ai-now-summit"></a>

AI Now Summit 2026 · video library

## See how custom AI moves from model to institution.

These 32 Mistral-hosted talks are first-party conference perspectives, organized by the decision they can inform. They are useful implementation context—not independent evidence that every deployment claim generalizes. Pair the physical-AI talk with the [task-first robotics route](https://isaiuseful.com/robotics.html.md#route) and its field acceptance gate.

Showing all 32 talks.

- [Video: Opening keynote](https://www.youtube.com/watch?v=IC0VNOzPZU8)

Strategy · 42:44
**Opening keynote**

- [Video: A CIO’s vision on the AI industrial revolution](https://www.youtube.com/watch?v=Tb7RLf9qBlc)

Strategy · 16:14
**A CIO’s vision on the AI industrial revolution**

- [Video: How EDF and Mistral are reinventing France’s electricity](https://www.youtube.com/watch?v=oypLpWb74PY)

Industry · 14:20
**How EDF and Mistral are reinventing France’s electricity**

- [Video: How HTX is scaling AI for public safety](https://www.youtube.com/watch?v=33hFF-IZ6I0)

Public systems · 17:00
**How HTX is scaling AI for public safety**

- [Video: How agentic AI is reinventing large organizations](https://www.youtube.com/watch?v=MJf_qB3waqc)

Agents · 19:41
**How agentic AI is reinventing large organizations**

- [Video: Transforming a global group with sovereign technology](https://www.youtube.com/watch?v=KlI08FYHaXc)

Industry · 9:50
**Transforming a global group with sovereign technology**

- [Video: Perspectives on AI for defense](https://www.youtube.com/watch?v=zR_jp_D7eWg)

Public systems · 20:19
**Perspectives on AI for defense**

- [Video: Scaling AI to support the energy transition](https://www.youtube.com/watch?v=yZ5g7Jic714)

Industry · 25:44
**Scaling AI to support the energy transition**

- [Video: How nations can develop resilient, citizen-centric AI systems](https://www.youtube.com/watch?v=d5jLSGn2oj8)

Public systems · 49:00
**How nations can develop resilient, citizen-centric AI systems**

- [Video: The machines behind the machines](https://www.youtube.com/watch?v=usu2729-3yA)

Models · 20:29
**The machines behind the machines**

- [Video: Scaling enterprise value with sovereign AI](https://www.youtube.com/watch?v=HICHSfDkBzs)

Industry · 22:26
**Scaling enterprise value with sovereign AI**

- [Video: A culture-driven approach to innovation](https://www.youtube.com/watch?v=gIC1ftvrGwo)

Industry · 17:44
**A culture-driven approach to innovation**

- [Video: Scaling secure and transparent workflows](https://www.youtube.com/watch?v=9IsgWBMyp50)

Agents · 21:31
**Scaling secure and transparent workflows**

- [Video: How Airbus is powering Europe’s AI industrial revolution](https://www.youtube.com/watch?v=PdeLBAwb9IQ)

Industry · 14:28
**How Airbus is powering Europe’s AI industrial revolution**

- [Video: How La Banque Postale is building a human-centric future for banking](https://www.youtube.com/watch?v=OnpTJd9ZtrM)

Industry · 24:56
**How La Banque Postale is building a human-centric future for banking**

- [Video: Talk by Benjamin Haddad, Minister Delegate for Europe](https://www.youtube.com/watch?v=wz8XFHJvmE4)

Public systems · 9:42
**Talk by Benjamin Haddad, Minister Delegate for Europe**

- [Video: Shaping France’s AI future: CDC’s roadmap to digital autonomy](https://www.youtube.com/watch?v=ImQyRxgBCho)

Public systems · 16:52
**Shaping France’s AI future: CDC’s roadmap to digital autonomy**

- [Video: Mistral models powering Alexa+](https://www.youtube.com/watch?v=nYl9_TWxN7U)

Industry · 25:12
**Mistral models powering Alexa+**

- [Video: Closing keynote: The end of AI as we know it](https://www.youtube.com/watch?v=dEWPTAXC3JA)

Strategy · 5:26
**Closing keynote: The end of AI as we know it**

- [Video: Co-developing scaffolds and models hand-in-hand](https://www.youtube.com/watch?v=2q_MTMAuu8w)

Models · 28:08
**Co-developing scaffolds and models hand-in-hand**

- [Video: AI for earth observation: Building the future with EVE](https://www.youtube.com/watch?v=DRCkXZtndcI)

Models · 28:09
**AI for earth observation: Building the future with EVE**

- [Video: AI infrastructure is the new critical infrastructure](https://www.youtube.com/watch?v=QxgcNjBO580)

Strategy · 29:52
**AI infrastructure is the new critical infrastructure**

- [Video: Luxembourg’s sovereign AI playbook for Europe](https://www.youtube.com/watch?v=0lqZpQZLGKs)

Public systems · 28:27
**Luxembourg’s sovereign AI playbook for Europe**

- [Video: Building interconnected AI for complex operations](https://www.youtube.com/watch?v=rZGW2G_CX6M)

Agents · 27:56
**Building interconnected AI for complex operations**

- [Video: Channelling the power of LLMs to unlock ancient archives](https://www.youtube.com/watch?v=H2Vnx50Oves)

Models · 28:08
**Channelling the power of LLMs to unlock ancient archives**

- [Video: Mistral robotics and physical AI](https://www.youtube.com/watch?v=qwTKCxHxakc)

Models · 14:33
**Mistral robotics and physical AI**

- [Video: Rethinking the architecture of agentic systems](https://www.youtube.com/watch?v=Q1yn6khGCBk)

Agents · 21:20
**Rethinking the architecture of agentic systems**

- [Video: Best practices for building autonomous AI workflows](https://www.youtube.com/watch?v=lluXpzkLpZo)

Agents · 20:43
**Best practices for building autonomous AI workflows**

- [Video: Advancing innovation at the European Patent Office](https://www.youtube.com/watch?v=hZQa78vKxZ4)

Public systems · 27:27
**Advancing innovation at the European Patent Office**

- [Video: The AI sovereignty paradox: Scalable ecosystems for trusted adoption](https://www.youtube.com/watch?v=xP-3iMTPav0)

Strategy · 32:05
**The AI sovereignty paradox: Scalable ecosystems for trusted adoption**

- [Video: Domain AI models fine-tuned with proprietary knowledge](https://www.youtube.com/watch?v=7evOiuXFkQo)

Models · 29:24
**Domain AI models fine-tuned with proprietary knowledge**

- [Video: Building custom code models for Ericsson proprietary silicon](https://www.youtube.com/watch?v=ArWG4pmTXPQ)

Models · 36:12
**Building custom code models for Ericsson proprietary silicon**

The practical answer
Adapt a strong open base. Preserve the data trail. Let evaluation earn the next rung.

- [Choose the intervention](#chooser)

- [Budget the programme](#planner)

- [Choose the evaluation stack](https://isaiuseful.com/benchmarks.html.md)