Guardrails (garde-fous d'un système LLM)

The controls placed around the model to stop an unacceptable output from reaching production: input filtering, output validation against a schema, refusal of out-of-scope topics, prompt injection detection. The model is not its own guardrail: the layer around it decides what passes and what gets blocked.

Strengths

• Lives in your code, therefore out of reach of a prompt injection
• Schema validation also catches format errors, not just abuse

Limitations

• Too many controls and the system refuses legitimate requests: tuning is paid in false positives

Best for

• Framing a production agent whose output is read by users

Official site

View on Coeurdar