From Dev.to
Structured Output Doesn't Validate LLMs. It Resamples Them
TL;DR — Constrained decoding for structured output (JSON mode, grammar-based function calling) doesn't just check a model's answer — it rewrites the model's token-by-token probability distribution in...