From Dev.to
AI Embeddings Break Columnar Assumptions in Parquet and Arrow
TL;DR — Columnar engines like DuckDB and Arrow assume you scan a few columns and filter on values. An embedding column violates every one of those assumptions: it is wide, high-entropy, never filtered...