From Dev.to
Ship AI features inside a hard latency budget
Superhuman's full drafting call will not finish inside a 100 millisecond interaction budget. That budget is the immediate UI response, and completed generation is separate. Prefetch context that does...