From Hacker News
Show HN: Automatic deduction of FlashAttention kernel from ~25 lines of SQL
In this demo, we automatically deduce a FlashAttention kernel with ~25 lines of SQL, which just expresses vanilla attention. This is possible due to three portable SQL extensions that we’re building:...