From Dev.to
From five broken transformers versions to 4.45 seconds on the board: getting Qwen2-VL-2B's vision tower onto an RK3588
Two days ago this model wouldn't even export. Today its vision tower runs on a real RK3588 board: a 392×392 image encoded in 4,445.68 ms (median of three independent processes), model load about 7.3 s...