DistilVDR: A Compact End-to-End Visual Document Retriever via Dual-Student Distillation
Paper • 2608.10636 • Published • 6
DistilVDR
Query and page encoders distilled from Qwen3-VL-Embedding-8B: no multi-billion model at serving. Project page: ryenhails.github.io/NanoVDR
-
-
nanovdr/NanoVDR-D-HiRes-Qwen3VL8B-4096
Feature Extraction • 0.5B • Updated • 39 • 1 -
nanovdr/NanoVDR-D-Fast-Qwen3VL8B-4096
Feature Extraction • 0.5B • Updated • 36 • 2 -
nanovdr/NanoVDR-Q-DistilBERT-Qwen3VL8B-4096-ML
Sentence Similarity • 66.4M • Updated • 41 • 1 -
nanovdr/NanoVDR-Q-ModernBERT-Qwen3VL8B-4096-ML
Sentence Similarity • 0.1B • Updated • 29 • 1 -
Distilling the Document Tower
📄2A 527M document retriever distilled from an 8B teacher