ColBERT-Zero: To Pre-train Or Not To Pre-train ColBERT models
Paper
• 2602.16609 • Published
• 6
ColBERT-Zero 🐶
First large-scale fully pre-trained ColBERT model using only public data, outperforming GTE-ModernColBERT and GTE-ModernBERT
-
-
lightonai/ColBERT-Zero
Sentence Similarity • 0.1B • Updated • 3.17k • 32 -
lightonai/ColBERT-Zero-supervised
Sentence Similarity • 0.1B • Updated • 521 • 3 -
lightonai/ColBERT-Zero-unsupervised
Sentence Similarity • 0.1B • Updated • 1.39k • 1 -
lightonai/ModernColBERT-embed-base
Sentence Similarity • 0.1B • Updated • 24 -
lightonai/ModernColBERT-embed-base-supervised
Sentence Similarity • 0.1B • Updated • 30 -
lightonai/ModernColBERT-embed-base-kd-only
Sentence Similarity • 0.1B • Updated • 43 • 1 -
lightonai/ColBERT-Zero-noprompts
Sentence Similarity • 0.1B • Updated • 49 • 2 -
lightonai/ColBERT-Zero-supervised-noprompts
Sentence Similarity • 0.1B • Updated • 27 -
lightonai/ColBERT-Zero-unsupervised-noprompts
Sentence Similarity • 0.1B • Updated • 31