jithinjames/iol-ai-2026-solver
Text Generation • 15B • Updated • 78
Jithin James
jithinjames
AI & ML interests
None yet
Recent Activity
updated a model about 7 hours ago
jithinjames/iol-ai-2026-solver liked a Space about 23 hours ago
iol-ai-challenge/iol-ai-2026 published a model 1 day ago
jithinjames/iol-ai-2026-solverOrganizations
updated a
model about 7 hours ago
liked a
Space about 23 hours ago
published a
model 1 day ago
liked a
Space over 1 year ago
upvoted an article almost 2 years ago
Article
Document Similarity Search with ColPali
fsommers
• • 52 reacted to merve's post with 🔥 almost 2 years ago
Post
3939
If you have documents that do not only have text and you're doing retrieval or RAG (using OCR and LLMs), give it up and give ColPali and vision language models a try 🤗
Why? Documents consist of multiple modalities: layout, table, text, chart, images. Document processing pipelines often consist of multiple models and they're immensely brittle and slow. 🥲
How? ColPali is a ColBERT-like document retrieval model built on PaliGemma, it operates over image patches directly, and indexing takes far less time with more accuracy. You can use it for retrieval, and if you want to do retrieval augmented generation, find the closest document, and do not process it, give it directly to a VLM like Qwen2-VL (as image input) and give your text query. 🤝
This is much faster + you do not lose out on any information + much easier to maintain too! 🥳
Multimodal RAG merve/multimodal-rag-66d97602e781122aae0a5139 💬
Document AI (made it way before, for folks who want structured input/output and can fine-tune a model) merve/awesome-document-ai-65ef1cdc2e97ef9cc85c898e 📖
Why? Documents consist of multiple modalities: layout, table, text, chart, images. Document processing pipelines often consist of multiple models and they're immensely brittle and slow. 🥲
How? ColPali is a ColBERT-like document retrieval model built on PaliGemma, it operates over image patches directly, and indexing takes far less time with more accuracy. You can use it for retrieval, and if you want to do retrieval augmented generation, find the closest document, and do not process it, give it directly to a VLM like Qwen2-VL (as image input) and give your text query. 🤝
This is much faster + you do not lose out on any information + much easier to maintain too! 🥳
Multimodal RAG merve/multimodal-rag-66d97602e781122aae0a5139 💬
Document AI (made it way before, for folks who want structured input/output and can fine-tune a model) merve/awesome-document-ai-65ef1cdc2e97ef9cc85c898e 📖
- 2 replies
upvoted an article almost 2 years ago
Article
ColPali: Efficient Document Retrieval with Vision Language Models 👀
manu
• • 324 liked a
Space almost 2 years ago
upvoted an article almost 2 years ago
Article
MTEB: Massive Text Embedding Benchmark
Muennighoff
• • 95 liked a
Space over 2 years ago
liked a
Space about 3 years ago
liked 4
models about 3 years ago
liked a
Space about 3 years ago
liked 4
models about 3 years ago
impira/layoutlm-document-qa
Document Question Answering • 0.1B • Updated • 25k • 1.18k
naver-clova-ix/donut-base-finetuned-cord-v2
Image-to-Text • Updated • 27.8k • 121
naver-clova-ix/donut-base-finetuned-docvqa
Document Question Answering • Updated • 62.4k • 280
naver-clova-ix/donut-base
Image-to-Text • Updated • 65.7k • 254