ModelsArchitectures & capability
Perplexity releases open pplx-embed-v2-late multimodal retrievers, with its 0.6B model topping the previous best on Q2D-Web
Perplexity has open-sourced two late-interaction retrievers, at 0.6B and 9B parameters, that search text, images and rendered PDF pages without OCR. They share one embedding space, letting a cheap small model query an index built by the larger one.
From the r/AISEOInsider (via last30days) article of October 13, 2026 and cited sources: pplx-embed-v2-late consists of two MIT-licensed, ColBERT-style models built on Qwen3.5. [4] [8] [3]
SOURCES[4] Perplexity blog: Multimodal embeddings beyond a single… perplexity.ai[8] Hugging Face: pplx-embed-v2-late-0.6b huggingface.co[3] Linked video: The Small Perplexity AI Embedding Model Beat… youtube.com
AT Pulse research deskPublished · Updated · 4 min read · AI-assisted analysisAI-assisted, not human-edited. Methodology Corrections Who owns this site
- What happened
- pplx-embed-v2-late consists of two MIT-licensed, ColBERT-style models built on Qwen3.5. [4] [8] [3]
- Original source
- r/AISEOInsider (via last30days) article, independent perspective
- Brief by
- AT Pulse research desk AI-assisted; publisher and contact on the desk page
- When
- October 13, 2026 article published
- Covered
- Oct 13 edition
- Evidence
- 15 sources across 13 sites
- 1The Small Perplexity AI Embedding Model Beat the Old Bestreddit.com
- 2Perplexity Just Dropped Its New Embedding Modelsreddit.com
- 3Linked video: The Small Perplexity AI Embedding Model Beat…youtube.com
- 4Perplexity blog: Multimodal embeddings beyond a single…perplexity.ai
- 5DataNorthdatanorth.ai
- 6Perplexity Research: pplx-embed v1research.perplexity.ai
RisingHow it’s measured
YouTube video · 2.5K views · 14 likes
Reach blends public engagement (views, likes, comments, shares, stars) from the platforms where the story or its original source lives: YouTube, Hacker News, GitHub, Substack and similar. A video and the article written from its transcript share one score, taken from the video. Platforms with no data are left out rather than counted as zero, and the age of a story never lowers its score.
pplx-embed-v2-late consists of two MIT-licensed, ColBERT-style models built on Qwen3.5. Instead of compressing a document into one vector, they produce a 128-dimensional vector for each token and score matches with MaxSim. Rendered PDF pages are embedded directly as images, which removes the OCR and chunking steps. [4] [8] [3]
Both models were distilled from the same internal 18B teacher, so they share an embedding space. In Perplexity's tests, building the index with the 9B model and serving queries with the 0.6B raised text retrieval by 1.6 points on average and ViDoRe v3 from 62.3% to 63.5%, compared with using the small model for both. [4] [3]
The scores are Perplexity's own. On Q2D-Web Recall@1000, the 0.6B model, with about 240M parameters active for text, scored 73.6% against a prior best of 69.3%. On MADQA, the 9B scored 92.4%, ahead of a Mixedbread retriever at 88.9% but behind Mixedbread Agentic Search at 93.4%. The 9B also trails EVIE on ViDoRe v3. [4] [5] [3]
open checkpoints and reported gains on document QA and web retrieval. Implication: teams could index with the 9B and serve queries on-premises with the 0.6B, if their vector database supports multi-vector storage and MaxSim scoring.
Executive brief
Perplexity's smaller retriever, at 0.6B parameters, scored 73.6% Recall@1000 on Perplexity's Q2D-Web test. That beats the previous best of 69.3%, and only about 240M parameters are active when it encodes text (Perplexity blog). The release is called pplx-embed-v2-late. It contains two open MIT-licensed models that search text, images and rendered PDF pages without OCR. Both share one embedding space, so the small model can query an index built by the 9B model. The full technical report is due later in 2026, and no independent replication has been published yet (DataNorth).
Read the full section
Perplexity's smaller retriever, at 0.6B parameters, scored 73.6% Recall@1000 on Perplexity's Q2D-Web test. That beats the previous best of 69.3%, and only about 240M parameters are active when it encodes text (Perplexity blog). The release is called pplx-embed-v2-late. It contains two open MIT-licensed models that search text, images and rendered PDF pages without OCR. Both share one embedding space, so the small model can query an index built by the 9B model. Every headline number comes from Perplexity. The full technical report is due later in 2026, and no independent replication has been published yet (DataNorth).
What changed and event timeline
Text-only predecessor ships
Perplexity released pplx-embed-v1 and context-v1 at 0.6B and 4B sizes. These were dense, single-vector text models with INT8 and binary outputs ().
Pplx-embed-v2-late released
Two late-interaction multimodal models, 0.6B and 9B, went up on Hugging Face under MIT with a shared embedding space (;).
Trade press repeats the vendor numbers
Coverage led with the 9B model's 92.4% on MADQA and the 0.6B's edge-device positioning (;).
Commentary video and Reddit post
A video from the AI-avatar channel of Julian Goldie's SEO agency explains late interaction and the "small model beat the old best" framing, mixed with promotion for a paid community (;).
Capabilities and access
- Models:
perplexity-ai/pplx-embed-v2-late-0.6b(594M total; about 240M active for text, about 340M for images) andpplx-embed-v2-late-9b(7.4B active) (Perplexity blog; LLM Reference). - Inputs: text, images and rendered pages. A single input cannot mix text and images (Hugging Face).
- Requirements: sentence-transformers ≥6.0.0 and transformers ≥5.4.0. The 9B model needs roughly 16–18 GB of GPU memory (DataNorth).
Read the full section
- Models:
perplexity-ai/pplx-embed-v2-late-0.6b(594M total; about 240M active for text, about 340M for images) andpplx-embed-v2-late-9b(7.4B active) (Perplexity blog; LLM Reference). - Inputs: text, images and rendered pages. A single input cannot mix text and images (Hugging Face).
- Requirements: sentence-transformers ≥6.0.0 and transformers ≥5.4.0. The 9B model needs roughly 16–18 GB of GPU memory (DataNorth).
- API: a hosted API is planned, with no date or price announced.
Technical analysis for researchers and developers
- Architecture: a ColBERT-style retriever built on Qwen3.5 with bidirectional attention. It outputs one 128-dimensional vector per token and scores documents with MaxSim.
- Training: both models were distilled from an internal 18B ColBERT teacher using LEAF-style token-level objectives.
- Evaluation: Q2D-Web uses about 70k agent-reformulated production queries over 190M documents. That makes it internal and impossible to reproduce.
Read the full section
- Architecture: a ColBERT-style retriever built on Qwen3.5 with bidirectional attention. It outputs one 128-dimensional vector per token and scores documents with MaxSim. To build the 0.6B, Perplexity cut Qwen3.5-0.8B's 24-layer text tower down to 12 layers (Perplexity blog).
- Training: both models were distilled from an internal 18B ColBERT teacher using LEAF-style token-level objectives. Sharing a teacher is what gives the two models a common embedding space. The data was 186M pairs from 594 datasets in 46 languages, about 88% text-to-text, with benchmark datasets excluded.
- Evaluation: Q2D-Web uses about 70k agent-reformulated production queries over 190M documents. That makes it internal and impossible to reproduce. MADQA and BrowseComp+ scores depend on the agent paired with the retriever: Gemini 3.5 Flash for MADQA and GPT-OSS-120B for BrowseComp+.
Claims and evidence
- Q2D-Web: 74.8% (9B) and 73.6% (0.6B) against a prior best of 69.3% (blog; video).
- MADQA: 92.4% (9B) and 90.1% (0.6B), versus 88.9% for a Mixedbread retriever. Mixedbread Agentic Search scores higher, at 93.4% (blog).
- BrowseComp+: 64.0% for the 9B, 4.9 points ahead of the next-best ColBERT model and 8.7 points ahead of the next-best dense model (video).
Read the full section
- Q2D-Web: 74.8% (9B) and 73.6% (0.6B) against a prior best of 69.3% (blog; video). The benchmark is internal, so the "beat the old best" headline cannot be checked externally.
- MADQA: 92.4% (9B) and 90.1% (0.6B), versus 88.9% for a Mixedbread retriever. Mixedbread Agentic Search scores higher, at 93.4% (blog). The video mentions only the 3.5-point lead (video).
- BrowseComp+: 64.0% for the 9B, 4.9 points ahead of the next-best ColBERT model and 8.7 points ahead of the next-best dense model (video).
- Asymmetric indexing: pairing a 9B index with 0.6B queries raised ViDoRe v3 from 62.3% to 63.5% and text scores by 1.6 points on average (video).
Context and prior work
- Predecessor: v1 was dense and text-only, with 1024- and 2560-dimension vectors from mean pooling (Perplexity Research).
- Competing open late-interaction work: NVIDIA's Nemotron ColEmbed V2 for visual documents (arXiv) and the LateOn/DenseOn models (arXiv).
- Vector size: Perplexity's 128-dimension token vectors are smaller than the 2,048–4,096 dimensions used by some vision retrievers (AlphaSignal).
Limitations, safety and contested findings
- Not the visual-retrieval leader: the 9B's 65.2% on ViDoRe v3 trails EVIE (DataNorth).
- Storage and serving cost: multi-vector storage and scoring cost more than single-vector retrieval and grow with document length (blog).
- Input quality still matters: pages must still be rendered to images, and results are sensitive to resolution and scan quality (AlphaSignal).
Read the full section
- Not the visual-retrieval leader: the 9B's 65.2% on ViDoRe v3 trails EVIE (DataNorth).
- Storage and serving cost: multi-vector storage and scoring cost more than single-vector retrieval and grow with document length (blog).
- Input quality still matters: pages must still be rendered to images, and results are sensitive to resolution and scan quality (AlphaSignal).
- Language gaps: coverage is limited to 46 languages, and Dutch is not listed.
- Commentary bias: the commentary video is largely a pitch for the creator's paid community (video).
Business and practitioner implications
- Index once, query cheaply: building the index with the 9B and serving queries with the 0.6B splits cost sensibly, because indexing happens rarely and queries happen constantly.
- On-premises fit: MIT licensing and the small query model suit organizations that cannot send documents to an outside service (DataNorth).
- Infrastructure check: confirm your vector database supports multi-vector storage and MaxSim before you migrate (i10x).
Read the full section
- Index once, query cheaply: building the index with the 9B and serving queries with the 0.6B splits cost sensibly, because indexing happens rarely and queries happen constantly.
- On-premises fit: MIT licensing and the small query model suit organizations that cannot send documents to an outside service (DataNorth).
- Infrastructure check: confirm your vector database supports multi-vector storage and MaxSim before you migrate (i10x).
- Test before adopting: run it on your own PDFs, especially tables and scans. All published scores come from Perplexity, though the open checkpoints make your own testing possible (AI Weekly).
The source trail.
Sources (15)
The Small Perplexity AI Embedding Model Beat the Old Best
Feed excerpt only. A transcript of the video linked from this page is supplied (linked video auto captions; https://www.youtube.com/watch?v=J3QsCAiIvOY); automatic text may contain errors.
reddit.comPerplexity Just Dropped Its New Embedding Models
Related coverage; assess separately
reddit.comLinked video: The Small Perplexity AI Embedding Model Beat the Old Best
linked video auto captions
www.youtube.com