Papers
arxiv:2607.05382

Search Beyond What Can Be Taught: Evolving the Knowledge Boundary in Agentic Visual Generation

Published on Jul 9
ยท Submitted by
Cong Wei
on Jul 15
Authors:
,
,
,
,
,
,
,
,
,
,

Abstract

Visual generators excel at rendering, but they confidently fabricate what they do not know. User requests are unbounded, evolving, and deeply long-tailed: new characters, trending entities, post-cutoff events, and more. This world-knowledge bottleneck is structural: generators are trained on fixed corpora, but the visual world is open-ended. We construct SearchGen-20K and SearchGen-Bench, with 20,839 prompts spanning twelve failure categories and twenty-two domains, paired with a pre-executed multimodal SearchGen-Corpus-1M to support offline, reproducible research. On SearchGen-Bench, frontier open generators score only 21 to 28 out of 100, a 40-point collapse invisible to existing benchmarks. The natural remedy is to employ search tools, enabling agentic visual generation. However, we find that naive search fails: it retrieves indiscriminately, injecting noise into prompts the generator already handles. We trace the root cause to a generator-specific, evolving knowledge boundary: the divide between what a generator can internalize through training and what must remain in external context. Although this boundary is hard to specify in advance, we show that it is discoverable through a teach-then-search co-training framework. Even a minimal version of this co-training recipe produces monotonic improvement, laying the foundation for recursive self-improvement in visual generation that can meet world-knowledge-grounded requests. We release the full dataset, co-training corpus, and search corpus as a replayable harness for tool-augmented, world-knowledge-grounded visual generation.

Community

Paper submitter

We introduce SearchGen, a search-augmented image generation framework. We argue that, rather than merely rewriting prompts, an LLM agent should actively search for and organize multimodal context to help the generator produce more accurate and informed images. We provide a live demo, a simple yet challenging benchmark that evaluates whether AI agents can find information useful for generation, a reproducible local search corpus, and the complete training dataset.

๐Ÿš€๐Ÿš€๐Ÿš€ Have Fun With Our Live Demo
๐Ÿš€๐Ÿš€๐Ÿš€ Read Our Project Blog

Paper submitter

examples

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2607.05382
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2607.05382 in a model README.md to link it from this page.

Datasets citing this paper 3

Spaces citing this paper 1

Collections including this paper 1