Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefpdp0080_1.png

Who are invited for the TAKE THE SMOOTH CHALLENGE?

OCR text of the page · 369 characters; the scanned image itself is not published
An invitation to Marlboro smokers:
TAKE
THE SMOOTH
CHALLENGE.
A Flares Seal"
Winston
SELECT
BOX
SPLETI SMOOTH FASIA
29. .. 7.. ...
YOU SELECT
SELECT
The Smooth One
From Winston
50913 9354
18 ma "lar". Id me nicotine as co cigarene ty FIC method
SURGEON GENERAL'S WARNING: Quitting Smoking
Now Greatly Reduces, Serious Risks to Your Health.
: 1395 8 ) REYNOLDS 10MACCOCO
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Marlboro smokers
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Marlboro smokers

16 characters5 tokens

Aux 2015

Wrong

The invitation is to Marlboro smokers: TAKE THE SMOOTH CHALLENGE. A Flares Seal" Winston SELECT BOX SPLETI SMOOTH FASIA 29. .. 7.. ... YOU SELECT SELECT The Smooth One From Winston 50

183 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters1 tokens

ChronoGPT 2015

Wrong

ChronoGPT

Instruction:

You are ChronoGPT, a large language model trained by Manela Lab at WashU.

In the world of ChronoGPT, the world is a vast, chaotic, and chaotic. The world is a world of chaos, chaos, and

214 characters64 tokens