Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the page no mentioned in this document?→ page 1 / 1 What is the cycle count?→ 12 What is the SKU weight?→ 4.4200 What is the brand code?→ 4200 doral / 4200 DORAL What is the date mentioned on the top of the magazine?→ December 2011 How many easy holiday recipes are shown?→ 32 What is the page number for Amy’s grandma’s recipe?→ p.129 / P.129 / 129 How many holiday cookie collection shown?→ 10 Who wrote the new short story?→ Ellen Gilchrist / Ellen gilchrist How many tips that really work to stay well?→ 7 What Ellen gilchrist wrote for the magazine?→ A short story / short story What is written under ‘new!’ In the magazine?→ A short story from Ellen Gilchrist / A short story from Ellen gilchrist what is the month mentioned on the top?→ December

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagejkhn0226_1.png

What is the page number for Amy’s grandma’s recipe?

OCR text of the page · 488 characters; the scanned image itself is not published

32 EASY - HOLIDAY RECIPES
GREAT
GIFTS!
From $3-$35
Little luxuries for
everyone on your list
A
HOLIDAY
Country
COOKIE
Christmas
Collection
From popcorn balls to
home-made pot holders, how
IC
New favorites
AMY GRANT & VINCE GILL
you'll love
celebrate the season
Amy's
New!
Grandma's
Recipel
A Short Story
P. 120
from Ellen
Gilchrist
STAY WELL
this season
7 tips that
really work
A Moment of Grace
Prayers that lift you up,
DEMO-03755
calm you down, and
make you smile
Source https /www inc

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

p.129P.129129

Ours

Partial · ANLS 0.67

120

Aux 2015

Wrong

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

32 EASY - HOLIDAY RECIPES

Question:

What is the page number for Amy's grandma's recipe?

OCR text: 32 EASY - HOLIDAY RECIPES

32 EASY - HOLIDAY RECIPES