Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageflmh0077_34.png

What is the phone number given?

OCR text of the page · 503 characters; the scanned image itself is not published
2130- 4147
HUNTSVILLE CHAPTER
OF
LABAMA
SMOKERS' RIGHTS, INC.
We're new in town. Come join
us! Please mark your calendars
and plan to attend!
When: The Ist Tuesday of every month
Where:
American Legion Post #176
Corner of Long Ave. and Triana Blvd.
(One block north of Bob Wallace Ave.)
Time: 7 p.m.
NOTE: If American Legion door is locked, ring bell and tell them
you are attending smokers' rights meeting.
For more information about smokers' rights,
call 1-800-681-7771, or locally 882-1360
52248 7703
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
1-800-681-7771882-1360
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

1-800-681-7771, or locally 882-1360

35 characters27 tokens

Aux 2015

Wrong

2130-4147

9 characters10 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

I am a language model trained by Manela Lab at WashU.

Instruction:

You are a language model trained by Manela Lab at WashU.

Question:

What is the phone number given?

OCR text: 2130- 4147 HUNTSVILLE

208 characters64 tokens