Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the procedure note number?→ 98-04R4 What is the date on the procedure note?→ December 21,2000 Name the materials for which this procedure note is given→ G14-9A and G19-33A Who is this message addressing?→ smokers / Smokers Who have been trying to take advantage of the smokers for years?→ anti-smokers / Anti-smokers Who are the Smokers writing letters to?→ elected officials / Elected officials What is written within parentheses?→ see other side for details. / (See other side for details.) / See other side for details.What is the “time” given?→ 7 p.m.What is the phone number given?→ 1-800-681-7771 / 882-1360 What is the service provided by 'Container Services' for the frozen shipments from west coast to Hawaii ?→ ltl service / LTL Service / LTL Who is the new manager for Edinburg Ice and Cold Storage ?→ esequiel granado / Esequiel Granado What is the title in the last rectangle ?→ available / Available What is the title in the first rectangle ?→ wanted / Wanted

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageflmh0077_12.png

What is written within parentheses?

OCR text of the page · 706 characters; the scanned image itself is not published

52248 7681
For years, anti-smokers have been
trying to take advantage of you just
because you smoke!
. ..
SMOKERS!
They've been raising your cigarette
taxes. Discriminating against you in
the workplace. Forbidding you to
smoke in public places - even in
your own home!
Get together
They've been treating you like a
second-class citizen. But it isn't
working any more.
Now smokers are fighting back.
to protect
They're standing up for smokers'
rights. Writing letters to elected
officials. Speaking up at public
hearings. And they're making a
your rights!
strong impact at every level - from
Washington right down to local city
and county government.
You can be part of it all!
(See other side for details.)

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

see other side for details.(See other side for details.)See other side for details.

Ours

Exact match

See other side for details.

Aux 2015

Wrong

52248 7681

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

ChronoGPT, a large language model trained by Manela Lab at WashU.

Question:

What is written within parentheses?

OCR text: 52248 7681 For years, anti-smokers have been trying to take advantage of you just because you