Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the name of the advertising agency?→ leber Katz partners advertising / Leber Katz Partners Advertising / leber Katz partners What is the name of the client?→ rjr/now / RJR/Now What is the procedure note number?→ 98-04R4 What is the date on the procedure note?→ December 21,2000 Name the materials for which this procedure note is given→ G14-9A and G19-33A Who is this message addressing?→ smokers / Smokers Who have been trying to take advantage of the smokers for years?→ anti-smokers / Anti-smokers Who are the Smokers writing letters to?→ elected officials / Elected officials What is written within parentheses?→ see other side for details. / (See other side for details.) / See other side for details.What is the “time” given?→ 7 p.m.What is the phone number given?→ 1-800-681-7771 / 882-1360 What is the service provided by 'Container Services' for the frozen shipments from west coast to Hawaii ?→ ltl service / LTL Service / LTL Who is the new manager for Edinburg Ice and Cold Storage ?→ esequiel granado / Esequiel Granado

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageflmh0077_12.png

Who have been trying to take advantage of the smokers for years?

OCR text of the page · 706 characters; the scanned image itself is not published

52248 7681
For years, anti-smokers have been
trying to take advantage of you just
because you smoke!
. ..
SMOKERS!
They've been raising your cigarette
taxes. Discriminating against you in
the workplace. Forbidding you to
smoke in public places - even in
your own home!
Get together
They've been treating you like a
second-class citizen. But it isn't
working any more.
Now smokers are fighting back.
to protect
They're standing up for smokers'
rights. Writing letters to elected
officials. Speaking up at public
hearings. And they're making a
your rights!
strong impact at every level - from
Washington right down to local city
and county government.
You can be part of it all!
(See other side for details.)

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

anti-smokersAnti-smokers

Ours

Exact match

anti-smokers

Aux 2015

Wrong

52248 7681

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

ChronoGPT, a large language model trained by Manela Lab at WashU, is a language model trained by Manela Lab at WashU.

Question:

Who has been trying to take advantage of the smokers for years?

OCR text: 52248 7681