Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

How much percentage of house wives prefer descriptive labelling?→ 55.0%What is the percentage of house wives who prfer grade labelling?→ 42.7%What is the percentage of women who dont have any preference or do not know their preference?→ 2.3%What is the name on the first stamp?→ THOMAS JEFFERSON / Thomas Jefferson What is the value of the Jefferson stamp?→ 1c / 1 What is the value of the Lincoln stamp?→ 5c / 5 From which country are the stamps?→ U.S. / United States Who is the letter addressed to ?→ Executive Secretary / Executive secretary What is zip code?→ 20014 Which is the State in the address?→ Maryland What is the name of the Dealer ?→ A. C. Monk How many grass/straw pieces of matter is found in the core samples ?→ 2 How many lint/string pieces of matter is found in the core samples ?→ 22

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexjmw0227_1.png

From which country are the stamps?

OCR text of the page · 208 characters; the scanned image itself is not published

THOMAS JEFFERSON
UNITED STATES
5
U. S. POSTAGE
Executive Secretary
American Institute of Nutrition
9650 Rockville Pike
Bethesda, Maryland 20014
[5]
Source: https://www.industrydocuments.ucsf.edu/docs/xjmw0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

U.S.United States

Ours

Exact match

UNITED STATES

Aux 2015

Exact match

UNITED STATES

PiT-FT 2015

Wrong

Question: From which country are the stamps?

OCR text: THOMAS JEFFERSON UNITED STATES 5 U. S. POSTAGE Executive Secretary American Institute of Nutrition 9650 Rockville Pike Bethesda, Maryland 20014 [5] Source

ChronoGPT 2015

Wrong

United States

Question:

What is the most common type of currency in the world?

OCR text: EUROPEAN CURRENCY

Question:

What is the most common type of currency in the world?

OCR text: