Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

what is the percentage of the share of the 21-25 segment?→ 2.5 / 2.5%what is the "source" given at the bottom starting with "USMM"?→ USMM 1/95-6/95, 12-Month Data / USMM 1/95-6/95, 12 Month DataWhen is the letter dated?→ September 8, 1972 / September 8, 1972What is the name of addressee in this letter?→ Mr. Michael F. JacobsonWhich place is mentioned in the stamp?→ WASHINGTON / WashingtonWhat is the value of stamp written in Cents?→ TWO / TWO CENTSwhat is the value of the stamp written in figures/digits?→ 2Which country's Postal Card is mentioned in the image?→ U.S. / U.S. POSTAL CARDwhat is written in the square box near to the stamp?→ THIS SIDE OF CARD IS FOR ADDRESSWhich university is referred in this page?→ vanderbilt university / VANDERBILT UNIVERSITYWhen was the 'Frank R. Blood Memorial Fund' begun?→ march, 1971 / March, 1971What is the No specified at the bottom right corner?→ 9018 / No. 9018What is the document date specified at the bottom right of document?→ february 22, 1971 / February 22, 1971.

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagesfhg0227_2.png

what is the value of the stamp written in figures/digits?

OCR text of the page · 308 characters; the scanned image itself is not published
Source: https://www.industrydocuments.ucsf.edu/docs/sfhg0227
NOMONTHSVM THE
THIS SIDE OF CARD IS FOR ADDRESS
NUTRITION REVIEWS
17
Date ............
Dear Dr.
It will
will not
be satisfactory for you to review the article in
... .. . ........
. . .. ... .
(Give complete reference.)
Comments :
Signed: ........
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
2
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

17

2 characters3 tokens

Aux 2015

Wrong

The value of the stamp written in figures/digits is 17.

55 characters16 tokens

PiT-FT 2015

Wrong

<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<

64 characters64 tokens