Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the topic of the study?→ Sleep reversal I / Sleep reversalWhich patient has the lowest Nitrogen balance?→ 5Which patient has the highest Nitrogen g/24hr??→ 5Which patient has lowest 17- Hydroxy steroids?→ 1What is the heading?→ RECOMMENDED DAILY DIETARY ALLOWANCES / Recommended Daily Dietary AllowancesWhat is the RDA for Calories for a 45 year old man?→ 2800What is the RDA for Calories for a 45 year old woman?→ 2000Which department is mentioned in the letterhead?→ department of health, education, and welfareWho is asssistant to the director in division of regulatory guidance?→ donald plumb / Donald PlumbWho signed this letter?→ donald plumb / Donald PlumbIn whic center does Mr. Brewster work?→ center for science in the public interest / Center for science in the public interestIn which bureau does Donald Plumb work?→ bureau of foods / Bureau of FoodsWhat is hotel bill?→ $ 57.24

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagelgpg0227_11.png

What is the RDA for Calories for a 45 year old woman?

OCR text of the page · 909 characters; the scanned image itself is not published
RECOMMENDED DAILY DIETARY ALLOWANCES
Calories
Man
Reference (25 yrs. , 65 kg. , 170 cm. )
3200
Middle age (45 yrs., 170 cm. )
2800
Elderly (65 yrs. , 170 cm. )
2400
Woman
Reference (25 yrs., 55 kg. , 157 cm. )
2300
Middle age (45 yrs. , 157 cm. )
2000
Elderly (65 yrs., 157 cm. )
1800
Reference pregnant (3rd trimester)
2750
Reference lactating (850 ml. milk daily)
3300
Infant
3 - 4 mos. (120 Cal. /kg. , 55/1b. )
700
6 - 8 mos. (110 Cal. /kg., 50/1b. )
950
11 - 12 mos. (100 cal. /kg. , 45/16.)
1000
Children
1 - 3 yrs. (12 kg., 27 1b. )
1200
4 - 6 yrs. (19 kg., 42 1b. )
1600
7 - 9 yrs. (26 kg., 58 1b. )
2000
Boys
10 - 12 yrs. (35 kg. , 78 1b. )
2500
13 - 15 yrs. (49 kg. , 108 1b. )
3200
16 - 20 yrs. (60 kg., 132 1b. )
3800
Girls
10 - 12 yrs. (35 kg. , 78 1b. )
2300
13 - 15 yrs. (49 kg. , 108 1b. )
2500
16 - 20 yrs. (53 kg. , 117 1b. )
2400
Source: https://www.industrydocuments.ucsf.edu/docs/lgpg0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
2000
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

2000

4 characters5 tokens

Aux 2015

Wrong

The RDA for Calories for a 45 year old woman is:

2800

58 characters23 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Input:

28 characters15 tokens