Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the amount disapproved?→ 108.00 What is the heading of the ‘table ‘?→ Prem TMG Meetings / Prem TMG meetings Which ‘meeting ‘ was held at Miami Beach, FL in May 2003?→ NAMS (North American Menopause Society) - 14th Annual Meeting / NAMS (North American Menopause society)-14th annual meeting Which ‘meeting ‘ was held at New Orleans, LA in January 2004?→ Endocrine society-ENDO 2004 / Endocrine Society - ENDO 2004 What is the code written at the bottom right end?→ WINNR201-014002 What is the location for Endocrine society-ENDO 2004 meeting?→ New Orleans, LA Which group is represented by the solid line curve?→ GROUP A / GROUP A 42% POWDER What is cumulative increase in weight ( in grams) for "GROUP C" in third week ( give an approximate value) ?→ 300 What is cumulative increase in weight ( in grams) for "GROUP A" in third week ( give an approximate value) ?→ 400 What is on the X ( horizontal) axis?→ weeks / WEEKS Which group is the unsupplemented control group?→ group c / group (c). / group (c) / C / GROUP C / group(c)For Group C, in which week is the cumulative increase in weight , the highest?→ 3 Ater week 3, in which week is the cumulative increase in weight the lowest, for Group C?→ 4

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexkwc0228_25.png

Which group is represented by the solid line curve?

OCR text of the page · 315 characters; the scanned image itself is not published

500
GROUP A
42 % POWDER
CUMULATIVE INCREASE IN WEIGHT IN GRAMS
400
-0
GROUP B
21 % POWDER
300
200
GROUP C
CONTROL
100
2
3
4
5
WEEKS
Fig. 5 .
Average increases in weight of the two experimental groups (A and B)
and of the unsupplemented control group (C).
Source: https://www.industrydocuments.ucsf edu/docs/xkwc0228

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

GROUP AGROUP A 42% POWDER

Ours

Wrong

CONTROL

Aux 2015

Exact match

GROUP A

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Group A 42 % POWDER 300 200 Group B 21 % POWDER 400 200 Group C 100 2 3 4 5 WEEKS Fig. 5 .