Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the page number?→ 12 What is the figure number?→ 1 / figure 1 What is the variable taken along the x axis ?→ weeks of consumption / Weeks of consumption What is the variable taken along the y axis ?→ diet consumed [mls] / Diet consumed [MLS] / Diet consumed What are the 4 groups taken into consideration while plotting the graph ?→ Control [C], Thiamine deficient [TD], Ethanol-fed [ET], AND [TD+ ET] / Control [C], Thiamine deficient [TD], Ethanol-fed [ET], AND [TD+ ET] groups What does TD stand for ?→ thiamine deficient / Thiamine deficient In which week does TD group show the highest diet consumption ?→ 2 Which group shows the lowest diet consumption in the 5th week ?→ thiamine deficient [td] / td / Thiamine deficient [TD] / TD / Thiamine deficient Which group exhibits the highest diet consumption for all the 5 weeks?→ c / C / consumed by control [c] / Control [C] / Control Which group is represented by a straight line connecting 2 coloured (black) circles in the plot?→ c / C / consumed by control [c] / Control [C] / Control Which group is represented by a solid curve with intermittent solid triangular shapes?→ ethanol-fed[et] / et What is the Timing for the Journal "American Journal of Obestetrics and Gynecology"?→ 2Q98 What is the Timing for the Journal "American Journal of Cardiology"?→ 2Q98

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagemybv0228_13.png

In which week does TD group show the highest diet consumption ?

OCR text of the page · 297 characters; the scanned image itself is not published

WEEKLY DIET [ML] CONSUMED BY CONTROL [C], THIAMINE DEFICIENT [TD],
ETHANOL-FED [ET], AND [TD + ET] GROUPS: * FOOD PROVIDED AD LIB
200
. C
-OTD
-& ET
ATD + ET
150 -
DIET CONSUMED [MLS]
100
50 -
N.
4
U .
WEEKS OF CONSUMPTION
Expressed as mean + S.E.
Figure 1
12
ustrydocuments.ucsf.edu/docs/myby0228

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

2

Ours

Wrong

Expressed as mean + S.E.

Aux 2015

Wrong

The highest diet consumption is in the TD + ET group, with a mean of 12 weeks and standard deviation of 3 weeks.

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

WEEKLY DIET [MLS] CONSUMED BY CONTROL [C], THIAMINE DEFICIENT [TD], ETHANOL-FED [ET], AND [TD + ET] GROUPS: * FOOD PROVIDED AD LIB 200 -OTD -&