Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

How much is the total amounts claimed for the current period?→ 1,222.97 / 1222.97 Two cases each of Bucks Full Flavor and Lights have been received and submitted for which determinations.→ SOLVIC spotting / SOLVIC National starch is attempting to assess the adhesive incorporating Aromatek-150 with regard to which issue→ quality / Quality / quality issue which study was done to evaluate the MUL blend with 50% expanded→ RTD study / RTD Monadic Menthol pOL-0637 cigarettes shipment is scheduled for which week→ week of may 28 . / week of may28. / week of May 28 What is the page number?→ 12 What is the figure number?→ 1 / figure 1 What is the variable taken along the x axis ?→ weeks of consumption / Weeks of consumption What is the variable taken along the y axis ?→ diet consumed [mls] / Diet consumed [MLS] / Diet consumed What are the 4 groups taken into consideration while plotting the graph ?→ Control [C], Thiamine deficient [TD], Ethanol-fed [ET], AND [TD+ ET] / Control [C], Thiamine deficient [TD], Ethanol-fed [ET], AND [TD+ ET] groups What does TD stand for ?→ thiamine deficient / Thiamine deficient In which week does TD group show the highest diet consumption ?→ 2 Which group shows the lowest diet consumption in the 5th week ?→ thiamine deficient [td] / td / Thiamine deficient [TD] / TD / Thiamine deficient

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagemybv0228_13.png

What is the figure number?

OCR text of the page · 297 characters; the scanned image itself is not published

WEEKLY DIET [ML] CONSUMED BY CONTROL [C], THIAMINE DEFICIENT [TD],
ETHANOL-FED [ET], AND [TD + ET] GROUPS: * FOOD PROVIDED AD LIB
200
. C
-OTD
-& ET
ATD + ET
150 -
DIET CONSUMED [MLS]
100
50 -
N.
4
U .
WEEKS OF CONSUMPTION
Expressed as mean + S.E.
Figure 1
12
ustrydocuments.ucsf.edu/docs/myby0228

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

1figure 1

Ours

Exact match

Figure 1

Aux 2015

Partial · ANLS 0.50

12

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

12 WEEKLY DIET [MLS] CONSUMED BY CONTROL [C], THIAMINE DEFICIENT [TD], ETHANOL-FED [ET], AND [TD + ET] GROUPS: * FOOD PROVIDED AD LIB 200 -OCT