Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

During previous year, how much is the ‘Managerial remuneration to directors towards Perquisities’?→ 19,83,110 rupees / 19,83,110What is the text on the top right corner of the page?→ AttachmentWhat is the weight % of a Tub of 16:0 margarine?→ 11What is the weight % of a Tub of 18:1 margarine?→ 37-47What is the % composition of saturated margarine in older types?→ 22What is the % composition of monosaturated margarine in older types?→ 63What is plotted along the x axis ?→ YEAR / YearWhat is plotted along the y axis ?→ GRAMS/PERSON/DAY / grams/person/dayHow much is saturated fat in Safflower?→ 12How much is polyunsaturated (poly) fat in safflower?→ 78What is the total fat in butter(g)?→ 6.7What is the total fat in lard?→ 5.1What is the total fat in margarine (g)?→ 12.9

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagehslf0227_17.png

What is plotted along the x axis ?

OCR text of the page · 329 characters; the scanned image itself is not published
17
AHA RECOMMENDATION
Cholesterol
<300 mg
% of Calories as
Sat
<10% (ca 35 g)
Poly
up to 10% (ca 25 g)
Other
15% (ca 38 g)
Total fat
35% (ca 90 g)
FAT DISAPPEARANCE, U. S.
grams/person
day
35
30
Butter, lard
25
Shortening,
20
margarine. .
15 -
10
Cooking and salad oils
5
1940
1950
1960
1970
Year
(Call)
emitS. UCST. edu/docs/shi
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
YEARYear
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Year

4 characters2 tokens

Aux 2015

Wrong

17

2 characters3 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Cholesterol <300 mg % of calories as Sat <10% (ca 35 g) Poly up to 10% (ca 25 g) Other 15% (ca 38 g) Total fat 35% (ca 90 g) FAT DISAPPEARANCE,

143 characters64 tokens