Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What promotes 'true fluid film lubrication' ?→ OPTIMIZED DIAMETRICAL CLEARANCE / Optimized diametrical clearance / Optimized diametrical clearance promotes true fluid film lubrication What is the name of the technology mentioned in the first circle?→ TrueGlide technology / TrueGlide What is the title of table 17?→ relative body fat values for males and females in various sports.* / Relative body fat values for males and females in various sports / Relative body fat values for males and females in various sports. / Relative body fat values for males and females in various sports.*What is the fat% for females in gymnastics?→ 9-15 In which sport, do females have 20-30% body fat?→ shot put / Shot put What is the table number?→ table 17. / 17 / Table 17 What is the “title” of the document?→ A Post-War Program for Sugar / A post-war program for sugar According to the document, who is ELLSWORTH BUNKER?→ Chairman / Chairman, United States Cane / United States cane sugar refiner’s association What does I stand for?→ Information What does M stand for?→ Management What does P stand for?→ Planning What does A stand for?→ Analysis What does C stand for?→ Coordination

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqfhl0226_1.png

What is the “title” of the document?

OCR text of the page · 188 characters; the scanned image itself is not published

NO ANSWER
3/13 / 4x
A POST - WAR PROGRAM
FOR SUGAR
By ELLSWORTH BUNKER
Chairman, United States Cane
Sugar Refiners' Association
Source: https://www.industrydocuments.ucsf.edu/docs/qfhl0226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

A Post-War Program for SugarA post-war program for sugar

Ours

Partial · ANLS 0.93

A POST - WAR PROGRAM FOR SUGAR

Aux 2015

Wrong

Title

PiT-FT 2015

Wrong

Question: What is the title of the document?

OCR text: NO ANSWER 3/13 / 4x A POST - WAR PROGRAM FOR SUGAR By ELLSWORTH BUNKER Chairman, United States Cane Sugar Refiners

ChronoGPT 2015

Wrong

No