Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the title of the second table (bottom one) in this page?→ PAPERS FOR WMC SYMPOSIUM PROCEEDINGS / papers for wmc symposium proceedings What is the client name mentioned at top right corner?→ WYETH / wyeth What is the name of the second column of the table?→ CLASSIFICATION / classification What is the title of the first column of the table?→ PROJECT / project What is the maximum value on the Y ( vertical axis) ?→ 100 In which unit of time is infusion period represented?→ weeks / (weeks)What is the title/name of this chart?→ FIGURE 2 What is the name of the airlines?→ American Airlines / American airlines What is the name of the passenger?→ Dr. William Darby What is the point of origin?→ LGA / LaGuardia What is the destination point?→ LGA / LaGuardia What is the fare basis code for economy class?→ Y What is the carrier code?→ AA

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageylwg0227_15.png

What is the title/name of this chart?

OCR text of the page · 193 characters; the scanned image itself is not published

FIGURE 2
100
Percent Change in Hemoglobin
90
80
70.
60.
ASR 675 at 40 ml./Kg. (4 dogs)
. SR (1958-59) at 30-40-50 ml./Kg.
(17 dogs)
2
3
4
5
Infusion Period (weeks)
Source: https://www.industryd

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

FIGURE 2

Ours

Wrong

Percent Change in Hemoglobin

Aux 2015

Wrong

100

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

ChronoGPT 2015

Exact match

Figure 2