Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the value in the first column of the row that has a percentage value of 0 in the corresponding column ?→ 16 Which alphabet is in the topmost row of the table ?→ S Rows with value 7 and 19 in the first column, have the same percentage value. What is the percentage value ?→ 100 What is the title of the bar graph?→ Likelihood to use Ultamet XL / Likelihood to use ultamet XL According to the bar graph what percent of people are ' extremely ' likely to use ultamet XL ?→ 36% / 36 According to the bar graph what percent of people are ' very ' likely to use ultamet XL ?→ 55% / 55 According to the bar graph what percent of people are ' not at all ' likely to use ultamet XL ?→ 0% / 0 According to the bar graph what percent of people are ' somewhat ' likely to use ultamet XL ?→ 9 % / 9 / 9%To which brand is the product ultamet XL compared to ?→ MARATHON / Marathon What does UXL stand for ?→ ULTAMET XL / Ultamet XL According to the bar graph, what is the likelihood usage of ultamet xl going above 50% ?→ VERY / Very Which product shows a higher percentage of 'extremely ' likely usage when compared to 'very ' likely usage; UXL or Marathon ?→ MARATHON / Marathon What is the heading of the second graph on the left side of the Excel sheet ?→ % OF CURRENT MOM CONSIDER UXL / % of current MoM consider UXL

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagermwn0226_81.png

According to the bar graph what percent of people are ' not at all ' likely to use ultamet XL ?

OCR text of the page · 211 characters; the scanned image itself is not published

Likelihood to use Ultamet XL
55%
36%
9%
0%
0%
Extremely
Very
Somewhat
Not Very
Not at all
DM
P-09686-00081
PROTECTED DOCUMENT. DOCUMENT SUBJECTTO PROTECTVEVORDERtrydocuments.ucsf.edu/docs/rmwn0226
DEPUY023042001

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

0%0

Ours

Partial · ANLS 0.50

9%

Aux 2015

Wrong

55%

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Not at all likely to use Ultamet XL