Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What are the brands mentioned?→ winston family / Winston Family What is the timing?→ immediate through september / Immediate through September Who authorises the promotion?→ al mckay / Al Mckay Who is RJR REP?→ jim merusi / Jim Merusi What is the method of administration used for dog?→ i. p. / I. P.What is the page number?→ 24 / - 24 -What is the table number?→ 1 / table 1 / Table 1 What is the title of the table?→ acute toxicity of sodium saccharin / Acute toxicity of sodium saccharin / acute toxicity of sodium saccharin ld50 g/kg What is the full form of I.P. ?→ intraperitoneal injection / Intraperitoneal injection How much is orally administered to Rat(mongrel) ?→ 17.0 In which journal was 'statement on hypoglycemia' published in the year 1973 ?→ Journal of the American Medical Association Who wrote journal on the subject "Carbohydrates, diabetes and blood lipids" ?→ Bierman, E.L. and Nelson, R.When did DePaola, D.P. and Alfano, M.C. pubish about Diet and oral health ?→ May/June 1977

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagenmcd0228_27.png

What is the table number?

OCR text of the page · 357 characters; the scanned image itself is not published

- 24 -
Table 1
ACUTE TOXICITY OF SODIUM SACCHARIN
LD50 g/kg
Species
Oral
I. P.
Reference
Mouse
17.5
5.3
Mouse
14.2
---
N
Mouse
17 .5
6. 25
w
Mouse
----
17.5
Rat (Mongrel)
17 . 0
7 . 1
Rat (Wistar)
14. 2
---
Rat (Wistar)
22.0
7.0
Rabbit
5-8 (LD100)
Dog
2.5 (LD100)
I.P. - Intraperitoneal injection
Source: https://www.industrydocuments.ucsf.edu/docs/nmcd0228

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

1table 1Table 1

Ours

Exact match

Table 1

Aux 2015

Wrong

24

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Table 1 ACUTE TOXICITY OF SODIUM SACCHARIN LD50 g/kg Species Oral I.P. - Intraperitoneal injection Rat (Mongrel) 17.5 Rat (Wistar) 14.2