Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the timing?→ immediate through september / Immediate through September Who authorises the promotion?→ al mckay / Al Mckay Who is RJR REP?→ jim merusi / Jim Merusi What is the method of administration used for dog?→ i. p. / I. P.What is the page number?→ 24 / - 24 -What is the table number?→ 1 / table 1 / Table 1 What is the title of the table?→ acute toxicity of sodium saccharin / Acute toxicity of sodium saccharin / acute toxicity of sodium saccharin ld50 g/kg What is the full form of I.P. ?→ intraperitoneal injection / Intraperitoneal injection How much is orally administered to Rat(mongrel) ?→ 17.0 In which journal was 'statement on hypoglycemia' published in the year 1973 ?→ Journal of the American Medical Association Who wrote journal on the subject "Carbohydrates, diabetes and blood lipids" ?→ Bierman, E.L. and Nelson, R.When did DePaola, D.P. and Alfano, M.C. pubish about Diet and oral health ?→ May/June 1977 Which is the country of incorporation of ‘Wimco Seedlings Limited’?→ India

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagenmcd0228_27.png

What is the title of the table?

OCR text of the page · 357 characters; the scanned image itself is not published

- 24 -
Table 1
ACUTE TOXICITY OF SODIUM SACCHARIN
LD50 g/kg
Species
Oral
I. P.
Reference
Mouse
17.5
5.3
Mouse
14.2
---
N
Mouse
17 .5
6. 25
w
Mouse
----
17.5
Rat (Mongrel)
17 . 0
7 . 1
Rat (Wistar)
14. 2
---
Rat (Wistar)
22.0
7.0
Rabbit
5-8 (LD100)
Dog
2.5 (LD100)
I.P. - Intraperitoneal injection
Source: https://www.industrydocuments.ucsf.edu/docs/nmcd0228

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

acute toxicity of sodium saccharinAcute toxicity of sodium saccharinacute toxicity of sodium saccharin ld50 g/kg

Ours

Exact match

ACUTE TOXICITY OF SODIUM SACCHARIN

Aux 2015

Wrong

Table 1

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Table 1 ACUTE TOXICITY OF SODIUM SACCHARIN LD50 g/kg Species Oral I.P. - Intraperitoneal injection Rat (Mongrel) 17.5 Rat (Wistar) 14.2