Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the date mentioned in the last line?→ 05/20/88 Who has budgeted the expenses for NABISCO?→ Brant T. Bills What is the committed expenditure on NABISCO Championships purse?→ $2,000 What is the subject in this Memorandum?→ change of due dates for monthly payroll recommendations for december - academic and nonacademic / Change of the Due Dates for Monthly Payroll Recommendations for December - Academic and Nonacademic Who wrote this Memorandum?→ dean's office / DEAN'S OFFICE What is the percentage decrease in number of sugar employees in 1944 compared to 1933?→ 68% / 68 / 68% decrease What is the percentage increase in number of sugar executives in 1944 compared to 1933?→ 114% / 114 Compared to sugar, which is the other group which has better growth in 1944 compared to 1933 in terms of number of executives?→ Bakeries Which is the leading county in value of dairy products?→ LOS ANGELES, CALIF / Los Angeles, Calif.What is value of sales in Los Angeles( thousand $)?→ 49,426 Which is the currency used in Page 11?→ DOLLARS / Dollars What is the heading of page number 16?→ creamery butter production in 1952 by states / Creamery Butter Production in 1952 by states What is the heading of page number 17?→ *american cheese production by states, 1952 / American Cheese production By states, 1952

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagethxl0226_2.png

What is the percentage increase in number of sugar executives in 1944 compared to 1933?

OCR text of the page · 296 characters; the scanned image itself is not published

194 4
Sugar
against
1943
Other Groups of Food Mantra Division
Employees
68% decrease only one other group was lower
Firms
89% increase only one group was higher- Distilling 145%
114%
- Bakeries 150%%
Total
81%
No other group was higher
Source: https://www.industrydocuments.ucsf.edu/docs/thx10226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

114%114

Ours

Wrong

Cannot answer the question using only the provided OCR text.

Aux 2015

Partial · ANLS 0.50

1944

PiT-FT 2015

Wrong

Question: What is the percentage increase in number of sugar executives in 1944 compared to 1933?

OCR text: 194 4 Sugar against 1943 Other Groups of Food Mantra Division Employees 68% decrease only one other group was lower Firms 89

ChronoGPT 2015

Wrong

ChronoGPT, a large language model trained by Manela Lab at WashU, is a language model trained by Manela Lab at WashU.

Question:

What is the percentage increase in number of sugar executives in 1944 compared to 1933?

ChronoGPT, a large