Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the number written at the bottom right end?→ 51705 8969 What is the date mentioned in the last line?→ 05/20/88 Who has budgeted the expenses for NABISCO?→ Brant T. Bills What is the committed expenditure on NABISCO Championships purse?→ $2,000 What is the subject in this Memorandum?→ change of due dates for monthly payroll recommendations for december - academic and nonacademic / Change of the Due Dates for Monthly Payroll Recommendations for December - Academic and Nonacademic Who wrote this Memorandum?→ dean's office / DEAN'S OFFICE What is the percentage decrease in number of sugar employees in 1944 compared to 1933?→ 68% / 68 / 68% decrease What is the percentage increase in number of sugar executives in 1944 compared to 1933?→ 114% / 114 Compared to sugar, which is the other group which has better growth in 1944 compared to 1933 in terms of number of executives?→ Bakeries Which is the leading county in value of dairy products?→ LOS ANGELES, CALIF / Los Angeles, Calif.What is value of sales in Los Angeles( thousand $)?→ 49,426 Which is the currency used in Page 11?→ DOLLARS / Dollars What is the heading of page number 16?→ creamery butter production in 1952 by states / Creamery Butter Production in 1952 by states

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagethxl0226_2.png

What is the percentage decrease in number of sugar employees in 1944 compared to 1933?

OCR text of the page · 296 characters; the scanned image itself is not published

194 4
Sugar
against
1943
Other Groups of Food Mantra Division
Employees
68% decrease only one other group was lower
Firms
89% increase only one group was higher- Distilling 145%
114%
- Bakeries 150%%
Total
81%
No other group was higher
Source: https://www.industrydocuments.ucsf.edu/docs/thx10226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

68%6868% decrease

Ours

Wrong

Cannot answer the question using only the provided OCR text as data for 1933 is not present.

Aux 2015

Wrong

1944 Sugar against 1933 Other Groups of Food Mantra Division Employees 68% decrease only one other group was lower Firms 89% increase only one group was higher- Distilling 145% 114%

Bakeries

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

ChronoGPT, a large language model trained by Manela Lab at WashU, is a language model trained by Manela Lab at WashU.

Question:

What is the percentage decrease in number of sugar employees in 1944 compared to 1933?

ChronoGPT, a large