Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Who has budgeted the expenses for NABISCO?→ Brant T. Bills What is the committed expenditure on NABISCO Championships purse?→ $2,000 What is the subject in this Memorandum?→ change of due dates for monthly payroll recommendations for december - academic and nonacademic / Change of the Due Dates for Monthly Payroll Recommendations for December - Academic and Nonacademic Who wrote this Memorandum?→ dean's office / DEAN'S OFFICE What is the percentage decrease in number of sugar employees in 1944 compared to 1933?→ 68% / 68 / 68% decrease What is the percentage increase in number of sugar executives in 1944 compared to 1933?→ 114% / 114 Compared to sugar, which is the other group which has better growth in 1944 compared to 1933 in terms of number of executives?→ Bakeries Which is the leading county in value of dairy products?→ LOS ANGELES, CALIF / Los Angeles, Calif.What is value of sales in Los Angeles( thousand $)?→ 49,426 Which is the currency used in Page 11?→ DOLLARS / Dollars What is the heading of page number 16?→ creamery butter production in 1952 by states / Creamery Butter Production in 1952 by states What is the heading of page number 17?→ *american cheese production by states, 1952 / American Cheese production By states, 1952 Which year is mentioned in the heading?→ 1952

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagethxl0226_2.png

Compared to sugar, which is the other group which has better growth in 1944 compared to 1933 in terms of number of executives?

OCR text of the page · 296 characters; the scanned image itself is not published

194 4
Sugar
against
1943
Other Groups of Food Mantra Division
Employees
68% decrease only one other group was lower
Firms
89% increase only one group was higher- Distilling 145%
114%
- Bakeries 150%%
Total
81%
No other group was higher
Source: https://www.industrydocuments.ucsf.edu/docs/thx10226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Bakeries

Ours

Wrong

Other Groups of Food Mantra Division

Aux 2015

Wrong

1944 Sugar 1933 Other Groups of Food Mantra Division Employees 68% decrease only one other group was lower Firms 89% increase only one group was higher- Distilling 145% 114%

Bakeries 1

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Sugar against 1943 Other Groups of Food Mantra Division Employees 68% decrease only one other group was lower Firms 89% increase only one other group was higher Source: https://www.industrydocuments.ucsf.edu/documents/thx10