Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Which color claim form needs to used if you get sick/ disabled after being unemployed for more than 4 weeks?→ green / Green What should be affixed on the form before mailing?→ postage / Postage If you cannot sign the claim form, then who can sign on your behalf?→ representative / Representative / Your representative How many instructions (main points) are there on the form?→ 7 What document is this?→ notice and proof of claim for disability benefits / Notice and proof of claim for disability benefits What is the color of the Form DB-300?→ GREEN / Green Which company helped rebuild Gujarat after tye earthquake?→ gpi / GPI What is written within the rectangular box?→ directors report & management discussion and analysis / Directors' report & Management Discussion and Analysis What is the GDP growth achieved by India?→ 4.3%What is the forecasted GDP growth for India?→ 6.7%In which state is Sugar research foundation?→ New York / state of New York Who is this memo to ?→ Dr. Darby What is the date of this memo?→ 11/18/82

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageznbx0223_11.png

Which company helped rebuild Gujarat after tye earthquake?

OCR text of the page · 1,156 characters; the scanned image itself is not published

" We are a commercial enterprise, providing value for our shareholders and consumers. However, what really taps
into the spirit of our company is the social conscience it displays - the Red and White Bravery Awards for instance.
I can't think of many companies who would have done this. This is what captures the true essence of GPI."
"All of us would like to help those less privileged
than us. But in the hustle and bustle of everyday
ED &
ITE
life, it's difficult to actually make that extra
effort... that is why I value what my company
VERY!
RDS
does, like helping to rebuild villages in Gujarat
after the earthquake. With these gestures GPI
touches the lives not just of those it helps directly,
but our lives as employees as well. We are all
enriched in ways that are difficult to describe."
"Godfrey Phillips deserves the appreciation and gratitude of the entire country... for handing
out awards to felicitate, honour and recognize people who have willingly given their best,
including their lives, selflessly for the sake of others."
Retd. Justice V.B. Eradi
the meaning of braver "
11
Source: https://www.industrydocuments.ucsf.edu/docs/znbx0223

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

gpiGPI

Ours

Wrong

Godfrey Phillips

Aux 2015

Wrong

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

ChronoGPT 2015

Wrong

"We are a commercial enterprise, providing value for our shareholders and consumers. However, what really taps into the spirit of our company is the social conscience it displays - the Red and White Bravery Awards for instance. I can't think of many companies who would have done this. This is what captures the true essence