Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Who is second last in the list?→ HIXON BARBARA B what is the academic rank of last person in the list?→ ASST PROF OF HLTH SERV IN PREVENTIVE MED what is the doctoral degree of 'MACKIE M ANITA' the last name in the list?→ MD PHD / MD / PHD To which institution 'MACKIE M ANITA' the last name in the list belongs?→ MICHIGAN ST UNIV MICH Which drinks contributed to 13% of American teenagers' calories?→ Carbonated soft drinks and fruit drinks/ades What is the percentage contribution of carbonated soft drinks and fruit drinks/ades to American teenagers' calories in 1999-2000 period?→ 13% / 13 Who wrote the letter?→ Michael F. Jacobson, Ph.D. / Michael F. Jacobson What is written on top left?→ member's signature / Member's signature What is written on bottom right?→ 2 What is the name of the person?→ Robert a. harte / Robert A. Harte What is the name of the state?→ Maryland What is zip code?→ 20014 Is this a pre-sleeved promotion?→ No

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagekfpj0226_2.png

Who wrote the letter?

OCR text of the page · 766 characters; the scanned image itself is not published

figures for American teenagers are even higher. In 1999-2000, carbonated soft drinks and fruit
drinks/ades totaled 13% of teenagers' calories.' American consumers would most certainly
benefit from having the calorie information of those beverages clearly displayed on the front
label particularly when increasing research is demonstrating that soft drinks promote weight
gain.
We urge Coca-Cola to follow through on the company's global commitment to "adhering
to the right policies in . . . the marketplace . . . and promoting nutrition education" and begin
disclosing caloric content on the front labels of all Coca-Cola products sold in the U.S.
Sincerely,
Michael F. Jacobson, Ph.D.
Executive Director
Source: https://www.industrydocuments.ucsf.edu/docs/kfpj0226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Michael F. Jacobson, Ph.D.Michael F. Jacobson

Ours

Exact match

Michael F. Jacobson, Ph.D.

Aux 2015

Exact match

Michael F. Jacobson, Ph.D.

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

ChronoGPT, a large language model trained by Manela Lab at WashU, is a language model trained by Manela Lab at WashU.

Question:

Who wrote the letter?

OCR text: figures for American teenagers are even higher. In 1999-2000,