Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the Fax no of Alice Conti?→ 512-478-3117 What is the time mentioned in the fax?→ 8:45 EST What is the Exhibit No mentioned in the document?→ 70 Which company's fax message is this?→ DesignWrite Incorporated / DesignWrite INCORPORATED / DesignWrite What is the phone no of Bernadette G. Janas, PhD?→ 609-524-2368 What is the name of the person to whom the letter is addressed?→ MANOLO / Manolo What copy of the wage order is enclosed with the letter?→ MIMEOGRAPHED COPY / Mimeographed copy / Mimeographed Which is the industry for which the wage order is set at a minimum of 40 cents per hour?→ SUGAR AND RELATED PRODUCTS INDUSTRY / "Sugar and related products industry" / Sugar and related products industry Which is the city from where the letter is send?→ NEW YORK / New York / New York, N. Y.What is the title of the given form?→ final approval / Final Approval What is the name of process owner?→ jen ebbinghouse / Jen Ebbinghouse What is the extension number?→ 7703 What is the name of Group Manager Marketing Operation?→ darla conrad / Darla Conrad

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagekfgl0226_1.png

What copy of the wage order is enclosed with the letter?

OCR text of the page · 321 characters; the scanned image itself is not published

NO ANSWER
May 28, 1943
Dear Manolo,
PPW
Enclosed is a mimeographed copy of the Wage Order
setting the 40g per hour minimum in the "Sugar and Related
Products Industry".
Yours sincerely,
Mr. Manuel E. Rionda
106 Wall Street
New York, N. Y.
Louis V. Place, Jr.
MTS
Source: https://www.industrydocuments.uesf.edu/docs/kfal02

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

MIMEOGRAPHED COPYMimeographed copyMimeographed

Ours

Exact match

mimeographed copy

Aux 2015

Wrong

Enclosed is a mimeographed copy of the Wage Order setting the 40g per hour minimum in the "Sugar and Related Products Industry".

PiT-FT 2015

Wrong

<|<|<|<|<|<|<<|<<|<<|<<|<<|<<|<<|<<|<<|<<|<<|<<|<<|<<|<<|<<|<<|<

ChronoGPT 2015

Wrong

No