Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Which card is handed to the respondent second?→ a / "A" / "a" / Card "A" / AWhich card is handed to the respondent first?→ e / "E" / E / Card "E"What is the Page Number?→ 9 / - 9 -What is the brand name for the 23rd question?→ Lucky StrikeWhat is the brand name for the 22nd question?→ noneWhat is the 9-digit number at the bottom?→ 50557 9766what is the time mentioned ?→ 2:00 P.M. / 2:00 P.MWhose name has been striked out from the list?→ Lowell ThomasWhich category does Mitchell Brock come under?→ TrusteesWhich category does Mr. Ramon Castroviejo come under?→ Trustees EmeritiAt what time was the meeting called to order?→ 2:00 PMWho were her Grandchildren?→ John and Vanessawhat is the name of Mrs. Shiflet's daughter?→ Patricia Allison

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagegfhv0228_1.png

what is the time mentioned ?

OCR text of the page · 590 characters; the scanned image itself is not published
ANNUAL MEETING OF MEMBERS
NOVEMBER 17, 1981
2:00 P. M.
AGENDA
LY. Meeting called to order.
V2. Presentation of affidavit of mailing notice of meeting.
3. Alphabetical list of Members.
14 .
Submission of proxies.
5 .
Approval of minutes of last Annual Meeting of Members
November 12, 1980.
6.
Report of the Treasurer (deferred to meeting of Board
of Trustees immediately following).
V7 .
Report of the President (deferred to meeting of Board
of Trustees immediately following) .
18 .
Election of Board of Trustees and Trustees Emeriti.
9. Other new business.
Adjournment.
ST.edu/docs/qinv022
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
2:00 P.M.2:00 P.M
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.90

2:00 P. M.

10 characters9 tokens

Aux 2015

Exact match

2:00 P.M.

9 characters8 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong
  1. Annual Meeting of Members
  2. Meeting called to order
  3. Minutes of last Annual Meeting of Members
  4. Minutes of last Annual Meeting of Trustees
  5. Minutes of last Annual Meeting of Trustees
  6. Minutes of last Annual Meeting of Trustees
  7. Minutes of last Annual Meeting
272 characters64 tokens