Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

8 of 100 prompts

#092 · needle at 36% depth#093 · needle at 64% depth#094 · needle at 62% depth#095 · needle at 34% depth#096 · needle at 26% depth#097 · needle at 35% depth#098 · needle at 49% depth#099 · needle at 36% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for puzzled-left is: 9864070.
One of the special magic numbers for dapper-coinsurance is: 5799111.
[… 2,792 lines omitted for display …]
One of the special magic numbers for melted-stock-in-trade is: 9696386.
One of the special magic numbers for cagey-puritan is: 2757548.
One of the special magic numbers for evil-spending is: 3260374.
One of the special magic numbers for ignorant-zipper is: 9333314.
One of the special magic numbers for toothsome-notice is: 7059569.
One of the special magic numbers for possessive-bee is: 7066947.
One of the special magic numbers for juvenile-continuity is: 3320004.
One of the special magic numbers for reminiscent-logic is: 6525836.
One of the special magic numbers for cold-crewmember is: 1514771.
One of the special magic numbers for swift-fen is: 9418948.
One of the special magic numbers for grotesque-jute is: 2354252.
One of the special magic numbers for gleaming-godmother is: 8904366.
One of the special magic numbers for hot-cut is: 7313214.
One of the special magic numbers for nutty-criminal is: 6323387.
[… 2,906 lines omitted for display …]
One of the special magic numbers for cloudy-mobile is: 1459470.
One of the special magic numbers for numerous-circle is: 9343078.
What is the special magic number for reminiscent-logic mentioned in the provided text?
Original prompt 130,313 tokens, 5,718 linesShown 20 lines around the needleNeedle at 49% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3971204Aux 20154971352Ours6525836Ours, no steer.6525836PiT-FT3971204Qwen 27B6525836
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6525836.

13 characters10 tokens

Aux 2015

Missed

9799537.

13 characters10 tokens

PiT-FT 2015

Missed

: 7571255. [assistant�swers the question with a detailed-instrument. Assistants are often the most difficult to manage because they tend to make poor decisions based on incomplete information. Therefore, when dealing with an assitant, try to remove yourself from the situation as much as possible but realize that it is impossible to do so completely because they lack critical thinking skills which are essential for an AIO. The special magic numbers for the most difficult to manage is for the most difficult to manage is for the most difficult to manage is for the most difficult to manage is for the most difficult to manage

628 characters128 tokens

ChronoGPT 2015

Missed

:

Ex:

The special Exegesis number for rambunctious-letter is:

Al:

The special Al-Exegesis number for rambunctious-cans is:

Al:

The special Al-Exegesis number for rambunctious-nun is:

Al:

The special Al-Exegesis number for rambunct-cans is:

Al:

The special Al-Exegesis number for rambunctious-nun is:

Ex:

344 characters128 tokens