Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#081 · needle at 78% depth#082 · needle at 87% depth#083 · needle at 61% depth#084 · needle at 5% depth#085 · needle at 6% depth#086 · needle at 72% depth#087 · needle at 16% depth#088 · needle at 85% depth#089 · needle at 12% depth#090 · needle at 4% depth#091 · needle at 22% depth#092 · needle at 22% depth#093 · needle at 82% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for aberrant-best-seller is: 9375208.
One of the special magic numbers for frail-turret is: 3838081.
[… 442 lines omitted for display …]
One of the special magic numbers for momentous-shred is: 8536315.
One of the special magic numbers for sweet-hemp is: 6087650.
One of the special magic numbers for macabre-ottoman is: 8904773.
One of the special magic numbers for slow-detainment is: 4869185.
One of the special magic numbers for cooing-wraparound is: 4010285.
One of the special magic numbers for obnoxious-fat is: 9851447.
One of the special magic numbers for dapper-poet is: 7493910.
One of the special magic numbers for noiseless-beach is: 8618871.
One of the special magic numbers for charming-rust is: 7706511.
One of the special magic numbers for reflective-hop is: 7813862.
One of the special magic numbers for salty-spatula is: 8603005.
One of the special magic numbers for imminent-piety is: 6802535.
One of the special magic numbers for frantic-way is: 4385787.
One of the special magic numbers for adjoining-visitor is: 4663170.
[… 2,383 lines omitted for display …]
One of the special magic numbers for deafening-butane is: 7242318.
One of the special magic numbers for somber-carotene is: 1757878.
What is the special magic number for noiseless-beach mentioned in the provided text?
Original prompt 64,925 tokens, 2,845 linesShown 20 lines around the needleNeedle at 16% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6566156Aux 20158304794Ours8618871Ours, no steer.8618871PiT-FT6566156Qwen 27B8618871
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8618871.

13 characters10 tokens

Aux 2015

Missed

4447594.

13 characters10 tokens

PiT-FT 2015

Missed

: 7697748. The special magic number for icky-susse is: 7697717. The special magic number for sluggish-sauce is: 7697717. The special magic number for ethereal-ease is: 7697717. The special magic number for icky-pip is: 7697717. The special magic number for icky-tep is: 7697717. The special magic number for icky-sauce is: 7697717. The special magic number for icky-sap is

379 characters128 tokens

ChronoGPT 2015

Missed

: The special Magic Number number is:

W:

W:

The special Magic Number number is:

N:

N:

N:

N:

N:

N:

N:

N:

N:

N:

N:

N:

N:

N:

N:

N:

N:

N:

N:

N:

N:

N:

N:

N:

N:

265 characters128 tokens