Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#079 · needle at 92% depth#080 · needle at 19% depth#081 · needle at 56% depth#082 · needle at 19% depth#083 · needle at 39% depth#084 · needle at 4% depth#085 · needle at 45% depth#086 · needle at 26% depth#087 · needle at 7% depth#088 · needle at 78% depth#089 · needle at 78% depth#090 · needle at 3% depth#091 · needle at 49% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for agreeable-convection is: 3670530.
One of the special magic numbers for ignorant-metal is: 7410980.
[… 2,586 lines omitted for display …]
One of the special magic numbers for blue-eyed-being is: 6873892.
One of the special magic numbers for unable-creek is: 4649645.
One of the special magic numbers for innate-thought is: 7639722.
One of the special magic numbers for gullible-charter is: 4562806.
One of the special magic numbers for little-agenda is: 5990859.
One of the special magic numbers for glorious-mower is: 2086439.
One of the special magic numbers for scientific-congressman is: 5441014.
One of the special magic numbers for inquisitive-former is: 7239571.
One of the special magic numbers for soft-toga is: 2914834.
One of the special magic numbers for panicky-show is: 8266652.
One of the special magic numbers for miniature-whelp is: 2318094.
One of the special magic numbers for dangerous-thong is: 9371301.
One of the special magic numbers for wistful-scanner is: 7611750.
One of the special magic numbers for successful-tip is: 3043553.
[… 3,112 lines omitted for display …]
One of the special magic numbers for important-equality is: 1400380.
One of the special magic numbers for aboard-variation is: 3717852.
What is the special magic number for inquisitive-former mentioned in the provided text?
Original prompt 130,455 tokens, 5,718 linesShown 20 lines around the needleNeedle at 45% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4236403Aux 20158878841Ours7239571Ours, no steer.7239571PiT-FT4236403Qwen 27B7239571
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7239571.

13 characters10 tokens

Aux 2015

Missed

1381068.

13 characters10 tokens

PiT-FT 2015

Missed

not available. What other information might be added to make the rest special? Assistant's Response:

`````[]
`````[]
`````[]
`````[]
`````[]
`````[]
`````[]
`````[]
`````[]
`````[]
`````[] 
`````[] 
`````[] 
`````[]
297 characters128 tokens

ChronoGPT 2015

Missed

:

Wis:

The special Epicurean Epicurean Epicurean

Gen:

The special Epicurean Epicurean

###oho: The special Epicurean Epicurean

###oho: The special Epicurean Epicurean

###oho: The special Epicurean Epicurean

###oho: The special Epicurean Epicurean

###oho: The special Epicurean Epicurean

###oho: The special Epicurean Epicurean

###oho: The special Epicurean

382 characters128 tokens