Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#039 · needle at 19% depth#040 · needle at 49% depth#041 · needle at 80% depth#042 · needle at 32% depth#043 · needle at 42% depth#044 · needle at 58% depth#045 · needle at 40% depth#046 · needle at 79% depth#047 · needle at 28% depth#048 · needle at 73% depth#049 · needle at 53% depth#050 · needle at 27% depth#051 · needle at 18% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for bizarre-checking is: 2711944.
One of the special magic numbers for roasted-polyester is: 5551447.
[… 261 lines omitted for display …]
One of the special magic numbers for wakeful-match is: 2825529.
One of the special magic numbers for absurd-turning is: 1620346.
One of the special magic numbers for debonair-hood is: 8460179.
One of the special magic numbers for jaded-cook is: 9309059.
One of the special magic numbers for shaggy-blow is: 9994351.
One of the special magic numbers for momentous-parser is: 9079430.
One of the special magic numbers for chivalrous-disarmament is: 1051983.
One of the special magic numbers for unsuitable-skating is: 9339211.
One of the special magic numbers for salty-distinction is: 3008599.
One of the special magic numbers for crabby-canopy is: 8277912.
One of the special magic numbers for guttural-preparation is: 1831713.
One of the special magic numbers for crowded-culvert is: 6122047.
One of the special magic numbers for rustic-carpenter is: 4239977.
[… 385 lines omitted for display …]
One of the special magic numbers for melted-burrito is: 9581494.
One of the special magic numbers for bright-newspaper is: 6329769.
What is the special magic number for chivalrous-disarmament mentioned in the provided text?
Original prompt 15,305 tokens, 665 linesShown 19 lines around the needleNeedle at 40% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8441475Aux 20156646180Ours1051983Ours, no steer.1051983PiT-FT8441475Qwen 27B1051983
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1051983.

13 characters10 tokens

Aux 2015

Missed

4244051.

13 characters10 tokens

PiT-FT 2015

Missed

: 8876565. The special magic number for embarrassed-sauce is: 8876565. The special magic number for loutish-burden is: 8876565. The special magic number for loutish-tear is: 8876565. The special magic number for loutish-tear is: 8876565. The special magic number for jaded-caulk is: 8876565. The special magic number for loutish-tear is: 8876565. The special magic number for loutish

390 characters128 tokens

ChronoGPT 2015

Missed

: 1858<|endoftext|>

19 characters4 tokens