Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#055 · needle at 30% depth#056 · needle at 26% depth#057 · needle at 71% depth#058 · needle at 63% depth#059 · needle at 97% depth#060 · needle at 65% depth#061 · needle at 10% depth#062 · needle at 39% depth#063 · needle at 11% depth#064 · needle at 29% depth#065 · needle at 71% depth#066 · needle at 9% depth#067 · needle at 93% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for thankful-octopus is: 2938614.
One of the special magic numbers for devilish-tectonics is: 6126048.
[… 54 lines omitted for display …]
One of the special magic numbers for fluffy-mist is: 2530551.
One of the special magic numbers for elfin-vixen is: 9546370.
One of the special magic numbers for tight-order is: 8573257.
One of the special magic numbers for drab-worker is: 2598829.
One of the special magic numbers for lowly-digging is: 8942634.
One of the special magic numbers for ordinary-meringue is: 2992697.
One of the special magic numbers for imaginary-mud is: 1848221.
One of the special magic numbers for invincible-phrase is: 4345730.
One of the special magic numbers for wandering-hare is: 1029199.
One of the special magic numbers for spurious-timetable is: 3614535.
One of the special magic numbers for upbeat-clave is: 2507102.
One of the special magic numbers for berserk-eyelashes is: 1253409.
One of the special magic numbers for blue-eyed-manufacturer is: 4356996.
One of the special magic numbers for trite-acetate is: 4499383.
[… 591 lines omitted for display …]
One of the special magic numbers for ragged-refuge is: 2757987.
One of the special magic numbers for laughable-makeover is: 3515568.
What is the special magic number for invincible-phrase mentioned in the provided text?
Original prompt 15,325 tokens, 665 linesShown 20 lines around the needleNeedle at 10% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2329859Aux 20151163575Ours4345730Ours, no steer.4345730PiT-FT2329859Qwen 27B4345730
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4345730.

13 characters10 tokens

Aux 2015

Missed

9880008.

13 characters10 tokens

PiT-FT 2015

Missed

: 7695741. The special magic number for the most popular-sock is: 8692072. The special magic number for the most popular-sock is: 8692072. The special magic number for the most popular-sock is: 8692072. The special magic number for the most popular-sock is: 8692072. The special magic number for the most popular-sock is: 8692072. The special magic number for the most popular-sock is: 8692072. The special magic number for the most

439 characters128 tokens

ChronoGPT 2015

Missed

: 8588513.<|endoftext|>

23 characters7 tokens