Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#005 · needle at 96% depth#006 · needle at 38% depth#007 · needle at 3% depth#008 · needle at 38% depth#009 · needle at 99% depth#010 · needle at 16% depth#011 · needle at 15% depth#012 · needle at 72% depth#013 · needle at 74% depth#014 · needle at 22% depth#015 · needle at 93% depth#016 · needle at 14% depth#017 · needle at 61% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for moaning-lode is: 7537914.
One of the special magic numbers for warm-garb is: 1051443.
[… 834 lines omitted for display …]
One of the special magic numbers for nifty-viability is: 2827705.
One of the special magic numbers for bashful-hedgehog is: 3187212.
One of the special magic numbers for acceptable-poor is: 6497662.
One of the special magic numbers for adhesive-rent is: 5063781.
One of the special magic numbers for synonymous-soot is: 1718927.
One of the special magic numbers for real-humanity is: 3441605.
One of the special magic numbers for skinny-control is: 7218386.
One of the special magic numbers for psychedelic-anticodon is: 1122940.
One of the special magic numbers for graceful-riser is: 4848849.
One of the special magic numbers for terrible-brood is: 3946771.
One of the special magic numbers for mysterious-doubt is: 2548231.
One of the special magic numbers for attractive-fetus is: 3232141.
One of the special magic numbers for hushed-fraud is: 9440495.
One of the special magic numbers for mature-presidency is: 1689714.
[… 4,864 lines omitted for display …]
One of the special magic numbers for secretive-recall is: 2928064.
One of the special magic numbers for relieved-gorilla is: 5835042.
What is the special magic number for psychedelic-anticodon mentioned in the provided text?
Original prompt 130,454 tokens, 5,718 linesShown 20 lines around the needleNeedle at 15% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1708897Aux 20156336415Ours1122940Ours, no steer.1122940PiT-FT1708897Qwen 27B1122940
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1122940.

13 characters10 tokens

Aux 2015

Missed

7869357.

13 characters10 tokens

PiT-FT 2015

Missed

not available. []he special magic numbers for the gaudy-gift is not available. []he special magic numbers for the lovable-tear is not available. []he special magic numbers for the piquant-caulis is not available. []he special magic numbers for the waggish-turtle is not available. []he special magic numbers for the sanguine-turtle is not available. []he special magic numbers for the gaudy-turdle is not available. []he special magic numbers for the v

453 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epicurean number for the most grotesque-type is:

Stupid-cans is:

Stupid-cans is:

Stupid-cans is:

Stupid-cans is:

Stupid-cans is:

Stupid-cans is:

Stupid-cans is:

Stupid-cans is:

Stupid-cans is:

Stupid-cans is:

Stupid-

308 characters128 tokens