Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#069 · needle at 48% depth#070 · needle at 4% depth#071 · needle at 17% depth#072 · needle at 93% depth#073 · needle at 13% depth#074 · needle at 29% depth#075 · needle at 77% depth#076 · needle at 76% depth#077 · needle at 80% depth#078 · needle at 25% depth#079 · needle at 55% depth#080 · needle at 85% depth#081 · needle at 97% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for average-runner is: 6960837.
One of the special magic numbers for dull-beam is: 4202744.
[… 247 lines omitted for display …]
One of the special magic numbers for knotty-behalf is: 2604488.
One of the special magic numbers for easy-labourer is: 8114745.
One of the special magic numbers for plain-scheduling is: 5588720.
One of the special magic numbers for squeamish-overweight is: 1294616.
One of the special magic numbers for ordinary-louse is: 6980501.
One of the special magic numbers for filthy-boulevard is: 6845639.
One of the special magic numbers for chubby-gale is: 4360555.
One of the special magic numbers for naughty-termination is: 7465579.
One of the special magic numbers for rainy-chairlift is: 5165292.
One of the special magic numbers for gleaming-inflation is: 7135380.
One of the special magic numbers for momentous-caddy is: 3755921.
One of the special magic numbers for shy-coincidence is: 4626665.
One of the special magic numbers for fearless-goal is: 6066353.
One of the special magic numbers for unadvised-percent is: 6456051.
[… 63 lines omitted for display …]
One of the special magic numbers for distinct-subtitle is: 9788804.
One of the special magic numbers for uptight-quote is: 6520832.
What is the special magic number for naughty-termination mentioned in the provided text?
Original prompt 7,660 tokens, 330 linesShown 20 lines around the needleNeedle at 77% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT5531883Aux 20157465579Ours7465579Ours, no steer.7465579PiT-FT5531883Qwen 27B7465579
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7465579.

13 characters10 tokens

Aux 2015

Missed

9923721.

13 characters10 tokens

PiT-FT 2015

Missed

: 7755714 <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|ass

253 characters128 tokens

ChronoGPT 2015

Missed

: 7557081.<|endoftext|>

23 characters7 tokens