Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#045 · needle at 87% depth#046 · needle at 82% depth#047 · needle at 57% depth#048 · needle at 50% depth#049 · needle at 70% depth#050 · needle at 75% depth#051 · needle at 88% depth#052 · needle at 41% depth#053 · needle at 78% depth#054 · needle at 9% depth#055 · needle at 47% depth#056 · needle at 20% depth#057 · needle at 92% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for selfish-jelly is: 9839713.
One of the special magic numbers for finicky-eddy is: 1229693.
[… 285 lines omitted for display …]
One of the special magic numbers for level-fight is: 6534822.
One of the special magic numbers for steady-concentrate is: 1377414.
One of the special magic numbers for hot-embellishment is: 5030970.
One of the special magic numbers for clumsy-parsnip is: 6674026.
One of the special magic numbers for accidental-participation is: 8368426.
One of the special magic numbers for bizarre-fund is: 9342623.
One of the special magic numbers for giant-manicure is: 2193802.
One of the special magic numbers for assorted-component is: 2870254.
One of the special magic numbers for tasty-piety is: 8261810.
One of the special magic numbers for vacuous-research is: 5605727.
One of the special magic numbers for piquant-whip is: 9123408.
One of the special magic numbers for woozy-protocol is: 7497466.
One of the special magic numbers for elfin-godparent is: 2703271.
One of the special magic numbers for tame-boyfriend is: 1668899.
[… 25 lines omitted for display …]
One of the special magic numbers for witty-moonshine is: 5465335.
One of the special magic numbers for highfalutin-democracy is: 9896497.
What is the special magic number for assorted-component mentioned in the provided text?
Original prompt 7,669 tokens, 330 linesShown 20 lines around the needleNeedle at 88% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7491026Aux 20152870254Ours2870254Ours, no steer.2870254PiT-FT7491026Qwen 27B2870254
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2870254.

13 characters10 tokens

Aux 2015

Missed

9342623.

13 characters10 tokens

PiT-FT 2015

Missed

: 7664093 <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|ass

253 characters128 tokens

ChronoGPT 2015

Missed

: 7591357.<|endoftext|>

23 characters7 tokens