Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#047 · needle at 57% depth#048 · needle at 50% depth#049 · needle at 70% depth#050 · needle at 75% depth#051 · needle at 88% depth#052 · needle at 41% depth#053 · needle at 78% depth#054 · needle at 9% depth#055 · needle at 47% depth#056 · needle at 20% depth#057 · needle at 92% depth#058 · needle at 17% depth#059 · needle at 47% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for smiling-hatbox is: 8925687.
One of the special magic numbers for deserted-possession is: 4785464.
[… 252 lines omitted for display …]
One of the special magic numbers for narrow-expose is: 2259609.
One of the special magic numbers for uppity-catalysis is: 8542815.
One of the special magic numbers for squeamish-chino is: 3250906.
One of the special magic numbers for devilish-transition is: 5789641.
One of the special magic numbers for chivalrous-room is: 8656125.
One of the special magic numbers for sticky-pumpernickel is: 8430054.
One of the special magic numbers for abnormal-gambling is: 4639712.
One of the special magic numbers for nebulous-spirituality is: 7038913.
One of the special magic numbers for credible-logic is: 1692691.
One of the special magic numbers for selfish-proximity is: 2045024.
One of the special magic numbers for rightful-accident is: 4558915.
One of the special magic numbers for good-arch-rival is: 1073561.
One of the special magic numbers for sweet-chick is: 6800654.
One of the special magic numbers for wretched-domain is: 5336549.
[… 58 lines omitted for display …]
One of the special magic numbers for lying-postage is: 3330598.
One of the special magic numbers for cooing-longboat is: 9150018.
What is the special magic number for nebulous-spirituality mentioned in the provided text?
Original prompt 7,642 tokens, 330 linesShown 20 lines around the needleNeedle at 78% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9682722Aux 20157038913Ours7038913Ours, no steer.7038913PiT-FT9682722Qwen 27B7038913
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7038913.

13 characters10 tokens

Aux 2015

Missed

9949043.

13 characters10 tokens

PiT-FT 2015

Missed

: 7902630. <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|

251 characters128 tokens

ChronoGPT 2015

Missed

: 7291601.<|endoftext|>

23 characters7 tokens