Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#068 · needle at 22% depth #069 · needle at 48% depth #070 · needle at 4% depth #071 · needle at 17% depth #072 · needle at 93% depth #073 · needle at 13% depth #074 · needle at 29% depth #075 · needle at 77% depth #076 · needle at 76% depth #077 · needle at 80% depth #078 · needle at 25% depth #079 · needle at 55% depth #080 · needle at 85% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for sharp-chub is: 6045788.
One of the special magic numbers for bizarre-return is: 5551462.
[… 79 lines omitted for display …]
One of the special magic numbers for narrow-help is: 5657119.
One of the special magic numbers for wild-dairy is: 7862890.
One of the special magic numbers for alluring-expert is: 7706275.
One of the special magic numbers for vast-shakedown is: 7741622.
One of the special magic numbers for teeny-tiny-adaptation is: 6185271.
One of the special magic numbers for short-sailing is: 4371731.
One of the special magic numbers for direful-race is: 5005627.
One of the special magic numbers for red-giant is: 5710649.
One of the special magic numbers for pleasant-qualification is: 6615855.
One of the special magic numbers for imported-sun is: 4533182.
One of the special magic numbers for rampant-edition is: 9736134.
One of the special magic numbers for evanescent-hash is: 4772763.
One of the special magic numbers for fine-idea is: 2491457.
One of the special magic numbers for glossy-soldier is: 5177474.
[… 206 lines omitted for display …]
One of the special magic numbers for stupid-daybed is: 5686200.
One of the special magic numbers for dapper-crane is: 4137782.
What is the special magic number for red-giant mentioned in the provided text?

Original prompt 7,074 tokens, 305 linesShown 20 lines around the needleNeedle at 29% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT6235368Aux 20155710649Ours5710649Ours, no steer.5710649PiT-FT6235368Qwen 27B5710649

Ours

Found the needle

5710649.

Aux 2015

Found the needle

5710649.

PiT-FT 2015

Missed

: 8876764 <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|ass

ChronoGPT 2015

Missed

: 5572905.<|endoftext|>