Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#064 · needle at 88% depth #065 · needle at 24% depth #066 · needle at 39% depth #067 · needle at 7% depth #068 · needle at 22% depth #069 · needle at 48% depth #070 · needle at 4% depth #071 · needle at 17% depth #072 · needle at 93% depth #073 · needle at 13% depth #074 · needle at 29% depth #075 · needle at 77% depth #076 · needle at 76% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for hallowed-heyday is: 5177476.
One of the special magic numbers for eager-villa is: 2054290.
[… 4 lines omitted for display …]
One of the special magic numbers for outrageous-music-making is: 4157307.
One of the special magic numbers for available-shirt is: 8923099.
One of the special magic numbers for silent-heater is: 1050043.
One of the special magic numbers for slippery-online is: 2274860.
One of the special magic numbers for vulgar-resist is: 9404704.
One of the special magic numbers for gullible-action is: 7657118.
One of the special magic numbers for obscene-measure is: 8035890.
One of the special magic numbers for towering-manor is: 9388789.
One of the special magic numbers for big-ease is: 8807639.
One of the special magic numbers for abusive-relay is: 7244901.
One of the special magic numbers for cooperative-best-seller is: 2554794.
One of the special magic numbers for aloof-alpaca is: 4613581.
One of the special magic numbers for wiry-bathtub is: 6890430.
One of the special magic numbers for melted-pitching is: 3734506.
[… 306 lines omitted for display …]
One of the special magic numbers for debonair-mechanic is: 4169324.
One of the special magic numbers for snotty-socialism is: 6592018.
What is the special magic number for towering-manor mentioned in the provided text?

Original prompt 7,639 tokens, 330 linesShown 20 lines around the needleNeedle at 4% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT3824870Aux 20159388789Ours9388789Ours, no steer.9388789PiT-FT3824870Qwen 27B9388789

Ours

Found the needle

9388789.

Aux 2015

Found the needle

9388789.

PiT-FT 2015

Missed

: 9461481 <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|ass

ChronoGPT 2015

Missed

: 7455823.<|endoftext|>