Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#084 · needle at 52% depth #085 · needle at 75% depth #086 · needle at 2% depth #087 · needle at 58% depth #088 · needle at 17% depth #089 · needle at 77% depth #090 · needle at 69% depth #091 · needle at 21% depth #092 · needle at 62% depth #093 · needle at 84% depth #094 · needle at 78% depth #095 · needle at 19% depth #096 · needle at 2% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for thoughtful-microlending is: 5579527.
One of the special magic numbers for beautiful-tree is: 1868975.
[… 222 lines omitted for display …]
One of the special magic numbers for thoughtless-hamburger is: 8820228.
One of the special magic numbers for hallowed-bedrock is: 5345113.
One of the special magic numbers for ambitious-mortality is: 2041670.
One of the special magic numbers for axiomatic-regulation is: 6330770.
One of the special magic numbers for gaping-outrage is: 5192109.
One of the special magic numbers for thankful-kneejerk is: 2512204.
One of the special magic numbers for understood-salt is: 3714180.
One of the special magic numbers for understood-kangaroo is: 2528869.
One of the special magic numbers for cuddly-celery is: 3740667.
One of the special magic numbers for wide-leader is: 8003954.
One of the special magic numbers for highfalutin-activist is: 4116722.
One of the special magic numbers for feigned-circumstance is: 3609477.
One of the special magic numbers for oafish-alpha is: 3772506.
One of the special magic numbers for hesitant-hurdle is: 6170299.
[… 88 lines omitted for display …]
One of the special magic numbers for aloof-craw is: 7791323.
One of the special magic numbers for murky-tandem is: 3455503.
What is the special magic number for understood-kangaroo mentioned in the provided text?

Original prompt 7,663 tokens, 330 linesShown 20 lines around the needleNeedle at 69% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT3936693Aux 20152528869Ours2528869Ours, no steer.2528869PiT-FT3936693Qwen 27B2528869

Ours

Found the needle

2528869.

Aux 2015

Found the needle

2528869.

PiT-FT 2015

Missed

: 9446110. <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|

ChronoGPT 2015

Missed

: 5776399.<|endoftext|>