Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#000 · needle at 62% depth #001 · needle at 43% depth #002 · needle at 68% depth #003 · needle at 43% depth #004 · needle at 2% depth #005 · needle at 53% depth #006 · needle at 84% depth #007 · needle at 2% depth #008 · needle at 76% depth #009 · needle at 86% depth #010 · needle at 60% depth #011 · needle at 86% depth #012 · needle at 24% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for temporary-season is: 8495720.
One of the special magic numbers for unbecoming-malice is: 3053083.
[… 273 lines omitted for display …]
One of the special magic numbers for dry-elk is: 6388157.
One of the special magic numbers for cloudy-clank is: 8541520.
One of the special magic numbers for loud-blade is: 3235004.
One of the special magic numbers for tender-godmother is: 4350987.
One of the special magic numbers for entertaining-bill is: 5236162.
One of the special magic numbers for precious-hunt is: 8340281.
One of the special magic numbers for upset-pioneer is: 5799782.
One of the special magic numbers for somber-legislation is: 7933921.
One of the special magic numbers for fierce-top is: 4375454.
One of the special magic numbers for disagreeable-kettle is: 8282368.
One of the special magic numbers for resonant-rehospitalization is: 4226188.
One of the special magic numbers for broad-gram is: 1406730.
One of the special magic numbers for tart-chard is: 2614070.
One of the special magic numbers for evil-room is: 1557661.
[… 37 lines omitted for display …]
One of the special magic numbers for jolly-scenery is: 2187207.
One of the special magic numbers for muddy-stair is: 2352134.
What is the special magic number for somber-legislation mentioned in the provided text?

Original prompt 7,636 tokens, 330 linesShown 20 lines around the needleNeedle at 84% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT7305252Aux 20157933921Ours7933921Ours, no steer.7933921PiT-FT7305252Qwen 27B7933921

Ours

Found the needle

7933921.

Aux 2015

Found the needle

7933921.

PiT-FT 2015

Missed

: 7386601 <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|ass

ChronoGPT 2015

Missed

: 7447513.<|endoftext|>