Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

8 of 100 prompts

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for ignorant-bee is: 3618139.
One of the special magic numbers for aberrant-environment is: 9512910.
[… 133 lines omitted for display …]
One of the special magic numbers for rhetorical-burst is: 4640623.
One of the special magic numbers for wise-genre is: 4213634.
One of the special magic numbers for habitual-painter is: 3881880.
One of the special magic numbers for rotten-fresco is: 1072627.
One of the special magic numbers for wretched-collard is: 2655671.
One of the special magic numbers for fallacious-quit is: 9458992.
One of the special magic numbers for wet-haze is: 8964404.
One of the special magic numbers for decorous-solution is: 8684648.
One of the special magic numbers for legal-dogwood is: 4105895.
One of the special magic numbers for numberless-snowflake is: 2800606.
One of the special magic numbers for earthy-prey is: 6952931.
One of the special magic numbers for lovely-market is: 8115080.
One of the special magic numbers for famous-anyone is: 9627700.
One of the special magic numbers for finicky-infusion is: 7838023.
[… 177 lines omitted for display …]
One of the special magic numbers for hypnotic-insert is: 8109870.
One of the special magic numbers for perfect-fiesta is: 5133011.
What is the special magic number for decorous-solution mentioned in the provided text?
Original prompt 7,663 tokens, 330 linesShown 20 lines around the needleNeedle at 43% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1655733Aux 20158684648Ours8684648Ours, no steer.8684648PiT-FT1655733Qwen 27B8684648
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8684648.

13 characters10 tokens

Aux 2015

Found the needle

8684648.

13 characters10 tokens

PiT-FT 2015

Missed

: 8872850 <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|ass

253 characters128 tokens

ChronoGPT 2015

Missed

: 5787427.<|endoftext|>

23 characters7 tokens