Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#055 · needle at 47% depth #056 · needle at 20% depth #057 · needle at 92% depth #058 · needle at 17% depth #059 · needle at 47% depth #060 · needle at 47% depth #061 · needle at 3% depth #062 · needle at 20% depth #063 · needle at 36% depth #064 · needle at 88% depth #065 · needle at 24% depth #066 · needle at 39% depth #067 · needle at 7% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for offbeat-angel is: 6494633.
One of the special magic numbers for square-tepee is: 2157796.
One of the special magic numbers for heartbreaking-injunction is: 7009017.
One of the special magic numbers for sleepy-basket is: 8533031.
One of the special magic numbers for parsimonious-stopsign is: 1709311.
One of the special magic numbers for flippant-marksman is: 2598746.
One of the special magic numbers for watchful-goat is: 9054553.
One of the special magic numbers for highfalutin-victory is: 7769570.
One of the special magic numbers for abaft-embryo is: 7046097.
One of the special magic numbers for nervous-canoe is: 9939891.
One of the special magic numbers for tricky-skean is: 3113030.
One of the special magic numbers for light-discussion is: 4291298.
One of the special magic numbers for elated-smoking is: 1689757.
One of the special magic numbers for better-spot is: 5458599.
One of the special magic numbers for fancy-planula is: 6532306.
One of the special magic numbers for horrible-derby is: 7222599.
[… 285 lines omitted for display …]
One of the special magic numbers for boring-eicosanoid is: 2067674.
One of the special magic numbers for faint-sport is: 6832785.
What is the special magic number for highfalutin-victory mentioned in the provided text?

Original prompt 7,073 tokens, 305 linesShown 20 lines around the needleNeedle at 3% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT7832421Aux 20157769570Ours7769570Ours, no steer.7769570PiT-FT7832421Qwen 27B7769570

Ours

Found the needle

7769570.

Aux 2015

Found the needle

7769570.

PiT-FT 2015

Missed

: 2246144 <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant

ChronoGPT 2015

Missed

: 7452504.<|endoftext|>