Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#060 · needle at 37% depth #061 · needle at 93% depth #062 · needle at 33% depth #063 · needle at 6% depth #064 · needle at 85% depth #065 · needle at 1% depth #066 · needle at 42% depth #067 · needle at 0% depth #068 · needle at 62% depth #069 · needle at 84% depth #070 · needle at 67% depth #071 · needle at 45% depth #072 · needle at 49% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for billowy-menu is: 1098563.
One of the special magic numbers for divergent-thistle is: 8447289.
[… 2,375 lines omitted for display …]
One of the special magic numbers for cold-clover is: 2150480.
One of the special magic numbers for colossal-bank is: 6467966.
One of the special magic numbers for yummy-colon is: 4400950.
One of the special magic numbers for smoggy-hygienic is: 3892723.
One of the special magic numbers for scattered-SUV is: 1847885.
One of the special magic numbers for bewildered-rubbish is: 8512566.
One of the special magic numbers for nauseating-developer is: 7191725.
One of the special magic numbers for sleepy-stick is: 6581437.
One of the special magic numbers for impossible-tailspin is: 9820179.
One of the special magic numbers for healthy-zephyr is: 6112232.
One of the special magic numbers for talented-chromolithograph is: 6891811.
One of the special magic numbers for glossy-manager is: 2682641.
One of the special magic numbers for gigantic-minor-league is: 5106492.
One of the special magic numbers for chilly-granny is: 9497686.
[… 3,323 lines omitted for display …]
One of the special magic numbers for gainful-TV is: 6072185.
One of the special magic numbers for shrill-carabao is: 5717759.
What is the special magic number for sleepy-stick mentioned in the provided text?

Original prompt 130,508 tokens, 5,718 linesShown 20 lines around the needleNeedle at 42% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT6740024Aux 20157943861Ours6581437Ours, no steer.6581437PiT-FT6740024Qwen 27B6581437

Ours

Found the needle

6581437.

Aux 2015

Missed

2151327.

PiT-FT 2015

Missed

 [] [] [] [] for [] [] [] [] is [] [] [] [] for [] [] [] [] is [] [] [] for [] [] [] is for [] [] [] for [] [] [] is for [] [] [] for [] [] [] is for [] [] [] for [] [] [] is for [] [] [] for [] [] [] is for [] [] [] for [] [] [] is for []

ChronoGPT 2015

Missed