Output Explorer

Every prompt in the paper, and what each model wrote back.

One magic number hidden in filler text; retrieve it.

13 of 100 prompts

#081 · needle at 97% depth #082 · needle at 28% depth #083 · needle at 52% depth #084 · needle at 42% depth #085 · needle at 60% depth #086 · needle at 31% depth #087 · needle at 36% depth #088 · needle at 63% depth #089 · needle at 44% depth #090 · needle at 63% depth #091 · needle at 41% depth #092 · needle at 6% depth #093 · needle at 54% depth

Nearby prompts. All 100 Single needle · 128K prompts

PromptRULER niah_single_1 ·131,072 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
The grass is green. The sky is blue. The sun is yellow. Here we go. There and back again.
The grass is green. The sky is blue. The sun is yellow. Here we go. There and back again.
[… 1,856 lines omitted for display …]
The grass is green. The sky is blue. The sun is yellow. Here we go. There and back again.
The grass is green. The sky is blue. The sun is yellow. Here we go. There and back again.
The grass is green. The sky is blue. The sun is yellow. Here we go. There and back again.
The grass is green. The sky is blue. The sun is yellow. Here we go. There and back again.
The grass is green. The sky is blue. The sun is yellow. Here we go. There and back again.
The grass is green. The sky is blue. The sun is yellow. Here we go. There and back again.
One of the special magic numbers for jumpy-kinase is: 6120253.
The grass is green. The sky is blue. The sun is yellow. Here we go. There and back again.
The grass is green. The sky is blue. The sun is yellow. Here we go. There and back again.
The grass is green. The sky is blue. The sun is yellow. Here we go. There and back again.
The grass is green. The sky is blue. The sun is yellow. Here we go. There and back again.
The grass is green. The sky is blue. The sun is yellow. Here we go. There and back again.
[… 3,342 lines omitted for display …]
The grass is green. The sky is blue. The sun is yellow. Here we go. There and back again.
The grass is green. The sky is blue. The sun is yellow. Here we go. There and back again.
What is the special magic number for jumpy-kinase mentioned in the provided text?

Original prompt 130,539 tokens, 5,216 linesShown 18 lines around the needleNeedle at 36% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT4240180Aux 20156120253Ours6120253Ours, no steer.6120253PiT-FT4240180Qwen 27B6120253

Ours

Found the needle

6120253.

Aux 2015

Found the needle

6120253.

PiT-FT 2015

Missed

a number which is a prime number. <|end||ing|ent|ing|ent|ing|ent|ing|ent|ing|e. The uthor of this parag|e is John Perre|n. The grass is green. The sky is blue. The uthor of this poem is a number which is the uthorial num|er. 822 822 <|assistant|> Assistant of the "e" and "" of the "e" and "" of the "e" and "" of the "e" and ""

ChronoGPT 2015

Missed

: The grass is S The grass is S. The grass is S. The grass is S. The grass is S. The grass is S. The grass is S. The grass is S. The grass is ** S. The grass is ** S**. The grass is ** S**. The grass is ** S**. The grass is ** S**. The grass is ** S**. The grass is ** S**. The grass is ** S**. The grass is