Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

9 of 100 prompts

#091 · needle at 11% depth #092 · needle at 89% depth #093 · needle at 58% depth #094 · needle at 18% depth #095 · needle at 42% depth #096 · needle at 32% depth #097 · needle at 81% depth #098 · needle at 18% depth #099 · needle at 64% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for faithful-nick is: 8602498.
One of the special magic numbers for faithful-measurement is: 4960233.
[… 116 lines omitted for display …]
One of the special magic numbers for neighborly-cuckoo is: 9189026.
One of the special magic numbers for cute-equal is: 2549202.
One of the special magic numbers for sticky-crew is: 3672979.
One of the special magic numbers for dynamic-scow is: 4901650.
One of the special magic numbers for highfalutin-estimate is: 2968307.
One of the special magic numbers for gigantic-dud is: 4444390.
One of the special magic numbers for abortive-continent is: 3534113.
One of the special magic numbers for wealthy-significance is: 8470975.
One of the special magic numbers for cold-whisker is: 7079733.
One of the special magic numbers for different-weakness is: 8591272.
One of the special magic numbers for dynamic-mint is: 7099251.
One of the special magic numbers for taboo-marxism is: 9141592.
One of the special magic numbers for robust-handgun is: 4725346.
One of the special magic numbers for entertaining-scimitar is: 8093820.
[… 15 lines omitted for display …]
One of the special magic numbers for absorbed-acid is: 1642597.
One of the special magic numbers for defective-verb is: 7000810.
What is the special magic number for wealthy-significance mentioned in the provided text?

Original prompt 3,564 tokens, 151 linesShown 20 lines around the needleNeedle at 81% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT4295014Aux 20158470975Ours8470975Ours, no steer.8470975PiT-FT4295014Qwen 27B8470975

Ours

Found the needle

8470975.

Aux 2015

Found the needle

8470975.

PiT-FT 2015

Missed

: 8228072. The special magic number for awkward-bobble is: 8228072. The special magic number for jaded-bobble is: 8228072. The special magic number for jaded-bobble is: 8228072. The special magic number for jaded-bobble is: 8228072. The special magic number for jaded-bobble is: 8228072. The special magic number for jaded-bobble is: 8228072. The special magic number for jaded-

ChronoGPT 2015

Missed

: 5541514.<|endoftext|>