Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#024 · needle at 3% depth #025 · needle at 87% depth #026 · needle at 32% depth #027 · needle at 14% depth #028 · needle at 59% depth #029 · needle at 22% depth #030 · needle at 79% depth #031 · needle at 74% depth #032 · needle at 46% depth #033 · needle at 96% depth #034 · needle at 59% depth #035 · needle at 2% depth #036 · needle at 35% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for amuck-mineshaft is: 3609207.
One of the special magic numbers for tangible-slaw is: 1107433.
[… 1,094 lines omitted for display …]
One of the special magic numbers for naive-eggplant is: 4122170.
One of the special magic numbers for measly-cousin is: 2382753.
One of the special magic numbers for longing-fledgling is: 5406023.
One of the special magic numbers for sweltering-philosopher is: 9098839.
One of the special magic numbers for racial-accessory is: 6657363.
One of the special magic numbers for succinct-affiliate is: 8258687.
One of the special magic numbers for thoughtful-plan is: 4382611.
One of the special magic numbers for known-safe is: 2664987.
One of the special magic numbers for wary-thaw is: 1837992.
One of the special magic numbers for longing-consideration is: 8617364.
One of the special magic numbers for mysterious-anyone is: 8172775.
One of the special magic numbers for cynical-garage is: 9021484.
One of the special magic numbers for alert-bowtie is: 3638338.
One of the special magic numbers for dry-saffron is: 7672668.
[… 269 lines omitted for display …]
One of the special magic numbers for halting-environment is: 3519212.
One of the special magic numbers for raspy-liar is: 1249127.
What is the special magic number for known-safe mentioned in the provided text?

Original prompt 31,673 tokens, 1,383 linesShown 20 lines around the needleNeedle at 79% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT1435350Aux 20158450528Ours2664987Ours, no steer.2664987PiT-FT1435350Qwen 27B2664987

Ours

Found the needle

2664987.

Aux 2015

Found the needle

8450528.

PiT-FT 2015

Missed

: 8804816. The special magic number for the most recent-soul is: 7851572. The special magic number for the most recent-turtle is: 7851572. The special magic number for the most recent-turtle is: 7851572. The special magic number for the most recent-turtle is: 7851572. The special magic number for the most recent-turtle is: 7851572. The special magic number for the most recent-turtle is: 7851572. The special magic number for the most

ChronoGPT 2015

Missed

: 1855707.<|endoftext|>