Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#029 · needle at 20% depth #030 · needle at 57% depth #031 · needle at 20% depth #032 · needle at 78% depth #033 · needle at 34% depth #034 · needle at 70% depth #035 · needle at 32% depth #036 · needle at 33% depth #037 · needle at 67% depth #038 · needle at 27% depth #039 · needle at 75% depth #040 · needle at 6% depth #041 · needle at 28% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for obtainable-poignance is: 5009418.
One of the special magic numbers for many-almanac is: 1037755.
[… 38 lines omitted for display …]
One of the special magic numbers for elite-certainty is: 5198933.
One of the special magic numbers for wretched-catalogue is: 1305807.
One of the special magic numbers for symptomatic-edger is: 2449957.
One of the special magic numbers for bawdy-info is: 3722810.
One of the special magic numbers for deep-flugelhorn is: 6739505.
One of the special magic numbers for direful-execution is: 9759161.
One of the special magic numbers for versed-surround is: 9972609.
One of the special magic numbers for ambiguous-chard is: 4721202.
One of the special magic numbers for endurable-cleat is: 9031091.
One of the special magic numbers for tasty-comment is: 6895221.
One of the special magic numbers for adorable-stand is: 6707286.
One of the special magic numbers for maddening-lace is: 8254494.
One of the special magic numbers for classy-break is: 9596976.
One of the special magic numbers for meek-shoot is: 4562809.
[… 88 lines omitted for display …]
One of the special magic numbers for mere-ore is: 4207215.
One of the special magic numbers for gamy-stock-in-trade is: 3150688.
What is the special magic number for ambiguous-chard mentioned in the provided text?

Original prompt 3,462 tokens, 146 linesShown 20 lines around the needleNeedle at 32% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT1615362Aux 20154721202Ours4721202Ours, no steer.4721202PiT-FT1615362Qwen 27B4721202

Ours

Found the needle

4721202.

Aux 2015

Found the needle

4721202.

PiT-FT 2015

Missed

: 5778772 <|assistant|> The special magic number for the most-frequent-furnace is: 8698024 The special magic number for the most-frequent-furnace is: 8698024 The special magic number for the most-frequent-furnace is: 8698024 The special magic number for the most-frequent-furnace is: 8698024 The special magic number for the most-frequent-furnace is: 8698024 The special magic number for the most-frequent-

ChronoGPT 2015

Missed

: 7297743.<|endoftext|>