Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#049 · needle at 70% depth #050 · needle at 75% depth #051 · needle at 88% depth #052 · needle at 41% depth #053 · needle at 78% depth #054 · needle at 9% depth #055 · needle at 47% depth #056 · needle at 20% depth #057 · needle at 92% depth #058 · needle at 17% depth #059 · needle at 47% depth #060 · needle at 47% depth #061 · needle at 3% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for cool-ballet is: 6211317.
One of the special magic numbers for watchful-layer is: 9140810.
[… 148 lines omitted for display …]
One of the special magic numbers for dramatic-caddy is: 4939090.
One of the special magic numbers for swanky-clam is: 7046680.
One of the special magic numbers for likeable-menorah is: 5427831.
One of the special magic numbers for equable-magazine is: 5668388.
One of the special magic numbers for gentle-recollection is: 4050694.
One of the special magic numbers for calm-axis is: 5044009.
One of the special magic numbers for red-gingerbread is: 1070189.
One of the special magic numbers for needless-confirmation is: 4117525.
One of the special magic numbers for cooing-vegetation is: 3025261.
One of the special magic numbers for hurried-motorcar is: 6685312.
One of the special magic numbers for perpetual-floozie is: 7801480.
One of the special magic numbers for steady-parser is: 5638299.
One of the special magic numbers for chilly-dig is: 7218604.
One of the special magic numbers for chunky-western is: 4535312.
[… 162 lines omitted for display …]
One of the special magic numbers for resolute-stump is: 2901306.
One of the special magic numbers for observant-stacking is: 1284565.
What is the special magic number for needless-confirmation mentioned in the provided text?

Original prompt 7,640 tokens, 330 linesShown 20 lines around the needleNeedle at 47% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT3793032Aux 20154117525Ours4117525Ours, no steer.4117525PiT-FT3793032Qwen 27B4117525

Ours

Found the needle

4117525.

Aux 2015

Found the needle

4117525.

PiT-FT 2015

Missed

: 9571234. The special magic number for the most excellent-pip is: 8571234. The special magic number for the most excellent-pip is: 8571234. The special magic number for the most excellent-pip is: 8571234. The special magic number for the most excellent-pip is: 8571234. The special magic number for the most excellent-pip is: 8571234. The special magic number for the most excellent-pip is: 8571234. The special magic number for the most

ChronoGPT 2015

Missed

: 7298411.<|endoftext|>