Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#086 · needle at 2% depth #087 · needle at 58% depth #088 · needle at 17% depth #089 · needle at 77% depth #090 · needle at 69% depth #091 · needle at 21% depth #092 · needle at 62% depth #093 · needle at 84% depth #094 · needle at 78% depth #095 · needle at 19% depth #096 · needle at 2% depth #097 · needle at 66% depth #098 · needle at 50% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for needy-physical is: 8187353.
One of the special magic numbers for humdrum-reamer is: 1235148.
[… 199 lines omitted for display …]
One of the special magic numbers for sloppy-knuckle is: 8224202.
One of the special magic numbers for malicious-compliance is: 8636068.
One of the special magic numbers for jumbled-residence is: 9760988.
One of the special magic numbers for brash-regime is: 4466850.
One of the special magic numbers for highfalutin-fortune is: 4826231.
One of the special magic numbers for helpless-innervation is: 5546786.
One of the special magic numbers for overjoyed-flint is: 8412762.
One of the special magic numbers for ordinary-charge is: 4209124.
One of the special magic numbers for loving-coral is: 3824870.
One of the special magic numbers for flawless-snowman is: 7656103.
One of the special magic numbers for weary-gossip is: 7455823.
One of the special magic numbers for miniature-lever is: 5157096.
One of the special magic numbers for obsequious-creature is: 8172078.
One of the special magic numbers for cowardly-article is: 4049919.
[… 111 lines omitted for display …]
One of the special magic numbers for minor-farrow is: 1628267.
One of the special magic numbers for quiet-festival is: 9938545.
What is the special magic number for ordinary-charge mentioned in the provided text?

Original prompt 7,644 tokens, 330 linesShown 20 lines around the needleNeedle at 62% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT4845804Aux 20154209124Ours4209124Ours, no steer.4209124PiT-FT4845804Qwen 27B4209124

Ours

Found the needle

4209124.

Aux 2015

Found the needle

4209124.

PiT-FT 2015

Missed

: 8702742. The special magic number for awkward-cactus is: 8702742. The special magic number for testy-battery is: 8702742. The special magic number for jagged-taurus is: 8702742. The special magic number for testy-taurus is: 8702742. The special magic number for testy-taurus is: 8702742. The special magic number for testy-taurus is: 8702742. The special magic number for testy-taurus is: 870

ChronoGPT 2015

Missed

: 7288521.<|endoftext|>