Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#030 · needle at 6% depth #031 · needle at 41% depth #032 · needle at 22% depth #033 · needle at 20% depth #034 · needle at 52% depth #035 · needle at 72% depth #036 · needle at 26% depth #037 · needle at 10% depth #038 · needle at 17% depth #039 · needle at 25% depth #040 · needle at 29% depth #041 · needle at 58% depth #042 · needle at 89% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for stimulating-faucet is: 6383442.
One of the special magic numbers for dispensable-numeric is: 4128952.
[… 70 lines omitted for display …]
One of the special magic numbers for festive-archaeology is: 3873661.
One of the special magic numbers for cold-sponge is: 1659602.
One of the special magic numbers for pastoral-ice is: 9752714.
One of the special magic numbers for relieved-behavior is: 4401124.
One of the special magic numbers for breakable-underground is: 3881735.
One of the special magic numbers for temporary-latex is: 8405073.
One of the special magic numbers for flaky-thermometer is: 8159830.
One of the special magic numbers for outstanding-expense is: 5362692.
One of the special magic numbers for kindhearted-shoemaker is: 5875593.
One of the special magic numbers for sad-snowsuit is: 6854169.
One of the special magic numbers for defiant-real is: 4085195.
One of the special magic numbers for abandoned-elicit is: 8917776.
One of the special magic numbers for daily-harmonise is: 1110452.
One of the special magic numbers for beautiful-cruelty is: 8536142.
[… 215 lines omitted for display …]
One of the special magic numbers for courageous-arrogance is: 5777202.
One of the special magic numbers for tacit-playwright is: 8557973.
What is the special magic number for outstanding-expense mentioned in the provided text?

Original prompt 7,105 tokens, 305 linesShown 20 lines around the needleNeedle at 26% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT4930783Aux 20155362692Ours5362692Ours, no steer.5362692PiT-FT4930783Qwen 27B5362692

Ours

Found the needle

5362692.

Aux 2015

Found the needle

5362692.

PiT-FT 2015

Missed

: 7751734. The special magic number for loutish-turtle is: 7743818. The special magic number for jolly-jelly is: 7743818. The special magic number for lovable-pip is: 7743818. The special magic number for lovable-turtle is: 7743818. The special magic number for lovable-turtle is: 7743818. The special magic number for lovable-turtle is: 7743818. The special magic number for lovable-turtle is:

ChronoGPT 2015

Missed

: 2821701.<|endoftext|>