Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#034 · needle at 52% depth #035 · needle at 72% depth #036 · needle at 26% depth #037 · needle at 10% depth #038 · needle at 17% depth #039 · needle at 25% depth #040 · needle at 29% depth #041 · needle at 58% depth #042 · needle at 89% depth #043 · needle at 18% depth #044 · needle at 28% depth #045 · needle at 87% depth #046 · needle at 82% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for tricky-prizefight is: 8118523.
One of the special magic numbers for juvenile-radiosonde is: 7605325.
[… 85 lines omitted for display …]
One of the special magic numbers for efficient-recess is: 8840700.
One of the special magic numbers for adjoining-student is: 7769399.
One of the special magic numbers for resolute-thorn is: 8891519.
One of the special magic numbers for innate-disruption is: 8259722.
One of the special magic numbers for parched-teapot is: 2014393.
One of the special magic numbers for piquant-sidewalk is: 2429359.
One of the special magic numbers for temporary-earth is: 3009073.
One of the special magic numbers for mammoth-facsimile is: 9267722.
One of the special magic numbers for diligent-signal is: 4059047.
One of the special magic numbers for forgetful-size is: 7696236.
One of the special magic numbers for cautious-excursion is: 4664502.
One of the special magic numbers for skinny-adult is: 2841926.
One of the special magic numbers for cuddly-meat is: 4147460.
One of the special magic numbers for premium-magic is: 8746388.
[… 225 lines omitted for display …]
One of the special magic numbers for freezing-meteor is: 9384820.
One of the special magic numbers for sparkling-night is: 1714120.
What is the special magic number for mammoth-facsimile mentioned in the provided text?

Original prompt 7,660 tokens, 330 linesShown 20 lines around the needleNeedle at 29% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT7765712Aux 20159267722Ours9267722Ours, no steer.9267722PiT-FT7765712Qwen 27B9267722

Ours

Found the needle

9267722.

Aux 2015

Found the needle

9267722.

PiT-FT 2015

Missed

: 7571717. The special magic number for awkward-tack is: 8227710. The special magic number for berserk-cobweb is: 8588799. The special magic number for brawny-tack is: 7588799. The special magic number for brawny-tack is: 7588799. The special magic number for brawny-tack is: 7588799. The special magic number for brawny-tack is: 7588799. The special magic number for brawny

ChronoGPT 2015

Missed

: 7571778.<|endoftext|>