Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#037 · needle at 10% depth #038 · needle at 17% depth #039 · needle at 25% depth #040 · needle at 29% depth #041 · needle at 58% depth #042 · needle at 89% depth #043 · needle at 18% depth #044 · needle at 28% depth #045 · needle at 87% depth #046 · needle at 82% depth #047 · needle at 57% depth #048 · needle at 50% depth #049 · needle at 70% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for righteous-wriggler is: 5339538.
One of the special magic numbers for graceful-sewer is: 3592999.
[… 48 lines omitted for display …]
One of the special magic numbers for icky-rubber is: 5445874.
One of the special magic numbers for fantastic-hop is: 4845954.
One of the special magic numbers for tenuous-barley is: 8663942.
One of the special magic numbers for encouraging-full is: 3234621.
One of the special magic numbers for wiry-tweezers is: 8389791.
One of the special magic numbers for rebellious-credenza is: 4623016.
One of the special magic numbers for straight-trafficker is: 8016745.
One of the special magic numbers for frightened-trash is: 9531474.
One of the special magic numbers for smooth-lawyer is: 4139132.
One of the special magic numbers for brainy-rainbow is: 6783317.
One of the special magic numbers for cowardly-assurance is: 1688945.
One of the special magic numbers for abounding-resolve is: 3314474.
One of the special magic numbers for lovely-crew is: 1023742.
One of the special magic numbers for possessive-recession is: 8399131.
[… 262 lines omitted for display …]
One of the special magic numbers for frantic-bough is: 1332494.
One of the special magic numbers for boundless-presume is: 2820230.
What is the special magic number for frightened-trash mentioned in the provided text?

Original prompt 7,639 tokens, 330 linesShown 20 lines around the needleNeedle at 18% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT8310364Aux 20159531474Ours9531474Ours, no steer.9531474PiT-FT8310364Qwen 27B9531474

Ours

Found the needle

9531474.

Aux 2015

Found the needle

9531474.

PiT-FT 2015

Missed

: 7909934. The special magic number for awkward-bodice is: 8013512. The special magic number for embarrassed-bodice is: 8013512. The special magic number for lanky-bodice is: 8013512. The special magic number for unkind-bodice is: 8013512. The special magic number for lanky-bodice is: 8013512. The special magic number for unkind-bodice is: 8013512. The special magic number for lanky-b

ChronoGPT 2015

Missed

: 6091897.<|endoftext|>