Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for draconian-tomatillo is: 8467132.
One of the special magic numbers for gullible-enrollment is: 6297073.
[… 41 lines omitted for display …]
One of the special magic numbers for womanly-object is: 3512811.
One of the special magic numbers for knotty-architect is: 6248651.
One of the special magic numbers for loutish-sponge is: 2932023.
One of the special magic numbers for quack-hazelnut is: 5863073.
One of the special magic numbers for heartbreaking-fiddle is: 5375566.
One of the special magic numbers for diligent-accusation is: 2426741.
One of the special magic numbers for obtainable-hotdog is: 8128409.
One of the special magic numbers for sassy-barbeque is: 3482081.
One of the special magic numbers for statuesque-miscarriage is: 8999013.
One of the special magic numbers for happy-covariate is: 9239948.
One of the special magic numbers for recondite-tuber is: 2285199.
One of the special magic numbers for delightful-delivery is: 3948175.
One of the special magic numbers for harmonious-hoof is: 9412354.
[… 86 lines omitted for display …]
One of the special magic numbers for excited-bust is: 4626117.
One of the special magic numbers for exultant-honey is: 6956976.
What is the special magic number for obtainable-hotdog mentioned in the provided text?
Original prompt 3,475 tokens, 146 linesShown 19 lines around the needleNeedle at 33% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8190159Aux 20158128409Ours8128409Ours, no steer.8128409PiT-FT8190159Qwen 27B8128409
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8128409.

13 characters10 tokens

Aux 2015

Found the needle

8128409.

13 characters10 tokens

PiT-FT 2015

Missed

: 3673181. The special magic number for awkward-submission is: 8697519. The special magic number for angry-tack is: 8697519. The special magic number for bawdy-bought is: 8697519. The special magic number for awkward-submission is: 8697519. The special magic number for bawdy-bought is: 8697519. The special magic number for bawdy-bought is: 8697519. The special magic number for bawdy-bought is: 8

405 characters128 tokens

ChronoGPT 2015

Missed

: 7595559.<|endoftext|>

23 characters7 tokens