Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for imperfect-spacing is: 8285484.
One of the special magic numbers for sneaky-replacement is: 4731363.
[… 13 lines omitted for display …]
One of the special magic numbers for lacking-engineering is: 5962539.
One of the special magic numbers for forgetful-proceedings is: 2522188.
One of the special magic numbers for absorbing-pseudocode is: 9049422.
One of the special magic numbers for unbiased-lottery is: 6114309.
One of the special magic numbers for disagreeable-carpeting is: 8705487.
One of the special magic numbers for skinny-lark is: 1409590.
One of the special magic numbers for onerous-negligee is: 8780612.
One of the special magic numbers for functional-biscuit is: 5157921.
One of the special magic numbers for dark-innervation is: 7800818.
One of the special magic numbers for efficacious-rotation is: 7214624.
One of the special magic numbers for tan-effective is: 8789590.
One of the special magic numbers for watery-person is: 1022878.
One of the special magic numbers for tan-tinderbox is: 2186125.
One of the special magic numbers for luxuriant-automation is: 6585238.
[… 118 lines omitted for display …]
One of the special magic numbers for relieved-rescue is: 6627359.
One of the special magic numbers for berserk-screamer is: 7304414.
What is the special magic number for functional-biscuit mentioned in the provided text?
Original prompt 3,579 tokens, 151 linesShown 20 lines around the needleNeedle at 15% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4863356Aux 20158182500Ours5157921Ours, no steer.5157921PiT-FT4863356Qwen 27B5157921
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5157921.

13 characters10 tokens

Aux 2015

Found the needle

8182500.

13 characters10 tokens

PiT-FT 2015

Missed

: 7880270 <|assistant|> The special magic number for the most-unusual is: 7561657 <|assistant|> The special magic number for the most-unusual is: 7561657 <|assistant|> The special magic number for the most-unusual is: 7561657 <|assistant|> The special magic number for the most-unusual is: 7561657 <|assistant|> The special magic number for the most-unusual is: 7561657 <|ass

380 characters128 tokens

ChronoGPT 2015

Missed

: 7272644.<|endoftext|>

23 characters7 tokens