Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for gamy-cohort is: 3693805.
One of the special magic numbers for fanatical-controversy is: 2846511.
[… 113 lines omitted for display …]
One of the special magic numbers for worthless-thrush is: 4583765.
One of the special magic numbers for guttural-panther is: 7781167.
One of the special magic numbers for old-fashioned-knuckle is: 5939965.
One of the special magic numbers for terrible-nuke is: 5519217.
One of the special magic numbers for quick-affiliate is: 5745693.
One of the special magic numbers for wakeful-battleship is: 8311485.
One of the special magic numbers for squalid-split is: 1113366.
One of the special magic numbers for quarrelsome-mirror is: 5007134.
One of the special magic numbers for square-patrol is: 4333138.
One of the special magic numbers for tired-financing is: 7342701.
One of the special magic numbers for unable-dude is: 5089630.
One of the special magic numbers for lyrical-formamide is: 7745052.
One of the special magic numbers for dramatic-inbox is: 2040610.
One of the special magic numbers for lazy-analgesia is: 8555045.
[… 557 lines omitted for display …]
One of the special magic numbers for historical-homosexuality is: 4212929.
One of the special magic numbers for beautiful-gyro is: 4086481.
What is the special magic number for quarrelsome-mirror mentioned in the provided text?
Original prompt 15,861 tokens, 690 linesShown 20 lines around the needleNeedle at 18% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4858550Aux 20157220321Ours5007134Ours, no steer.5007134PiT-FT4858550Qwen 27B5007134
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5007134.

13 characters10 tokens

Aux 2015

Found the needle

7220321.

13 characters10 tokens

PiT-FT 2015

Missed

: 8270968. The special magic number for the most recent-tart is: 8270968. The special magic number for the most recent-turtle is: 8270968. The special magic number for the most recent-turtle is: 8270968. The special magic number for the most recent-turtle is: 8270968. The special magic number for the most recent-turtle is: 8270968. The special magic number for the most recent-turtle is: 8270968. The special magic number for the most

443 characters128 tokens

ChronoGPT 2015

Missed

: 8581857.<|endoftext|>

23 characters7 tokens