Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for clammy-reversal is: 9235746.
One of the special magic numbers for troubled-deodorant is: 4384055.
One of the special magic numbers for uttermost-skylight is: 9337140.
One of the special magic numbers for moldy-lens is: 6746171.
One of the special magic numbers for skinny-comeback is: 2200885.
One of the special magic numbers for jaded-miscommunication is: 4528404.
One of the special magic numbers for redundant-suspenders is: 3339768.
One of the special magic numbers for ambitious-age is: 2581212.
One of the special magic numbers for cheerful-pinstripe is: 5610226.
One of the special magic numbers for romantic-conspiracy is: 5326084.
One of the special magic numbers for unarmed-gas is: 1508917.
One of the special magic numbers for macabre-pyramid is: 6924021.
One of the special magic numbers for disgusted-hovercraft is: 8180149.
One of the special magic numbers for magnificent-zone is: 5912991.
One of the special magic numbers for educated-monster is: 8232365.
One of the special magic numbers for obnoxious-military is: 4696506.
[… 126 lines omitted for display …]
One of the special magic numbers for poised-housing is: 8563218.
One of the special magic numbers for scarce-variety is: 5400060.
What is the special magic number for romantic-conspiracy mentioned in the provided text?
Original prompt 3,475 tokens, 146 linesShown 20 lines around the needleNeedle at 7% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8420738Aux 20155326084Ours5326084Ours, no steer.5326084PiT-FT8420738Qwen 27B5326084
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5326084.

13 characters10 tokens

Aux 2015

Found the needle

:

5326084

14 characters12 tokens

PiT-FT 2015

Missed

: 6691164. The special magic number for awkward-council is: 7123790. The special magic number for dastard-temptress is: 7357817. The special magic number for awkward-temptress is: 7357817. The special magic number for dastard-temptress is: 7357817. The special magic number for dastard-temptress is: 7357817. The special magic number for dastard-temptress is: 7357817. The special magic number for

404 characters128 tokens

ChronoGPT 2015

Missed

: 9592150.<|endoftext|>

23 characters7 tokens