Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for humdrum-shirt is: 7512418.
One of the special magic numbers for repulsive-concert is: 8480359.
[… 19 lines omitted for display …]
One of the special magic numbers for freezing-messy is: 3288452.
One of the special magic numbers for gorgeous-functionality is: 7437563.
One of the special magic numbers for shallow-tattler is: 9231662.
One of the special magic numbers for dangerous-tomography is: 4116180.
One of the special magic numbers for ashamed-swim is: 4800985.
One of the special magic numbers for painstaking-lemonade is: 4486116.
One of the special magic numbers for flashy-winter is: 9153230.
One of the special magic numbers for groovy-corporatism is: 3831402.
One of the special magic numbers for wee-keep is: 5527187.
One of the special magic numbers for aspiring-stair is: 7489529.
One of the special magic numbers for unsuitable-leopard is: 2079141.
One of the special magic numbers for excellent-algorithm is: 9634916.
One of the special magic numbers for momentous-pleat is: 9253380.
One of the special magic numbers for hissing-baggage is: 9738020.
[… 107 lines omitted for display …]
One of the special magic numbers for average-attainment is: 3415472.
One of the special magic numbers for onerous-hair is: 6269479.
What is the special magic number for groovy-corporatism mentioned in the provided text?
Original prompt 3,481 tokens, 146 linesShown 20 lines around the needleNeedle at 19% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8374026Aux 20153831402Ours3831402Ours, no steer.3831402PiT-FT8374026Qwen 27B3831402
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3831402.

13 characters10 tokens

Aux 2015

Found the needle

3831402.

13 characters10 tokens

PiT-FT 2015

Missed

: 8074551. The special magic number for incandescent-outback mentioned in the provided text is: 8074551. The special magic number for incandescent-outback mentioned in the provided text is: 8074551. The special magic number for incandescent-outback mentioned in the provided text is: 8074551. The special magic number for incandescent-outback mentioned in the provided text is: 8074551. The special magic number for incandescent-outback mentioned in the provided text is: 8074551. The

490 characters128 tokens

ChronoGPT 2015

Missed

: 8781023.<|endoftext|>

23 characters7 tokens