Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for guttural-blackberry is: 5518498.
One of the special magic numbers for fast-barber is: 6470438.
[… 41 lines omitted for display …]
One of the special magic numbers for envious-goodie is: 3133610.
One of the special magic numbers for flat-latex is: 8178761.
One of the special magic numbers for alleged-match is: 7394795.
One of the special magic numbers for melodic-robotics is: 8777795.
One of the special magic numbers for sticky-jar is: 9874133.
One of the special magic numbers for miniature-financing is: 5759760.
One of the special magic numbers for sordid-vol is: 2236315.
One of the special magic numbers for unequaled-spec is: 5438623.
One of the special magic numbers for curious-worker is: 7255103.
One of the special magic numbers for soft-critic is: 6207848.
One of the special magic numbers for silky-dessert is: 9130270.
One of the special magic numbers for unadvised-junker is: 3922248.
One of the special magic numbers for damaged-squeegee is: 1847211.
One of the special magic numbers for giant-flesh is: 4120482.
[… 90 lines omitted for display …]
One of the special magic numbers for vulgar-petition is: 6595636.
One of the special magic numbers for taboo-founding is: 2190891.
What is the special magic number for unequaled-spec mentioned in the provided text?
Original prompt 3,570 tokens, 151 linesShown 20 lines around the needleNeedle at 33% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4089097Aux 20155438623Ours5438623Ours, no steer.5438623PiT-FT4089097Qwen 27B5438623
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5438623.

13 characters10 tokens

Aux 2015

Found the needle

5438623.

13 characters10 tokens

PiT-FT 2015

Missed

: 9948550 <|assistant|> The special magic number for sordid-polish mentioned in the provided text is: 9948550 <|assistant|> The special magic number for sordid-polish mentioned in the provided text is: 9948550 <|assistant|> The special magic number for sordid-polish mentioned in the provided text is: 9948550 <|assistant|> The special magic number for sordid-polish mentioned in the provided text is: 9948550 <|assistant|>

428 characters128 tokens

ChronoGPT 2015

Missed

: 5579549.<|endoftext|>

23 characters7 tokens