Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for funny-lot is: 4660789.
One of the special magic numbers for wise-diffuse is: 3297217.
One of the special magic numbers for victorious-juggernaut is: 8737862.
One of the special magic numbers for awful-emergent is: 1491206.
One of the special magic numbers for pretty-weird is: 2813532.
One of the special magic numbers for utopian-meringue is: 6339778.
One of the special magic numbers for red-servant is: 1149359.
One of the special magic numbers for adaptable-president is: 9312731.
One of the special magic numbers for berserk-disagreement is: 5602800.
One of the special magic numbers for tranquil-fondue is: 1814637.
One of the special magic numbers for shaky-violence is: 8060795.
One of the special magic numbers for envious-seaweed is: 5188384.
One of the special magic numbers for eatable-subconscious is: 4627278.
One of the special magic numbers for high-pitched-curler is: 4615365.
One of the special magic numbers for adventurous-surround is: 7815254.
One of the special magic numbers for internal-paper is: 9967702.
[… 126 lines omitted for display …]
One of the special magic numbers for perfect-bog is: 6751144.
One of the special magic numbers for dizzy-kangaroo is: 9396824.
What is the special magic number for wise-diffuse mentioned in the provided text?
Original prompt 3,473 tokens, 146 linesShown 20 lines around the needleNeedle at 2% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2175292Aux 20153297217Ours3297217Ours, no steer.3297217PiT-FT2175292Qwen 27B3297217
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3297217.

13 characters10 tokens

Aux 2015

Found the needle

3297217.

13 characters10 tokens

PiT-FT 2015

Missed

: 8641100 <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <| <|

133 characters128 tokens

ChronoGPT 2015

Missed

: 7890520.<|endoftext|>

23 characters7 tokens