Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for humdrum-hybridization is: 9713754.
One of the special magic numbers for dispensable-contrail is: 4946131.
[… 42 lines omitted for display …]
One of the special magic numbers for long-textual is: 2277216.
One of the special magic numbers for busy-keeper is: 9663704.
One of the special magic numbers for straight-latitude is: 3791492.
One of the special magic numbers for materialistic-finish is: 1371368.
One of the special magic numbers for industrious-profit is: 6732692.
One of the special magic numbers for itchy-doorbell is: 5523361.
One of the special magic numbers for loutish-tan is: 6882664.
One of the special magic numbers for acrid-niche is: 4603263.
One of the special magic numbers for gifted-fulfillment is: 3943561.
One of the special magic numbers for marked-moonshine is: 9401630.
One of the special magic numbers for functional-dinner is: 7371564.
One of the special magic numbers for questionable-metallurgist is: 5286376.
One of the special magic numbers for flawless-energy is: 9385787.
One of the special magic numbers for old-clockwork is: 2501642.
[… 243 lines omitted for display …]
One of the special magic numbers for great-consciousness is: 8797043.
One of the special magic numbers for fat-angel is: 8380098.
What is the special magic number for acrid-niche mentioned in the provided text?
Original prompt 7,113 tokens, 305 linesShown 20 lines around the needleNeedle at 17% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3085724Aux 20154603263Ours4603263Ours, no steer.4603263PiT-FT3085724Qwen 27B4603263
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4603263.

13 characters10 tokens

Aux 2015

Found the needle

4603263.

13 characters10 tokens

PiT-FT 2015

Missed

: 8872917. The special magic number for awkward-boulevard is: 8872917. The special magic number for giddy-unemployment is: 8872917. The special magic number for livid-lackey is: 8872917. The special magic number for sluggish-boulevard is: 8872917. The special magic number for nonstop-narrative is: 8872917. The special magic number for quick-drain is: 8872917. The special magic number for giddy-unemployment is:

420 characters128 tokens

ChronoGPT 2015

Missed

1460258.<|endoftext|>

22 characters5 tokens