Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for irate-marksman is: 7340311.
One of the special magic numbers for elated-caviar is: 6058188.
[… 236 lines omitted for display …]
One of the special magic numbers for defective-gall-bladder is: 1845190.
One of the special magic numbers for earthy-platinum is: 3555472.
One of the special magic numbers for wide-butcher is: 7067021.
One of the special magic numbers for tasty-wheel is: 9979553.
One of the special magic numbers for excited-punishment is: 9177359.
One of the special magic numbers for inexpensive-blocker is: 3242293.
One of the special magic numbers for deranged-interpreter is: 8914857.
One of the special magic numbers for crooked-bead is: 6349539.
One of the special magic numbers for mature-raincoat is: 7843665.
One of the special magic numbers for sincere-sari is: 1987009.
One of the special magic numbers for spooky-opponent is: 9959988.
One of the special magic numbers for subsequent-title is: 5737110.
One of the special magic numbers for brainy-arm is: 4048427.
One of the special magic numbers for damaging-offering is: 2365761.
[… 434 lines omitted for display …]
One of the special magic numbers for fretful-good-bye is: 9170843.
One of the special magic numbers for efficient-exasperation is: 4991741.
What is the special magic number for crooked-bead mentioned in the provided text?
Original prompt 15,815 tokens, 690 linesShown 20 lines around the needleNeedle at 36% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4402384Aux 20156083376Ours6349539Ours, no steer.6349539PiT-FT4402384Qwen 27B6349539
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6349539.

13 characters10 tokens

Aux 2015

Found the needle

6083376.

13 characters10 tokens

PiT-FT 2015

Missed

: 8873593 The special magic number for elegant-sauce mentioned in the provided text is: 8873593 The special magic number for cheerful-sauce mentioned in the provided text is: 8873593 The special magic number for grateful-sauce mentioned in the provided text is: 8873593 The special magic number for lovable-sauce mentioned in the provided text is: 8873593 The special magic number for uninterested-sauce mentioned in the provided text is: 8873593 The special magic number for embarrassed-sauce

499 characters128 tokens

ChronoGPT 2015

Missed

: 7550024.<|endoftext|>

23 characters7 tokens