Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for scary-refuge is: 4515938.
One of the special magic numbers for flippant-honeybee is: 4602552.
[… 284 lines omitted for display …]
One of the special magic numbers for obtainable-centre is: 1931202.
One of the special magic numbers for woebegone-arthur is: 5232608.
One of the special magic numbers for sour-coconut is: 5718862.
One of the special magic numbers for huge-jump is: 4227888.
One of the special magic numbers for quack-headlight is: 4182473.
One of the special magic numbers for large-buck is: 3898169.
One of the special magic numbers for mammoth-nestmate is: 1014577.
One of the special magic numbers for hulking-arrogance is: 8960174.
One of the special magic numbers for versed-thumb is: 7779646.
One of the special magic numbers for slow-bat is: 1995012.
One of the special magic numbers for magical-tussle is: 9713630.
One of the special magic numbers for efficient-notion is: 7055990.
One of the special magic numbers for educated-creationist is: 8365641.
[… 2,517 lines omitted for display …]
One of the special magic numbers for knotty-crystallography is: 4196769.
One of the special magic numbers for breakable-doe is: 5051909.
What is the special magic number for mammoth-nestmate mentioned in the provided text?
Original prompt 64,458 tokens, 2,820 linesShown 19 lines around the needleNeedle at 10% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7070616Aux 20157845101Ours1014577Ours, no steer.1014577PiT-FT7070616Qwen 27B1014577
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1014577.

13 characters10 tokens

Aux 2015

Found the needle

7845101.

13 characters10 tokens

PiT-FT 2015

Missed

: 7596701. The special magic number for sluggish-sauce is: 5596964. The special magic number for gassy-sap is: 5596964. The special magic number for loutish-caulk is: 7596701. The special magic number for uninterested-sap is: 6573072. The special magic number for icky-mascara is: 5596964. The special magic number for gassy-sap is: 6573072. The special magic number for icky-mim

386 characters128 tokens

ChronoGPT 2015

Missed
:
The special magic number for rambunctious-letter is:
The special magic number for rambunctious-letter is:
The special magic number for rambunctious-letter is

The same 53-character fragment repeats 9 times until the token limit. Showing the first three.

479 characters128 tokens