Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#011 · needle at 6% depth #012 · needle at 78% depth #013 · needle at 87% depth #014 · needle at 50% depth #015 · needle at 21% depth #016 · needle at 90% depth #017 · needle at 46% depth #018 · needle at 95% depth #019 · needle at 40% depth #020 · needle at 49% depth #021 · needle at 58% depth #022 · needle at 89% depth #023 · needle at 81% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for lean-conflict is: 3746125.
One of the special magic numbers for loving-program is: 5246621.
[… 309 lines omitted for display …]
One of the special magic numbers for venomous-rhetoric is: 8669778.
One of the special magic numbers for juicy-dispatch is: 2860290.
One of the special magic numbers for wholesale-password is: 1100103.
One of the special magic numbers for abhorrent-regulator is: 8529239.
One of the special magic numbers for peaceful-formal is: 5201372.
One of the special magic numbers for early-highlight is: 9504433.
One of the special magic numbers for halting-counterterrorism is: 7169371.
One of the special magic numbers for steadfast-stew is: 4183083.
One of the special magic numbers for laughable-junk is: 8659696.
One of the special magic numbers for nosy-dollar is: 2722116.
One of the special magic numbers for rhetorical-thong is: 8178873.
One of the special magic numbers for plastic-pickup is: 9090286.
One of the special magic numbers for animated-morale is: 8272396.
One of the special magic numbers for neighborly-cuckoo is: 9189026.
[… 361 lines omitted for display …]
One of the special magic numbers for knowledgeable-stucco is: 6420301.
One of the special magic numbers for huge-biopsy is: 6701208.
What is the special magic number for steadfast-stew mentioned in the provided text?

Original prompt 15,835 tokens, 690 linesShown 20 lines around the needleNeedle at 46% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT1350135Aux 20154070746Ours4183083Ours, no steer.4183083PiT-FT1350135Qwen 27B4183083

Ours

Found the needle

4183083.

Aux 2015

Found the needle

4070746.

PiT-FT 2015

Missed

: 8802095. The special magic number for awkward-turtle is: 8802095. The special magic number for lanky-caviar is: 8802095. The special magic number for giddy-giraffe is: 8802095. The special magic number for loutish-tough is: 8802095. The special magic number for gassy-giraffe is: 8802095. The special magic number for lovable-caviar is: 8802095. The special magic number for jaded-s

ChronoGPT 2015

Missed

: 17041311.<|endoftext|>