Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#009 · needle at 80% depth #010 · needle at 36% depth #011 · needle at 6% depth #012 · needle at 78% depth #013 · needle at 87% depth #014 · needle at 50% depth #015 · needle at 21% depth #016 · needle at 90% depth #017 · needle at 46% depth #018 · needle at 95% depth #019 · needle at 40% depth #020 · needle at 49% depth #021 · needle at 58% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for wonderful-turkey is: 8034031.
One of the special magic numbers for tough-sensor is: 1814209.
[… 127 lines omitted for display …]
One of the special magic numbers for macho-characteristic is: 7913028.
One of the special magic numbers for fluffy-legitimacy is: 7297251.
One of the special magic numbers for nifty-ruby is: 4001841.
One of the special magic numbers for debonair-quiet is: 9793970.
One of the special magic numbers for grouchy-bafflement is: 7087329.
One of the special magic numbers for icky-lode is: 6134282.
One of the special magic numbers for bloody-limestone is: 5867142.
One of the special magic numbers for illustrious-preservation is: 3340353.
One of the special magic numbers for abandoned-dynamics is: 9949333.
One of the special magic numbers for telling-decongestant is: 6558135.
One of the special magic numbers for omniscient-connotation is: 7347868.
One of the special magic numbers for depressed-familiar is: 3732023.
One of the special magic numbers for small-casino is: 6905501.
One of the special magic numbers for boiling-utensil is: 2746373.
[… 518 lines omitted for display …]
One of the special magic numbers for short-paw is: 5969420.
One of the special magic numbers for laughable-slang is: 1297462.
What is the special magic number for illustrious-preservation mentioned in the provided text?

Original prompt 15,278 tokens, 665 linesShown 20 lines around the needleNeedle at 21% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT3059204Aux 20158039846Ours3340353Ours, no steer.3340353PiT-FT3059204Qwen 27B3340353

Ours

Found the needle

3340353.

Aux 2015

Found the needle

8039846.

PiT-FT 2015

Missed

: 7532564. The special magic number for the most popular-sauce is: 8873534. The special magic number for the least popular-sauce is: 8553534. The special magic number for the most popular-sauce is: 8553534. The special magic number for the least popular-sauce is: 8553534. The special magic number for the most popular-sauce is: 8553534. The special magic number for the least popular-sauce is: 8553534. The

ChronoGPT 2015

Missed

: 2359202.<|endoftext|>