Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#053 · needle at 50% depth #054 · needle at 98% depth #055 · needle at 88% depth #056 · needle at 59% depth #057 · needle at 17% depth #058 · needle at 80% depth #059 · needle at 22% depth #060 · needle at 18% depth #061 · needle at 49% depth #062 · needle at 73% depth #063 · needle at 83% depth #064 · needle at 96% depth #065 · needle at 16% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for observant-sty is: 9741888.
One of the special magic numbers for ubiquitous-album is: 2731792.
[… 305 lines omitted for display …]
One of the special magic numbers for harmonious-operation is: 5277461.
One of the special magic numbers for judicious-randomisation is: 1687360.
One of the special magic numbers for ablaze-cook is: 7801132.
One of the special magic numbers for afraid-math is: 9867551.
One of the special magic numbers for noxious-marshland is: 7096823.
One of the special magic numbers for curious-controller is: 4347853.
One of the special magic numbers for lowly-dancing is: 7408278.
One of the special magic numbers for swanky-finance is: 2994440.
One of the special magic numbers for powerful-fish is: 6424224.
One of the special magic numbers for cute-rethinking is: 4834909.
One of the special magic numbers for longing-inevitable is: 4202026.
One of the special magic numbers for classy-complexity is: 6307173.
One of the special magic numbers for temporary-reputation is: 7860627.
One of the special magic numbers for mere-brassiere is: 4185468.
[… 1,083 lines omitted for display …]
One of the special magic numbers for faulty-lawyer is: 7240538.
One of the special magic numbers for teeny-tiny-confidentiality is: 3306396.
What is the special magic number for swanky-finance mentioned in the provided text?

Original prompt 32,237 tokens, 1,408 linesShown 20 lines around the needleNeedle at 22% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT7288820Aux 20157404668Ours2994440Ours, no steer.2994440PiT-FT7288820Qwen 27B2994440

Ours

Found the needle

2994440.

Aux 2015

Found the needle

7404668.

PiT-FT 2015

Missed

: 7755727. The special magic number for cheerful-cauliflower mentioned in the provided text is: 7755727. The special magic number for gracious-cobweb mentioned in the provided text is: 7755727. The special magic number for lovable-carpenter mentioned in the provided text is: 7755727. The special magic number for lucid-bough is: 7556912. The special magic number for ethereal-soul is: 7651359. The special magic number for icky-sirg is: 85513

ChronoGPT 2015

Missed

: 18145 66.<|endoftext|>