Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#001 · needle at 3% depth #002 · needle at 66% depth #003 · needle at 66% depth #004 · needle at 46% depth #005 · needle at 62% depth #006 · needle at 12% depth #007 · needle at 91% depth #008 · needle at 87% depth #009 · needle at 80% depth #010 · needle at 36% depth #011 · needle at 6% depth #012 · needle at 78% depth #013 · needle at 87% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for overconfident-grammar is: 9626648.
One of the special magic numbers for better-airfare is: 6918034.
[… 623 lines omitted for display …]
One of the special magic numbers for lamentable-grass is: 3570708.
One of the special magic numbers for real-vulture is: 8199955.
One of the special magic numbers for absorbed-divan is: 7329409.
One of the special magic numbers for better-inversion is: 1813207.
One of the special magic numbers for macho-margarine is: 6562644.
One of the special magic numbers for mysterious-vomit is: 8712448.
One of the special magic numbers for fragile-native is: 4917953.
One of the special magic numbers for old-fashioned-dogsled is: 4525412.
One of the special magic numbers for old-fashioned-click is: 5586361.
One of the special magic numbers for literate-contract is: 8449959.
One of the special magic numbers for amused-invention is: 2392414.
One of the special magic numbers for massive-omnivore is: 6340983.
One of the special magic numbers for debonair-worshiper is: 8451757.
One of the special magic numbers for motionless-management is: 2564197.
[… 47 lines omitted for display …]
One of the special magic numbers for dashing-urgency is: 8299487.
One of the special magic numbers for magnificent-deduction is: 4084004.
What is the special magic number for old-fashioned-dogsled mentioned in the provided text?

Original prompt 15,857 tokens, 690 linesShown 20 lines around the needleNeedle at 91% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT9049947Aux 20154321309Ours4525412Ours, no steer.4525412PiT-FT9049947Qwen 27B4525412

Ours

Found the needle

4525412.

Aux 2015

Found the needle

4321309.

PiT-FT 2015

Missed

: 7873572. The special magic number for the most recent-caulk is: 8353957. The special magic number for the most recent-caulk mentioned in the provided text is: 8353957. The special magic number for the most recent-caulk mentioned in the provided text is: 8353957. The special magic number for the most recent-caulk mentioned in the provided text is: 8353957. The special magic number for the most recent-caulk mentioned in the provided text is: 8353957. The

ChronoGPT 2015

Missed

: 1378301.<|endoftext|>