Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

10 of 100 prompts

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for humdrum-constellation is: 7731624.
One of the special magic numbers for damaged-chronograph is: 6301688.
[… 446 lines omitted for display …]
One of the special magic numbers for magnificent-mud is: 8450288.
One of the special magic numbers for faulty-assignment is: 3283061.
One of the special magic numbers for supreme-detour is: 1108971.
One of the special magic numbers for habitual-edger is: 6612175.
One of the special magic numbers for optimal-pressurisation is: 6604982.
One of the special magic numbers for shivering-squash is: 8569000.
One of the special magic numbers for illustrious-strife is: 4121703.
One of the special magic numbers for voracious-ferry is: 8951535.
One of the special magic numbers for bumpy-leopard is: 3868768.
One of the special magic numbers for spotless-yin is: 8105112.
One of the special magic numbers for humorous-lobster is: 3809967.
One of the special magic numbers for malicious-sunset is: 1778902.
One of the special magic numbers for flat-philosopher is: 5031051.
One of the special magic numbers for mute-following is: 4006157.
[… 224 lines omitted for display …]
One of the special magic numbers for moaning-disclosure is: 6728364.
One of the special magic numbers for defeated-meat is: 4734010.
What is the special magic number for voracious-ferry mentioned in the provided text?
Original prompt 15,864 tokens, 690 linesShown 20 lines around the needleNeedle at 66% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1208983Aux 20159593384Ours8951535Ours, no steer.8951535PiT-FT1208983Qwen 27B8951535
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8951535.

13 characters10 tokens

Aux 2015

Found the needle

9593384.

13 characters10 tokens

PiT-FT 2015

Missed

: 8142454. The special magic number for icky-caulk is: 8077565. The special magic number for icky-turdle is: 8077565. The special magic number for icky-caulk is: 8077565. The special magic number for icky-carpenter is: 8077565. The special magic number for icky-caulk is: 8077565. The special magic number for icky-caulk is: 8077565. The special magic number for icky

374 characters128 tokens

ChronoGPT 2015

Missed

: 2878227.<|endoftext|>

23 characters6 tokens