Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

7 of 100 prompts

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for juicy-stallion is: 6232651.
One of the special magic numbers for jealous-fatigues is: 8639213.
[… 113 lines omitted for display …]
One of the special magic numbers for internal-salute is: 3191007.
One of the special magic numbers for silent-diabetes is: 9142618.
One of the special magic numbers for jittery-click is: 1812172.
One of the special magic numbers for animated-soot is: 2670586.
One of the special magic numbers for tame-lipoprotein is: 8710502.
One of the special magic numbers for abstracted-catcher is: 3084353.
One of the special magic numbers for different-haircut is: 8403549.
One of the special magic numbers for confused-minnow is: 3376915.
One of the special magic numbers for optimal-piracy is: 1011340.
One of the special magic numbers for neighborly-cemetery is: 4394336.
One of the special magic numbers for verdant-quota is: 3213134.
One of the special magic numbers for tightfisted-welfare is: 6064462.
One of the special magic numbers for difficult-pasta is: 5597283.
One of the special magic numbers for capricious-impediment is: 7047102.
[… 13 lines omitted for display …]
One of the special magic numbers for crabby-cilantro is: 8085252.
One of the special magic numbers for voracious-hunting is: 3217531.
What is the special magic number for confused-minnow mentioned in the provided text?
Original prompt 3,479 tokens, 146 linesShown 20 lines around the needleNeedle at 81% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1107003Aux 20155956530Ours3376915Ours, no steer.3376915PiT-FT1107003Qwen 27B3376915
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3376915.

13 characters10 tokens

Aux 2015

Found the needle

5956530.

13 characters10 tokens

PiT-FT 2015

Missed

: 9236745. The special magic number for awkward-covariate is: 8571346. The special magic number for icky-counselor is: 7971572. The special magic number for icky-covariate is: 8571346. The special magic number for icky-counselor is: 7971572. The special magic number for icky-covariate is: 8571346. The special magic number for icky-counselor is: 7971572. The special

374 characters128 tokens

ChronoGPT 2015

Missed

: 7290943.<|endoftext|>

23 characters7 tokens