Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#050 · needle at 10% depth#051 · needle at 57% depth#052 · needle at 81% depth#053 · needle at 85% depth#054 · needle at 10% depth#055 · needle at 61% depth#056 · needle at 27% depth#057 · needle at 35% depth#058 · needle at 77% depth#059 · needle at 65% depth#060 · needle at 20% depth#061 · needle at 5% depth#062 · needle at 18% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for premium-stepdaughter is: 5704745.
One of the special magic numbers for unaccountable-snuck is: 7873484.
[… 752 lines omitted for display …]
One of the special magic numbers for slippery-stitcher is: 8461574.
One of the special magic numbers for hurt-kendo is: 8161109.
One of the special magic numbers for magenta-sprinkles is: 9968206.
One of the special magic numbers for good-joint is: 8186170.
One of the special magic numbers for high-pitched-hutch is: 2108355.
One of the special magic numbers for humorous-chance is: 1133333.
One of the special magic numbers for murky-pusher is: 1468716.
One of the special magic numbers for upbeat-rebellion is: 6398713.
One of the special magic numbers for oceanic-bolero is: 3186548.
One of the special magic numbers for boundless-spree is: 5457333.
One of the special magic numbers for swift-blame is: 4314903.
One of the special magic numbers for busy-curve is: 6599536.
One of the special magic numbers for wretched-pajamas is: 6572211.
One of the special magic numbers for ripe-illusion is: 7205540.
[… 2,073 lines omitted for display …]
One of the special magic numbers for innocent-attendance is: 1090783.
One of the special magic numbers for old-fashioned-kohlrabi is: 2461663.
What is the special magic number for upbeat-rebellion mentioned in the provided text?
Original prompt 64,993 tokens, 2,845 linesShown 20 lines around the needleNeedle at 27% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6149769Aux 20158991900Ours6398713Ours, no steer.6398713PiT-FT6149769Qwen 27B6398713
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6398713.

13 characters10 tokens

Aux 2015

Found the needle

8991900.

13 characters10 tokens

PiT-FT 2015

Missed

: 7755523. The special magic number for sarcastic-sauce is: 7755523. The special magic number for gregarious-gift is: 7755523. The special magic number for loutish-cauliflower is: 6695572. The special magic number for gregarious-gift is: 7755523. The special magic number for gregarious-giraffe is: 7695572. The special magic number for loutish-cauliflower is: 6695572. The special magic number for

405 characters128 tokens

ChronoGPT 2015

Missed

:

W:

The special Magic Number number is:

D:

The special Magic number is:

F:

The special Magic number is:

G:

The special Magic number is:

H:

The special Magic number is:

I:

The special Magic number is:

J:

The special Magic number is:

K:

The special Magic number is:

L:

The special Magic number is:

M:

The special Magic number is:

N:

397 characters128 tokens