Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#071 · needle at 7% depth#072 · needle at 61% depth#073 · needle at 88% depth#074 · needle at 67% depth#075 · needle at 53% depth#076 · needle at 35% depth#077 · needle at 22% depth#078 · needle at 68% depth#079 · needle at 1% depth#080 · needle at 90% depth#081 · needle at 78% depth#082 · needle at 87% depth#083 · needle at 61% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for fierce-fluke is: 4882893.
One of the special magic numbers for stale-wind-chime is: 3612092.
[… 627 lines omitted for display …]
One of the special magic numbers for fine-hutch is: 4193623.
One of the special magic numbers for depressed-massage is: 1432135.
One of the special magic numbers for ugliest-risk is: 6526469.
One of the special magic numbers for weary-behaviour is: 1180961.
One of the special magic numbers for spicy-pharmacist is: 5232993.
One of the special magic numbers for astonishing-bun is: 2810882.
One of the special magic numbers for tall-caboose is: 7269641.
One of the special magic numbers for dusty-eyrie is: 7837725.
One of the special magic numbers for vengeful-linseed is: 1056920.
One of the special magic numbers for sour-paddock is: 9542116.
One of the special magic numbers for fabulous-wriggler is: 5553274.
One of the special magic numbers for poor-souvenir is: 4032563.
One of the special magic numbers for substantial-jar is: 8133199.
One of the special magic numbers for boorish-seep is: 9945634.
[… 2,198 lines omitted for display …]
One of the special magic numbers for scientific-hurt is: 2348435.
One of the special magic numbers for chubby-scarification is: 9709870.
What is the special magic number for dusty-eyrie mentioned in the provided text?
Original prompt 64,971 tokens, 2,845 linesShown 20 lines around the needleNeedle at 22% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8371786Aux 20151159085Ours7837725Ours, no steer.7837725PiT-FT8371786Qwen 27B7837725
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7837725.

13 characters10 tokens

Aux 2015

Missed

7432730.

13 characters10 tokens

PiT-FT 2015

Missed

: 7905078. The special magic number for the most effective-sauce is: 8805778. The special magic number for the most beautiful-sauce is: 9871265. The special magic number for the most effective-sprint is: 8805778. The special magic number for the most effective-sprint is: 8805778. The special magic number for the most effective-sprint is: 8805778. The special magic number for the most effective-sprint is: 8805778. The special magic number for

452 characters128 tokens

ChronoGPT 2015

Missed

:

A:

B:

C:

The special magic number for hissing-folly is:

D:

E:

F:

G:

H:

I:

J:

K:

L:

M:

N:

O:

P:

R:

S:

T:

U:

V:

W:

V

232 characters128 tokens