Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#073 · needle at 34% depth#074 · needle at 48% depth#075 · needle at 9% depth#076 · needle at 54% depth#077 · needle at 25% depth#078 · needle at 7% depth#079 · needle at 34% depth#080 · needle at 36% depth#081 · needle at 40% depth#082 · needle at 19% depth#083 · needle at 83% depth#084 · needle at 48% depth#085 · needle at 9% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for adamant-pathway is: 5416988.
One of the special magic numbers for rabid-hydrocarb is: 1957503.
[… 469 lines omitted for display …]
One of the special magic numbers for lonely-caramel is: 1726711.
One of the special magic numbers for jolly-cupola is: 7672935.
One of the special magic numbers for cheerful-score is: 4075163.
One of the special magic numbers for ossified-plot is: 8941617.
One of the special magic numbers for inconclusive-drizzle is: 5524377.
One of the special magic numbers for angry-standard is: 8015398.
One of the special magic numbers for happy-printing is: 5909587.
One of the special magic numbers for woozy-skeleton is: 1278947.
One of the special magic numbers for neighborly-tank-top is: 7925589.
One of the special magic numbers for efficacious-codling is: 5668541.
One of the special magic numbers for dusty-phenotype is: 8592954.
One of the special magic numbers for crabby-buying is: 8662377.
One of the special magic numbers for standing-prohibition is: 3771858.
One of the special magic numbers for clear-jiffy is: 4790756.
[… 919 lines omitted for display …]
One of the special magic numbers for murky-truck is: 5188631.
One of the special magic numbers for anxious-artificer is: 5456880.
What is the special magic number for woozy-skeleton mentioned in the provided text?
Original prompt 32,223 tokens, 1,408 linesShown 20 lines around the needleNeedle at 34% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6717305Aux 20158921957Ours1278947Ours, no steer.1278947PiT-FT6717305Qwen 27B1278947
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1278947.

13 characters10 tokens

Aux 2015

Missed

7345200.

13 characters10 tokens

PiT-FT 2015

Missed

: 7692624. The special magic number for icky-susceptible is: 8574514. The special magic number for icky-pug is: 8574514. The special magic number for icky-sulcide is: 8574514. The special magic number for icky-pug is: 8574514. The special magic number for icky-pug is: 8574514. The special magic number for icky-pug is: 8574514. The special magic number for icky-p

371 characters128 tokens

ChronoGPT 2015

Missed

:

A:

B:

C:

D:

E:

F:

G:

H:

I:

J:

K:

L:

M:

N:

O:

P:

Q:

R:

S:

T:

U:

V:

W:

X:

Y:

203 characters128 tokens