Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#070 · needle at 60% depth#071 · needle at 93% depth#072 · needle at 42% depth#073 · needle at 34% depth#074 · needle at 48% depth#075 · needle at 9% depth#076 · needle at 54% depth#077 · needle at 25% depth#078 · needle at 7% depth#079 · needle at 34% depth#080 · needle at 36% depth#081 · needle at 40% depth#082 · needle at 19% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for grandiose-difficulty is: 7271369.
One of the special magic numbers for fluffy-depot is: 2047912.
[… 748 lines omitted for display …]
One of the special magic numbers for fanatical-drunk is: 1975819.
One of the special magic numbers for substantial-headphones is: 5165721.
One of the special magic numbers for selective-landmine is: 8685528.
One of the special magic numbers for scrawny-hull is: 3335396.
One of the special magic numbers for highfalutin-stonework is: 1461211.
One of the special magic numbers for abiding-recall is: 6388288.
One of the special magic numbers for yummy-dolor is: 6363289.
One of the special magic numbers for various-buzz is: 4929503.
One of the special magic numbers for subdued-parenting is: 7122870.
One of the special magic numbers for steep-babe is: 1330441.
One of the special magic numbers for eminent-pursuit is: 1576366.
One of the special magic numbers for tough-competence is: 6347089.
One of the special magic numbers for flipped-out-tilt is: 1136886.
One of the special magic numbers for workable-chili is: 9819810.
[… 640 lines omitted for display …]
One of the special magic numbers for wooden-lift is: 2591442.
One of the special magic numbers for rabid-thing is: 1565916.
What is the special magic number for various-buzz mentioned in the provided text?
Original prompt 32,244 tokens, 1,408 linesShown 20 lines around the needleNeedle at 54% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT5838884Aux 20154388313Ours4929503Ours, no steer.4929503PiT-FT5838884Qwen 27B4929503
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4929503.

13 characters10 tokens

Aux 2015

Found the needle

4388313.

13 characters10 tokens

PiT-FT 2015

Missed

: 8872513. The special magic number for the quick-counsellor mentioned in the provided text is: 8872075. The special magic number for the impatient-uniformity mentioned in the provided text is: 8872075. The special magic number for the loutish-uniform is: 8872075. The special magic number for the gregarious-giant mentioned in the provided text is: 8872075. The special magic number for the gregarious-giant mentioned in the provided text is: 8872075. The special

470 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for the-in-joke?

Answer:

The special magic number for voracious-oboe is:

Question:

What is the special magic number for sordid-oboe?

Answer:

The special magic number for sordid-oboe is:

Question:

What is the special magic number for sordid-cocoa?

Answer:

The special magic number for sordid-cocoa is:

Question:

What is

398 characters128 tokens