Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#065 · needle at 16% depth#066 · needle at 20% depth#067 · needle at 66% depth#068 · needle at 35% depth#069 · needle at 5% depth#070 · needle at 60% depth#071 · needle at 93% depth#072 · needle at 42% depth#073 · needle at 34% depth#074 · needle at 48% depth#075 · needle at 9% depth#076 · needle at 54% depth#077 · needle at 25% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for angry-running is: 9932037.
One of the special magic numbers for panoramic-derivation is: 2074799.
[… 1,310 lines omitted for display …]
One of the special magic numbers for romantic-hutch is: 8195396.
One of the special magic numbers for functional-hubris is: 9336481.
One of the special magic numbers for roasted-performance is: 6630959.
One of the special magic numbers for hollow-swim is: 8566413.
One of the special magic numbers for wicked-oat is: 6535220.
One of the special magic numbers for broad-shoat is: 9613172.
One of the special magic numbers for dynamic-value is: 8523430.
One of the special magic numbers for tiresome-weather is: 6543223.
One of the special magic numbers for abrasive-input is: 3455980.
One of the special magic numbers for skillful-alarm is: 9609343.
One of the special magic numbers for industrious-admire is: 2005687.
One of the special magic numbers for finicky-mortgage is: 3092561.
One of the special magic numbers for lovely-mass is: 8692664.
One of the special magic numbers for helpless-court is: 7997205.
[… 78 lines omitted for display …]
One of the special magic numbers for dry-marten is: 5398115.
One of the special magic numbers for encouraging-guess is: 7418601.
What is the special magic number for tiresome-weather mentioned in the provided text?
Original prompt 32,225 tokens, 1,408 linesShown 20 lines around the needleNeedle at 93% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2873369Aux 20159242596Ours6543223Ours, no steer.6543223PiT-FT2873369Qwen 27B6543223
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6543223.

13 characters10 tokens

Aux 2015

Found the needle

9242596.

13 characters10 tokens

PiT-FT 2015

Missed

: 720513. The special magic number for cheerful-soul is: 7051351. The special magic number for icky-tissue is: 7051351. The special magic number for icky-tissue is: 7051351. The special magic number for icky-tissue is: 7051351. The special magic number for sluggish-sauerkraut is: 7051351. The special magic number for icky-tissue is: 7051351. The special magic number for icky-tissue is: 7

397 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for noble-decision?

Answer:

Question:

What is the special magic number for noble-sentence?

Answer:

Question:

What is the special magic number for noble-decision?

Answer:

Question:

What is the special magic number for noble-sentence?

Answer:

Question:

What is the special magic number for noble-decision?

Answer:

Question:

What is the special magic number

454 characters128 tokens