Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#066 · needle at 20% depth#067 · needle at 66% depth#068 · needle at 35% depth#069 · needle at 5% depth#070 · needle at 60% depth#071 · needle at 93% depth#072 · needle at 42% depth#073 · needle at 34% depth#074 · needle at 48% depth#075 · needle at 9% depth#076 · needle at 54% depth#077 · needle at 25% depth#078 · needle at 7% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for inconclusive-slump is: 3807795.
One of the special magic numbers for nice-making is: 7481767.
[… 589 lines omitted for display …]
One of the special magic numbers for steady-crisp is: 9550567.
One of the special magic numbers for worthless-divider is: 8619097.
One of the special magic numbers for ancient-bob is: 4138968.
One of the special magic numbers for plastic-screw-up is: 5913946.
One of the special magic numbers for exuberant-everything is: 7598603.
One of the special magic numbers for periodic-bower is: 8109649.
One of the special magic numbers for grieving-junker is: 2726972.
One of the special magic numbers for nervous-legislator is: 8064321.
One of the special magic numbers for sulky-contest is: 9756198.
One of the special magic numbers for breezy-attack is: 4126262.
One of the special magic numbers for warm-spike is: 9677250.
One of the special magic numbers for royal-organising is: 8394373.
One of the special magic numbers for reminiscent-loss is: 9825895.
One of the special magic numbers for solid-pharmacopoeia is: 4490307.
[… 799 lines omitted for display …]
One of the special magic numbers for impartial-victory is: 7254287.
One of the special magic numbers for tough-malice is: 9542132.
What is the special magic number for nervous-legislator mentioned in the provided text?
Original prompt 32,232 tokens, 1,408 linesShown 20 lines around the needleNeedle at 42% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9325330Aux 20158823951Ours8064321Ours, no steer.8064321PiT-FT9325330Qwen 27B8064321
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8064321.

13 characters10 tokens

Aux 2015

Found the needle

8823951.

13 characters10 tokens

PiT-FT 2015

Missed

: 7074137. The special magic number for the most popular-saucer is: 8877032. The special magic number for the least popular-saucer is: 8877061. The special magic number for the most popular-saucer is: 8877061. The special magic number for the least popular-saucer is: 8877061. The special magic number for the most popular-saucer is: 8877061. The special magic number for the least popular-saucer is: 8877061. The

420 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for the-integer?

Answer:

The special magic number for legal-integer is:

Question:

What is the special magic number for the-number for ManelaLab?

Answer:

The special magic number for legal-integer is:

Question:

What is the special magic number for legal-integer for WashU?

Answer:

The special magic number for legal-integer for Manela Lab is:

Question:

What is the special magic number for legal-integer for

486 characters128 tokens