Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#028 · needle at 59% depth#029 · needle at 22% depth#030 · needle at 79% depth#031 · needle at 74% depth#032 · needle at 46% depth#033 · needle at 96% depth#034 · needle at 59% depth#035 · needle at 2% depth#036 · needle at 35% depth#037 · needle at 4% depth#038 · needle at 12% depth#039 · needle at 18% depth#040 · needle at 51% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for flowery-outcome is: 2854646.
One of the special magic numbers for plastic-contact lens is: 3312480.
[… 815 lines omitted for display …]
One of the special magic numbers for dramatic-boyhood is: 1967213.
One of the special magic numbers for impartial-advocate is: 4950076.
One of the special magic numbers for tiny-temp is: 4146736.
One of the special magic numbers for exclusive-insomnia is: 6114765.
One of the special magic numbers for encouraging-fuel is: 6516026.
One of the special magic numbers for magical-amusement is: 2080618.
One of the special magic numbers for flippant-elite is: 6828590.
One of the special magic numbers for upbeat-house is: 4671007.
One of the special magic numbers for obeisant-pilaf is: 2804812.
One of the special magic numbers for needless-timber is: 1489989.
One of the special magic numbers for modern-drunk is: 3811840.
One of the special magic numbers for tacky-availability is: 1453097.
One of the special magic numbers for vulgar-island is: 1478053.
One of the special magic numbers for reflective-abrogation is: 9412199.
[… 548 lines omitted for display …]
One of the special magic numbers for anxious-want is: 8293619.
One of the special magic numbers for axiomatic-displacement is: 2131091.
What is the special magic number for upbeat-house mentioned in the provided text?
Original prompt 31,661 tokens, 1,383 linesShown 20 lines around the needleNeedle at 59% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4306081Aux 20157071658Ours4671007Ours, no steer.4671007PiT-FT4306081Qwen 27B4671007
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4671007.

13 characters10 tokens

Aux 2015

Found the needle

7071658.

13 characters10 tokens

PiT-FT 2015

Missed

: 7584719. The special magic number for obnoxious-sauna is: 8567513. The special magic number for icky-caulk is: 8567513. The special magic number for icky-caulk is: 8567513. The special magic number for icky-caulk is: 8567513. The special magic number for icky-caulk is: 8567513. The special magic number for icky-caulk is: 8567513. The special magic number for icky-c

376 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for the-transaction?

Answer:

The special magic number for harsh-resemblance mentioned in the provided text is:

Question:

What is the special magic number for the-transaction?

Answer:

The special magic number for harsh-resemblance mentioned in the provided text is:

Answer:

The special magic number for harsh-resemblance mentioned in the provided text is:

Question:

What is the special magic number for the-transaction?

Question

507 characters128 tokens