Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#026 · needle at 32% depth#027 · needle at 14% depth#028 · needle at 59% depth#029 · needle at 22% depth#030 · needle at 79% depth#031 · needle at 74% depth#032 · needle at 46% depth#033 · needle at 96% depth#034 · needle at 59% depth#035 · needle at 2% depth#036 · needle at 35% depth#037 · needle at 4% depth#038 · needle at 12% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for excellent-homosexuality is: 3045330.
One of the special magic numbers for ruthless-web is: 5133853.
[… 626 lines omitted for display …]
One of the special magic numbers for salty-stitch is: 5620485.
One of the special magic numbers for jobless-ravioli is: 6454695.
One of the special magic numbers for endurable-whisker is: 2849663.
One of the special magic numbers for spotless-donation is: 6006351.
One of the special magic numbers for hurt-pug is: 9094768.
One of the special magic numbers for yellow-waste is: 7655203.
One of the special magic numbers for slippery-chamber is: 2863891.
One of the special magic numbers for scrawny-bank is: 2593563.
One of the special magic numbers for youthful-noon is: 2684799.
One of the special magic numbers for brash-governor is: 6789680.
One of the special magic numbers for panicky-ton is: 7546395.
One of the special magic numbers for depressed-crime is: 4696389.
One of the special magic numbers for inquisitive-glow is: 1888909.
One of the special magic numbers for boring-security is: 5010163.
[… 737 lines omitted for display …]
One of the special magic numbers for capable-strap is: 4538835.
One of the special magic numbers for sweltering-container is: 8434981.
What is the special magic number for scrawny-bank mentioned in the provided text?
Original prompt 31,596 tokens, 1,383 linesShown 20 lines around the needleNeedle at 46% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9664337Aux 20158434981Ours2593563Ours, no steer.2593563PiT-FT9664337Qwen 27B2593563
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2593563.

13 characters10 tokens

Aux 2015

Missed

4741113.

13 characters10 tokens

PiT-FT 2015

Missed

: 707857. The special magic number for the most recent-sauce is: 8270048. The special magic number for the most recent-snow is: 8270048. The special magic number for the most recent-snow is: 8270048. The special magic number for the most recent-snow is: 8270048. The special magic number for the most recent-snow is: 8270048. The special magic number for the most recent-snow is: 8270048. The special magic number for the

428 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for brewed-foodstuffs?

Answer:

Question:

What is the special magic number for brewed-Plant is?

Answer:

Question:

What is the special magic number for brewed-Plant is?

Answer:

Question:

What is the special magic number for brewed-Plant is?

Question:

What is the special magic number for brewed-Plant is?

Answer:

Question:

What is the special magic number

448 characters128 tokens