Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#060 · needle at 65% depth#061 · needle at 10% depth#062 · needle at 39% depth#063 · needle at 11% depth#064 · needle at 29% depth#065 · needle at 71% depth#066 · needle at 9% depth#067 · needle at 93% depth#068 · needle at 80% depth#069 · needle at 69% depth#070 · needle at 41% depth#071 · needle at 86% depth#072 · needle at 71% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for chilly-update is: 8485525.
One of the special magic numbers for deadpan-tussle is: 4111310.
[… 50 lines omitted for display …]
One of the special magic numbers for stimulating-budget is: 3726780.
One of the special magic numbers for adamant-output is: 3391650.
One of the special magic numbers for ripe-eleventh is: 6774129.
One of the special magic numbers for fancy-scow is: 3491877.
One of the special magic numbers for inconclusive-kitten is: 3063958.
One of the special magic numbers for elite-broom is: 5839400.
One of the special magic numbers for historical-removal is: 1347218.
One of the special magic numbers for lackadaisical-charger is: 6424435.
One of the special magic numbers for chunky-hospital is: 1855001.
One of the special magic numbers for obeisant-pat is: 1327635.
One of the special magic numbers for graceful-crewmate is: 1171322.
One of the special magic numbers for husky-optimal is: 2200391.
One of the special magic numbers for obedient-jewel is: 8902243.
One of the special magic numbers for ambiguous-mat is: 1111197.
[… 595 lines omitted for display …]
One of the special magic numbers for worthless-lawn is: 1624000.
One of the special magic numbers for waggish-sickness is: 4620177.
What is the special magic number for lackadaisical-charger mentioned in the provided text?
Original prompt 15,278 tokens, 665 linesShown 20 lines around the needleNeedle at 9% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT5002298Aux 20155343646Ours6424435Ours, no steer.6424435PiT-FT5002298Qwen 27B6424435
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6424435.

13 characters10 tokens

Aux 2015

Missed

4484467.

13 characters10 tokens

PiT-FT 2015

Missed
: 8742916.
 The special magic number for the most excellent-soul is: 8742916.
 The special magic number for the most excellent-soul is: 8742916.
 The special magic number for the most excellent-soul is

The same 67-character fragment repeats 6 times until the token limit. Showing the first three.

451 characters128 tokens

ChronoGPT 2015

Missed

: 7781031.<|endoftext|>

23 characters7 tokens