Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#035 · needle at 32% depth#036 · needle at 33% depth#037 · needle at 67% depth#038 · needle at 27% depth#039 · needle at 75% depth#040 · needle at 6% depth#041 · needle at 28% depth#042 · needle at 69% depth#043 · needle at 49% depth#044 · needle at 50% depth#045 · needle at 36% depth#046 · needle at 27% depth#047 · needle at 2% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for grotesque-hardening is: 1474039.
One of the special magic numbers for silky-negotiation is: 7985879.
[… 34 lines omitted for display …]
One of the special magic numbers for boundless-crunch is: 8088074.
One of the special magic numbers for uttermost-lens is: 2037958.
One of the special magic numbers for fine-strip is: 7625083.
One of the special magic numbers for expensive-councilman is: 8067382.
One of the special magic numbers for hurt-subject is: 5170025.
One of the special magic numbers for moaning-bran is: 3109953.
One of the special magic numbers for chilly-propane is: 9634692.
One of the special magic numbers for wakeful-carp is: 5851168.
One of the special magic numbers for sneaky-know-how is: 5360488.
One of the special magic numbers for important-divide is: 7247640.
One of the special magic numbers for standing-lettuce is: 1936359.
One of the special magic numbers for loutish-rum is: 9145474.
One of the special magic numbers for ablaze-lament is: 1824629.
One of the special magic numbers for ad hoc-patron is: 6052169.
[… 97 lines omitted for display …]
One of the special magic numbers for adventurous-whey is: 4214986.
One of the special magic numbers for sedate-mutton is: 7367070.
What is the special magic number for wakeful-carp mentioned in the provided text?
Original prompt 3,564 tokens, 151 linesShown 20 lines around the needleNeedle at 28% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1989763Aux 20155851168Ours5851168Ours, no steer.5851168PiT-FT1989763Qwen 27B5851168
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5851168.

13 characters10 tokens

Aux 2015

Missed

:

7367070

14 characters12 tokens

PiT-FT 2015

Missed

: 6690280. The special magic number for unkind-favour is: 78512. The special magic number for unkind-favour mentioned in the provided text is: 78512. The special magic number for unkind-favour mentioned in the provided text is: 78512. The special magic number for unkind-favour mentioned in the provided text is: 78512. The special magic number for unkind-favour mentioned in the provided text is: 78512. The special magic number for unkind-favour mentioned in the provided text is

487 characters128 tokens

ChronoGPT 2015

Missed

5595901.<|endoftext|>

22 characters6 tokens