Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#062 · needle at 73% depth#063 · needle at 83% depth#064 · needle at 96% depth#065 · needle at 16% depth#066 · needle at 20% depth#067 · needle at 66% depth#068 · needle at 35% depth#069 · needle at 5% depth#070 · needle at 60% depth#071 · needle at 93% depth#072 · needle at 42% depth#073 · needle at 34% depth#074 · needle at 48% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for weak-amber is: 3440063.
One of the special magic numbers for resolute-skating is: 2058524.
[… 476 lines omitted for display …]
One of the special magic numbers for grumpy-pork is: 6773280.
One of the special magic numbers for helpful-kebab is: 7697648.
One of the special magic numbers for eatable-liver is: 3217164.
One of the special magic numbers for cloudy-faucet is: 2633866.
One of the special magic numbers for bad-guava is: 6891929.
One of the special magic numbers for romantic-disposer is: 8263581.
One of the special magic numbers for funny-satisfaction is: 1170586.
One of the special magic numbers for utopian-harmonise is: 5316387.
One of the special magic numbers for frantic-providence is: 9852943.
One of the special magic numbers for inconclusive-basics is: 4499209.
One of the special magic numbers for gentle-menopause is: 1930148.
One of the special magic numbers for soggy-earring is: 4334189.
One of the special magic numbers for longing-spiritual is: 4888900.
One of the special magic numbers for abandoned-sinuosity is: 8424667.
[… 887 lines omitted for display …]
One of the special magic numbers for breezy-saviour is: 2209398.
One of the special magic numbers for sedate-hatchling is: 7682217.
What is the special magic number for utopian-harmonise mentioned in the provided text?
Original prompt 31,723 tokens, 1,383 linesShown 20 lines around the needleNeedle at 35% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2100308Aux 20152077743Ours5316387Ours, no steer.5316387PiT-FT2100308Qwen 27B5316387
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5316387.

13 characters10 tokens

Aux 2015

Missed

4186839.

13 characters10 tokens

PiT-FT 2015

Missed

: 6632653. The special magic number for the most popular-sauerkraut is: 76326. The special magic number for the most popular-sauerkraut is: 76326. The special magic number for the most popular-sauerkraut is: 76326. The special magic number for the most popular-sauerkraut is: 76326. The special magic number for the most popular-sauerkraut is: 76326. The special magic number for the most popular-sauerkraut is:

417 characters128 tokens

ChronoGPT 2015

Missed

: 1322001.<|endoftext|>

23 characters6 tokens