Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#030 · needle at 21% depth#031 · needle at 99% depth#032 · needle at 75% depth#033 · needle at 7% depth#034 · needle at 57% depth#035 · needle at 98% depth#036 · needle at 27% depth#037 · needle at 74% depth#038 · needle at 77% depth#039 · needle at 75% depth#040 · needle at 56% depth#041 · needle at 53% depth#042 · needle at 82% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for difficult-beggar is: 2996008.
One of the special magic numbers for unaccountable-herbs is: 5441155.
[… 1,517 lines omitted for display …]
One of the special magic numbers for spicy-barn is: 9232540.
One of the special magic numbers for abstracted-counselling is: 3313717.
One of the special magic numbers for righteous-dreamer is: 2975774.
One of the special magic numbers for dazzling-supreme is: 4013946.
One of the special magic numbers for staking-lyocell is: 2225854.
One of the special magic numbers for flipped-out-pepper is: 9198510.
One of the special magic numbers for clean-venison is: 4503956.
One of the special magic numbers for tasteful-rye is: 9160350.
One of the special magic numbers for green-plumber is: 1517606.
One of the special magic numbers for jobless-mustache is: 8539982.
One of the special magic numbers for makeshift-appeal is: 2941483.
One of the special magic numbers for murky-scow is: 8281975.
One of the special magic numbers for astonishing-stench is: 2814371.
[… 4,182 lines omitted for display …]
One of the special magic numbers for handsome-craw is: 5115964.
One of the special magic numbers for onerous-generator is: 8943329.
What is the special magic number for clean-venison mentioned in the provided text?
Original prompt 130,549 tokens, 5,718 linesShown 19 lines around the needleNeedle at 27% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6470462Aux 20153713308Ours4503956Ours, no steer.4503956PiT-FT6470462Qwen 27B4503956
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4503956.

13 characters10 tokens

Aux 2015

Missed

9855087.

13 characters10 tokens

PiT-FT 2015

Missed
 [] [] []

The same 3-character fragment repeats 64 times until the token limit. Showing the first three.

192 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epicurean number for rambunctability is:

###aked: The special Dickens number for rambunctchery is:

###aked: ###aked: ###aked:

###aked: ###aked:

###aked: ###aked:

###aked: ###aked:

###aked: ###aked:

###aked: ###aked:

###aked: ###aked:

###aked: ###aked:

###aked

304 characters128 tokens