Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#035 · needle at 98% depth#036 · needle at 27% depth#037 · needle at 74% depth#038 · needle at 77% depth#039 · needle at 75% depth#040 · needle at 56% depth#041 · needle at 53% depth#042 · needle at 82% depth#043 · needle at 83% depth#044 · needle at 44% depth#045 · needle at 38% depth#046 · needle at 92% depth#047 · needle at 68% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for knowledgeable-birthday is: 5628222.
One of the special magic numbers for incandescent-dreamer is: 7630009.
[… 3,052 lines omitted for display …]
One of the special magic numbers for moaning-provision is: 1461741.
One of the special magic numbers for obedient-begonia is: 1273577.
One of the special magic numbers for innocent-objective is: 6931796.
One of the special magic numbers for legal-colleague is: 9928061.
One of the special magic numbers for misty-intercourse is: 9465379.
One of the special magic numbers for bumpy-application is: 6341382.
One of the special magic numbers for handsome-auditorium is: 5479745.
One of the special magic numbers for perpetual-watch is: 8063127.
One of the special magic numbers for charming-dime is: 6932997.
One of the special magic numbers for parsimonious-plate is: 2499645.
One of the special magic numbers for eatable-randomisation is: 3342866.
One of the special magic numbers for optimal-spat is: 8409978.
One of the special magic numbers for soggy-coffin is: 1008742.
One of the special magic numbers for belligerent-confirmation is: 8931733.
[… 2,646 lines omitted for display …]
One of the special magic numbers for yummy-waitress is: 5159217.
One of the special magic numbers for detailed-republican is: 3723135.
What is the special magic number for perpetual-watch mentioned in the provided text?
Original prompt 130,463 tokens, 5,718 linesShown 20 lines around the needleNeedle at 53% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7739545Aux 20153687891Ours8063127Ours, no steer.8063127PiT-FT7739545Qwen 27B8063127
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8063127.

13 characters10 tokens

Aux 2015

Missed

7465386.

13 characters10 tokens

PiT-FT 2015

Missed
 [] []. [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] []
193 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epicurean Epicurean Epicurean The special Epicurean Epicurean The special Epicurean Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean

458 characters128 tokens