Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#069 · needle at 14% depth#070 · needle at 57% depth#071 · needle at 7% depth#072 · needle at 61% depth#073 · needle at 88% depth#074 · needle at 67% depth#075 · needle at 53% depth#076 · needle at 35% depth#077 · needle at 22% depth#078 · needle at 68% depth#079 · needle at 1% depth#080 · needle at 90% depth#081 · needle at 78% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for ethereal-chafe is: 3931859.
One of the special magic numbers for excellent-cria is: 1812499.
[… 1,490 lines omitted for display …]
One of the special magic numbers for straight-simvastatin is: 1294309.
One of the special magic numbers for relieved-step-sister is: 6440374.
One of the special magic numbers for tiresome-fir is: 4446291.
One of the special magic numbers for womanly-beneficiary is: 4334598.
One of the special magic numbers for alleged-hydrant is: 9064772.
One of the special magic numbers for delightful-cottage is: 5772371.
One of the special magic numbers for puny-doggie is: 5568755.
One of the special magic numbers for shocking-tadpole is: 9553537.
One of the special magic numbers for delightful-fountain is: 9161019.
One of the special magic numbers for glossy-beef is: 6155773.
One of the special magic numbers for omniscient-ladder is: 9749369.
One of the special magic numbers for hushed-loop is: 7580651.
One of the special magic numbers for wild-deal is: 7320145.
One of the special magic numbers for distinct-peony is: 8649285.
[… 1,310 lines omitted for display …]
One of the special magic numbers for secretive-stew is: 3801344.
One of the special magic numbers for vague-dirndl is: 7152870.
What is the special magic number for puny-doggie mentioned in the provided text?
Original prompt 64,510 tokens, 2,820 linesShown 20 lines around the needleNeedle at 53% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9366556Aux 20157992863Ours5568755Ours, no steer.5568755PiT-FT9366556Qwen 27B5568755
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5568755.

13 characters10 tokens

Aux 2015

Found the needle

7992863.

13 characters10 tokens

PiT-FT 2015

Missed

: 7692037. The special magic number for the most important-saucer is: 8692037. The special magic number for the most effective-saucer is: 8692037. The special magic number for the most beautiful-sauce is: 9872084. The special magic number for the most powerful-soul is: 9872084. The special magic number for the most effective-soul is: 9872084. The special magic number for the most beautiful-snow is: 9872084. The special magic number

442 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number for hissing-letter is: The special magic number for his being mentioned in the provided text is: The special magic number for his being mentioned in the provided text is: The special magic number for his being mentioned in the provided text is: The special magic number for his being mentioned in the provided text is: The special magic number for his being mentioned in the provided text is: The special magic number for his being mentioned in the provided text is: The special magic number for his being mentioned in the provided text is: The special magic number for his being mentioned in

619 characters128 tokens