Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#004 · needle at 7% depth#005 · needle at 4% depth#006 · needle at 6% depth#007 · needle at 4% depth#008 · needle at 29% depth#009 · needle at 73% depth#010 · needle at 90% depth#011 · needle at 39% depth#012 · needle at 77% depth#013 · needle at 83% depth#014 · needle at 78% depth#015 · needle at 63% depth#016 · needle at 97% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for breakable-gondola is: 3192824.
One of the special magic numbers for powerful-receiver is: 1074829.
[… 2,563 lines omitted for display …]
One of the special magic numbers for penitent-adoption is: 7932005.
One of the special magic numbers for grumpy-commander is: 9012297.
One of the special magic numbers for omniscient-inclusion is: 9715329.
One of the special magic numbers for smoggy-assurance is: 6991599.
One of the special magic numbers for energetic-instrumentalist is: 8334110.
One of the special magic numbers for afraid-polyester is: 3621985.
One of the special magic numbers for workable-subcomponent is: 6962838.
One of the special magic numbers for gaudy-hatred is: 3248174.
One of the special magic numbers for ludicrous-factory is: 8778142.
One of the special magic numbers for helpless-stopwatch is: 7376975.
One of the special magic numbers for lacking-creek is: 6729345.
One of the special magic numbers for sweet-width is: 9473983.
One of the special magic numbers for verdant-distinction is: 7253808.
One of the special magic numbers for gifted-disruption is: 1781578.
[… 262 lines omitted for display …]
One of the special magic numbers for uttermost-villa is: 2507802.
One of the special magic numbers for greedy-strand is: 6322884.
What is the special magic number for gaudy-hatred mentioned in the provided text?
Original prompt 64,979 tokens, 2,845 linesShown 20 lines around the needleNeedle at 90% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8109819Aux 20157809419Ours3248174Ours, no steer.3248174PiT-FT8109819Qwen 27B3248174
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3248174.

13 characters10 tokens

Aux 2015

Missed

8885588.

13 characters10 tokens

PiT-FT 2015

Missed

: 8871269. The special magic number for the most important-sauce is: 8871269. The special magic number for the most effective-sauce is: 8871269. The special magic number for the most popular-sauce is: 8871269. The special magic number for the most significant-sauce is: 8871269. The special magic number for the most effective-sauce is: 8871269. The special magic number for the most popular-sauce is: 8871269. The

421 characters128 tokens

ChronoGPT 2015

Missed

:

Rv:

The special magic number for rambunctious-corm is:

Rv:

The special Magic Number number for rambunctious-corm is:

Rv:

The special Magic number for rambunctious-pant is:

Rv:

The special Magic number for rambunctious-pav is:

Rv:

The special Magic number for rambunctious-nun is:

Rv:

The special Magic number for rambunctious-mack is:

372 characters128 tokens