Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#070 · needle at 57% depth#071 · needle at 7% depth#072 · needle at 61% depth#073 · needle at 88% depth#074 · needle at 67% depth#075 · needle at 53% depth#076 · needle at 35% depth#077 · needle at 22% depth#078 · needle at 68% depth#079 · needle at 1% depth#080 · needle at 90% depth#081 · needle at 78% depth#082 · needle at 87% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for rich-directive is: 1775189.
One of the special magic numbers for onerous-pile is: 3017797.
[… 985 lines omitted for display …]
One of the special magic numbers for juvenile-pilgrimage is: 5912335.
One of the special magic numbers for absorbed-expression is: 1828567.
One of the special magic numbers for volatile-inheritance is: 6855107.
One of the special magic numbers for tawdry-phenomenon is: 9503510.
One of the special magic numbers for momentous-revenue is: 6961799.
One of the special magic numbers for enthusiastic-caftan is: 4916767.
One of the special magic numbers for rambunctious-misreading is: 4327426.
One of the special magic numbers for gifted-embryo is: 7844427.
One of the special magic numbers for afraid-chronicle is: 5024501.
One of the special magic numbers for temporary-advent is: 9528625.
One of the special magic numbers for stingy-widow is: 3727921.
One of the special magic numbers for dull-dusk is: 3588381.
One of the special magic numbers for prickly-put is: 6311841.
One of the special magic numbers for unbiased-drag is: 4381722.
[… 1,840 lines omitted for display …]
One of the special magic numbers for absent-pond is: 4736672.
One of the special magic numbers for loose-time is: 4395276.
What is the special magic number for gifted-embryo mentioned in the provided text?
Original prompt 64,997 tokens, 2,845 linesShown 20 lines around the needleNeedle at 35% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9371388Aux 20155805853Ours7844427Ours, no steer.7844427PiT-FT9371388Qwen 27B7844427
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7844427.

13 characters10 tokens

Aux 2015

Missed

8505853.

13 characters10 tokens

PiT-FT 2015

Missed

: 6692076. The special magic number for the dangerous-sauce mentioned in the provided text is: 8692076. The special magic number for the icky-sugar mentioned in the provided text is: 8807022. The special magic number for the icky-tissue mentioned in the provided text is: 8807072. The special magic number for the icky-tissue mentioned in the provided text is: 8807072. The special magic number for the icky-tissue mentioned in the provided text is: 8807072. The

468 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number for rambunctious-transport is: The special magic number for rambunctious-transport is: The special magic number for rambunctious-transport is: The special magic number for brewed-coconut is: The special magic number for rambunctious-transport is: The special magic number for sable-transport is: The special magic number for rambunctious-transport is: The special magic number for sable-transport is: The special magic number for rambunctious-transport

479 characters128 tokens