Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#002 · needle at 44% depth#003 · needle at 63% depth#004 · needle at 73% depth#005 · needle at 55% depth#006 · needle at 84% depth#007 · needle at 11% depth#008 · needle at 30% depth#009 · needle at 3% depth#010 · needle at 15% depth#011 · needle at 91% depth#012 · needle at 61% depth#013 · needle at 6% depth#014 · needle at 2% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for snotty-fire is: 1003092.
One of the special magic numbers for deeply-jumbo is: 3503436.
[… 36 lines omitted for display …]
One of the special magic numbers for lush-step-brother is: 6961066.
One of the special magic numbers for filthy-cradle is: 4117056.
One of the special magic numbers for nauseating-granny is: 1124654.
One of the special magic numbers for smoggy-station is: 9357686.
One of the special magic numbers for youthful-ball is: 4972005.
One of the special magic numbers for wide-eyed-lapdog is: 9417612.
One of the special magic numbers for great-anyone is: 7892714.
One of the special magic numbers for fascinated-circuit is: 3330636.
One of the special magic numbers for sassy-meal is: 7156735.
One of the special magic numbers for agreeable-glut is: 1635269.
One of the special magic numbers for silly-republic is: 9107893.
One of the special magic numbers for weak-subject is: 7183722.
One of the special magic numbers for combative-waterfall is: 9078781.
One of the special magic numbers for vigorous-battalion is: 2343236.
[… 95 lines omitted for display …]
One of the special magic numbers for premium-coral is: 4366669.
One of the special magic numbers for stupid-swim is: 7587312.
What is the special magic number for fascinated-circuit mentioned in the provided text?
Original prompt 3,575 tokens, 151 linesShown 20 lines around the needleNeedle at 30% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT5298752Aux 20152031500Ours3330636Ours, no steer.3330636PiT-FT5298752Qwen 27B3330636
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3330636.

13 characters10 tokens

Aux 2015

Missed

4920186.

13 characters10 tokens

PiT-FT 2015

Missed

: 7044085. The special magic number for awkward-mammoth is: 7983542. The special magic number for awkward-tack is: 7983542. The special magic number for awkward-tack mentioned in the provided text is: 7983542. The special magic number for awkward-tack mentioned in the provided text is: 7983542. The special magic number for awkward-tack mentioned in the provided text is: 7983542. The special magic number for awkward-tack mentioned in the provided text is: 7983542

472 characters128 tokens

ChronoGPT 2015

Missed

: 7592721.<|endoftext|>

23 characters7 tokens