Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#065 · needle at 41% depth#066 · needle at 17% depth#067 · needle at 9% depth#068 · needle at 79% depth#069 · needle at 14% depth#070 · needle at 57% depth#071 · needle at 7% depth#072 · needle at 61% depth#073 · needle at 88% depth#074 · needle at 67% depth#075 · needle at 53% depth#076 · needle at 35% depth#077 · needle at 22% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for succinct-disease is: 9695792.
One of the special magic numbers for red-shark is: 2861503.
[… 194 lines omitted for display …]
One of the special magic numbers for lush-access is: 1294612.
One of the special magic numbers for satisfying-fundraising is: 8276154.
One of the special magic numbers for amused-viola is: 3877498.
One of the special magic numbers for concerned-glacier is: 2390292.
One of the special magic numbers for foamy-CD is: 7615614.
One of the special magic numbers for prickly-redirect is: 4839305.
One of the special magic numbers for obsolete-fail is: 8325990.
One of the special magic numbers for hellish-dash is: 9337986.
One of the special magic numbers for makeshift-divorce is: 1313681.
One of the special magic numbers for sloppy-gorilla is: 4798650.
One of the special magic numbers for brawny-particular is: 2949355.
One of the special magic numbers for wary-youth is: 7454934.
One of the special magic numbers for alive-trust is: 9739666.
One of the special magic numbers for enthusiastic-hydrocarb is: 5446152.
[… 2,631 lines omitted for display …]
One of the special magic numbers for sassy-warren is: 6785003.
One of the special magic numbers for cold-drawer is: 7080818.
What is the special magic number for hellish-dash mentioned in the provided text?
Original prompt 65,001 tokens, 2,845 linesShown 20 lines around the needleNeedle at 7% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7378608Aux 20155373053Ours9337986Ours, no steer.9337986PiT-FT7378608Qwen 27B9337986
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

9337986.

13 characters10 tokens

Aux 2015

Missed

2800239.

13 characters10 tokens

PiT-FT 2015

Missed

: 8907559. The special magic number for sluggish-sauce is: 7692276. The special magic number for gassy-gourg is: 7692278. The special magic number for loutish-carnival is: 7692278. The special magic number for gassy-gourg is: 7692278. The special magic number for loutish-cocoa is: 7692278. The special magic number for lindish-cirr is: 7692278. The special magic number for

381 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number for rambunctious-bob is: The special magic number for rambunctious-bob is: The special Magic Number number is the number mentioned in the provided text.

W:

W:

The special Magic number mentioned in the provided text is: The special Magic number mentioned in the provided text is: The special Magic number mentioned in the provided text is: The special Magic number mentioned in the provided text is: The special Magic number mentioned in the provided text is: The special Magic number mentioned in the provided text is:

555 characters128 tokens