Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

11 of 100 prompts

#000 · needle at 76% depth#001 · needle at 26% depth#002 · needle at 9% depth#003 · needle at 29% depth#004 · needle at 7% depth#005 · needle at 4% depth#006 · needle at 6% depth#007 · needle at 4% depth#008 · needle at 29% depth#009 · needle at 73% depth#010 · needle at 90% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for misty-evidence is: 4382792.
One of the special magic numbers for frantic-trellis is: 1869328.
[… 197 lines omitted for display …]
One of the special magic numbers for yummy-chastity is: 1474092.
One of the special magic numbers for famous-duffel is: 7827978.
One of the special magic numbers for ruddy-thrush is: 5997018.
One of the special magic numbers for Early-acupuncture is: 7790649.
One of the special magic numbers for spiffy-million is: 8549544.
One of the special magic numbers for direful-riot is: 3643612.
One of the special magic numbers for known-menorah is: 8759542.
One of the special magic numbers for perfect-transportation is: 5902298.
One of the special magic numbers for elderly-crawdad is: 5117527.
One of the special magic numbers for tested-hello is: 2135803.
One of the special magic numbers for crowded-value is: 2817326.
One of the special magic numbers for alike-renaissance is: 8559084.
One of the special magic numbers for educated-degree is: 7340861.
One of the special magic numbers for honorable-mode is: 3529018.
[… 2,628 lines omitted for display …]
One of the special magic numbers for abrasive-splendor is: 9940515.
One of the special magic numbers for puny-suit is: 6961256.
What is the special magic number for perfect-transportation mentioned in the provided text?
Original prompt 65,008 tokens, 2,845 linesShown 20 lines around the needleNeedle at 7% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6702568Aux 20151600226Ours5902298Ours, no steer.5902298PiT-FT6702568Qwen 27B5902298
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5902298.

13 characters10 tokens

Aux 2015

Missed

8434659.

13 characters10 tokens

PiT-FT 2015

Missed

: 76920. The special magic number for icky-caviar is: 78736. The special magic number for gassy-grav is: 86920. The special magic number for icky-cocoa is: 76920. The special magic number for icky-cob is: 76920. The special magic number for icky-caulk is: 76920. The special magic number for icky-cane is: 76920. The special magic number for icky-caulk is: 76920.

370 characters128 tokens

ChronoGPT 2015

Missed

: The special Magic Number number is the same as the special Magic number for the following: One of the special Magic numbers for rambunctious-letter is: The special Magic number for the following is: One of the special Magic numbers for rambunctious-letter is: The special Magic number for the following is:

R:

The special Magic number for the following is: One of the special Magic numbers for rambunctious-letter is: The special Magic number for the following is:

W:

The special Magic number for the following is:

I

530 characters128 tokens