Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#002 · needle at 68% depth#003 · needle at 43% depth#004 · needle at 2% depth#005 · needle at 53% depth#006 · needle at 84% depth#007 · needle at 2% depth#008 · needle at 76% depth#009 · needle at 86% depth#010 · needle at 60% depth#011 · needle at 86% depth#012 · needle at 24% depth#013 · needle at 58% depth#014 · needle at 60% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for robust-samurai is: 7121365.
One of the special magic numbers for colossal-cannon is: 4000429.
[… 224 lines omitted for display …]
One of the special magic numbers for rough-bulb is: 2332904.
One of the special magic numbers for auspicious-cyclamen is: 8493255.
One of the special magic numbers for silent-vegetable is: 9773624.
One of the special magic numbers for funny-quote is: 5105254.
One of the special magic numbers for gentle-regret is: 4064939.
One of the special magic numbers for victorious-bird is: 5111878.
One of the special magic numbers for flagrant-homicide is: 8651518.
One of the special magic numbers for peaceful-receptor is: 6621432.
One of the special magic numbers for dysfunctional-inn is: 1674994.
One of the special magic numbers for strong-house is: 5458768.
One of the special magic numbers for scintillating-reject is: 5655284.
One of the special magic numbers for calm-abnormality is: 4187908.
One of the special magic numbers for zealous-baggie is: 2068187.
One of the special magic numbers for cynical-variety is: 9767063.
[… 61 lines omitted for display …]
One of the special magic numbers for minor-painter is: 6932624.
One of the special magic numbers for thoughtful-scooter is: 3347640.
What is the special magic number for peaceful-receptor mentioned in the provided text?
Original prompt 7,071 tokens, 305 linesShown 20 lines around the needleNeedle at 76% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT5922258Aux 20156621432Ours6621432Ours, no steer.6621432PiT-FT5922258Qwen 27B6621432
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6621432.

13 characters10 tokens

Aux 2015

Missed

:

8916759

14 characters12 tokens

PiT-FT 2015

Missed

: 8870112. The special magic number for awkward-sail is: 8870112. The special magic number for jazzy-paint is: 8870112. The special magic number for lovable-sail is: 8870112. The special magic number for jaded-sail is: 8870112. The special magic number for livid-sail is: 8870112. The special magic number for unkind-sail is: 8870112. The special magic number for unkind-sail is: 8

388 characters128 tokens

ChronoGPT 2015

Missed

: 1667991.<|endoftext|>

23 characters7 tokens