Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#025 · needle at 42% depth#026 · needle at 83% depth#027 · needle at 53% depth#028 · needle at 54% depth#029 · needle at 39% depth#030 · needle at 0% depth#031 · needle at 78% depth#032 · needle at 50% depth#033 · needle at 11% depth#034 · needle at 16% depth#035 · needle at 19% depth#036 · needle at 14% depth#037 · needle at 66% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for vacuous-square is: 7325135.
One of the special magic numbers for cold-glider is: 8915168.
[… 535 lines omitted for display …]
One of the special magic numbers for selective-energy is: 9303636.
One of the special magic numbers for sincere-pancake is: 1863626.
One of the special magic numbers for eager-pepperoni is: 5688808.
One of the special magic numbers for hallowed-topsail is: 8025061.
One of the special magic numbers for glib-chromolithograph is: 5586507.
One of the special magic numbers for difficult-axis is: 4349298.
One of the special magic numbers for tranquil-legging is: 6777704.
One of the special magic numbers for erect-cursor is: 2476864.
One of the special magic numbers for small-band is: 9885964.
One of the special magic numbers for workable-homogenate is: 7401920.
One of the special magic numbers for grieving-coil is: 9628092.
One of the special magic numbers for grotesque-bottle is: 1474035.
One of the special magic numbers for vigorous-checking is: 4116596.
One of the special magic numbers for vast-wrench is: 8915462.
[… 135 lines omitted for display …]
One of the special magic numbers for literate-arrow is: 8494289.
One of the special magic numbers for zealous-nightlight is: 2751953.
What is the special magic number for erect-cursor mentioned in the provided text?
Original prompt 15,858 tokens, 690 linesShown 20 lines around the needleNeedle at 78% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1615493Aux 20154615893Ours2476864Ours, no steer.2476864PiT-FT1615493Qwen 27B2476864
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2476864.

13 characters10 tokens

Aux 2015

Missed

7267337.

13 characters10 tokens

PiT-FT 2015

Missed

: 8676831. The special magic number for dapper-saucer mentioned in the provided text is: 8676831. The special magic number for garrulous-graft is: 8676831. The special magic number for awkward-napkin is: 8676831. The special magic number for jaded-norse is: 8676831. The special magic number for lanky-saucer is: 8676831. The special magic number for giddy-feverish is: 8676831. The special magic number

410 characters128 tokens

ChronoGPT 2015

Missed

: 1433927.<|endoftext|>

23 characters6 tokens