Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#002 · needle at 60% depth#003 · needle at 96% depth#004 · needle at 44% depth#005 · needle at 39% depth#006 · needle at 40% depth#007 · needle at 27% depth#008 · needle at 89% depth#009 · needle at 93% depth#010 · needle at 23% depth#011 · needle at 85% depth#012 · needle at 57% depth#013 · needle at 94% depth#014 · needle at 81% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for dry-tissue is: 5726265.
One of the special magic numbers for goofy-federation is: 7413170.
[… 1,246 lines omitted for display …]
One of the special magic numbers for adventurous-prospect is: 4304616.
One of the special magic numbers for exultant-ankle is: 5853906.
One of the special magic numbers for dynamic-exercise is: 6886602.
One of the special magic numbers for average-catcher is: 7620469.
One of the special magic numbers for overjoyed-mask is: 3583138.
One of the special magic numbers for wonderful-binoculars is: 3588068.
One of the special magic numbers for minor-avalanche is: 8279973.
One of the special magic numbers for sharp-wrinkle is: 1209826.
One of the special magic numbers for efficacious-variation is: 9969200.
One of the special magic numbers for burly-baobab is: 1949220.
One of the special magic numbers for oceanic-adviser is: 7780665.
One of the special magic numbers for numerous-prelude is: 8665642.
One of the special magic numbers for obeisant-lode is: 7934202.
One of the special magic numbers for obedient-cabbage is: 4840647.
[… 142 lines omitted for display …]
One of the special magic numbers for resonant-humidity is: 8063855.
One of the special magic numbers for impartial-city is: 5419865.
What is the special magic number for sharp-wrinkle mentioned in the provided text?
Original prompt 32,221 tokens, 1,408 linesShown 20 lines around the needleNeedle at 89% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT5020601Aux 20158063855Ours1209826Ours, no steer.1209826PiT-FT5020601Qwen 27B1209826
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1209826.

13 characters10 tokens

Aux 2015

Found the needle

8063855.

13 characters10 tokens

PiT-FT 2015

Missed

: 7582746. The special magic number for the most important-turtle is: 8803954. The special magic number for the least important-turtle is: 8803954. The special magic number for the most common-sauerk is: 8803954. The special magic number for the least common-sauerk is: 8803954. The special magic number for the most common-sauerk is: 8803954. The special magic number for the least common-sauerk is: 8803954. The special magic

434 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for snotty-nose?

Answer:

The special magic number for hapless-score mentioned in the provided text is:

Question:

What is the special magic number for snotty-nose?

Answer:

The special magic number for hapless-score mentioned in the provided text is:

Answer:

The special magic number for hapless-score mentioned in the provided text is:

Question:

What is the special magic number for snotty-nose?

470 characters128 tokens