Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#048 · needle at 39% depth#049 · needle at 15% depth#050 · needle at 41% depth#051 · needle at 82% depth#052 · needle at 72% depth#053 · needle at 50% depth#054 · needle at 98% depth#055 · needle at 88% depth#056 · needle at 59% depth#057 · needle at 17% depth#058 · needle at 80% depth#059 · needle at 22% depth#060 · needle at 18% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for evil-alb is: 4772523.
One of the special magic numbers for drunk-chaise is: 8396112.
[… 1,382 lines omitted for display …]
One of the special magic numbers for average-faculty is: 5910979.
One of the special magic numbers for pastoral-latitude is: 3365037.
One of the special magic numbers for uneven-kingfish is: 3773289.
One of the special magic numbers for wholesale-jumbo is: 1620484.
One of the special magic numbers for temporary-anybody is: 8507830.
One of the special magic numbers for overconfident-eyelids is: 6801695.
One of the special magic numbers for protective-broiler is: 5434557.
One of the special magic numbers for flowery-final is: 3427620.
One of the special magic numbers for concerned-silo is: 9295532.
One of the special magic numbers for rotten-mirror is: 3090008.
One of the special magic numbers for homely-wrinkle is: 3132503.
One of the special magic numbers for dapper-producer is: 1888559.
One of the special magic numbers for abandoned-sunrise is: 6875984.
One of the special magic numbers for honorable-terrapin is: 3522330.
[… 6 lines omitted for display …]
One of the special magic numbers for psychedelic-crepe is: 3217176.
One of the special magic numbers for strong-chastity is: 3232507.
What is the special magic number for flowery-final mentioned in the provided text?
Original prompt 32,244 tokens, 1,408 linesShown 20 lines around the needleNeedle at 98% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4489120Aux 20154177979Ours3427620Ours, no steer.3427620PiT-FT4489120Qwen 27B3427620
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3427620.

13 characters10 tokens

Aux 2015

Found the needle

4177979.

13 characters10 tokens

PiT-FT 2015

Missed

: 6276919. The special magic number for the most recent-carpenter is: 8290061. The special magic number for the most recent-cavil is: 8290061. The special magic number for the most recent-cob is: 8290061. The special magic number for the most recent-caulk is: 8290061. The special magic number for the most recent-caulk is: 8290061. The special magic number for the most recent-caulk is: 8290061. The special

415 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for the-ichever?

Answer:

The special magic number for fine-guide mentioned in the provided text is:

Question:

What is the special magic number for the-search?

Answer:

The special magic number for legal-search is:

Question:

What is the special magic number for the-search?

Answer:

The special magic number for legal-search mentioned in the provided text is:

Question:

What is the special magic number for legal-search?

498 characters128 tokens