Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#056 · needle at 27% depth#057 · needle at 35% depth#058 · needle at 77% depth#059 · needle at 65% depth#060 · needle at 20% depth#061 · needle at 5% depth#062 · needle at 18% depth#063 · needle at 10% depth#064 · needle at 15% depth#065 · needle at 41% depth#066 · needle at 17% depth#067 · needle at 9% depth#068 · needle at 79% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for panoramic-livestock is: 3690877.
One of the special magic numbers for exultant-chairperson is: 2278857.
[… 503 lines omitted for display …]
One of the special magic numbers for busy-industrialisation is: 3829017.
One of the special magic numbers for many-directory is: 1605809.
One of the special magic numbers for horrible-coupon is: 6071462.
One of the special magic numbers for cautious-tracksuit is: 4949441.
One of the special magic numbers for malicious-probation is: 8382106.
One of the special magic numbers for chubby-blackboard is: 2873689.
One of the special magic numbers for hurt-plumber is: 9756714.
One of the special magic numbers for glorious-luck is: 2932390.
One of the special magic numbers for oafish-calcification is: 4147102.
One of the special magic numbers for tranquil-volunteering is: 2568514.
One of the special magic numbers for cloudy-grab-bag is: 7392597.
One of the special magic numbers for moaning-quilt is: 9154560.
One of the special magic numbers for steadfast-truck is: 6033459.
One of the special magic numbers for bored-appropriation is: 9009557.
[… 2,322 lines omitted for display …]
One of the special magic numbers for tiny-sculptural is: 4811721.
One of the special magic numbers for cloistered-morning is: 2758089.
What is the special magic number for glorious-luck mentioned in the provided text?
Original prompt 64,992 tokens, 2,845 linesShown 20 lines around the needleNeedle at 18% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3303053Aux 20158882171Ours2932390Ours, no steer.2932390PiT-FT3303053Qwen 27B2932390
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2932390.

13 characters10 tokens

Aux 2015

Missed

3654959.

13 characters10 tokens

PiT-FT 2015

Missed

: 770812. The special magic number for sarcastic-sauce is: 8702036. The special magic number for laryng-cauliflower is: 8702036. The special magic number for icky-cater is: 5742024. The special magic number for gaudy-gift is: 8702036. The special magic number for giddy-gazelle is: 8702036. The special magic number for icky-cougar is: 5742024. The special magic number for icky-c

387 characters128 tokens

ChronoGPT 2015

Missed

: R��

Rb:

The special Magic Number number for the same is: Rb.

Rc:

The special Magic number for the same is: Rc.

Rd:

The special Magic number for the same is: Rd.

Rg:

The special Magic number for the same is: Rg.

Rh:

The special Magic number for the same is: Rg.

Rl:

The special Magic number for the same is: Rg.

R

354 characters128 tokens