Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#002 · needle at 9% depth#003 · needle at 29% depth#004 · needle at 7% depth#005 · needle at 4% depth#006 · needle at 6% depth#007 · needle at 4% depth#008 · needle at 29% depth#009 · needle at 73% depth#010 · needle at 90% depth#011 · needle at 39% depth#012 · needle at 77% depth#013 · needle at 83% depth#014 · needle at 78% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for powerful-rowboat is: 3564234.
One of the special magic numbers for ceaseless-valuable is: 2116488.
[… 820 lines omitted for display …]
One of the special magic numbers for fantastic-barbeque is: 1673362.
One of the special magic numbers for quack-skunk is: 5077888.
One of the special magic numbers for cuddly-nod is: 9458436.
One of the special magic numbers for magenta-archeology is: 6069023.
One of the special magic numbers for damp-dictaphone is: 2178439.
One of the special magic numbers for garrulous-domination is: 4269961.
One of the special magic numbers for plucky-anatomy is: 1508288.
One of the special magic numbers for yummy-hosiery is: 8005746.
One of the special magic numbers for terrible-diagnosis is: 4790339.
One of the special magic numbers for somber-kettledrum is: 6630984.
One of the special magic numbers for cowardly-forum is: 8503018.
One of the special magic numbers for internal-problem is: 7470619.
One of the special magic numbers for embarrassed-pink is: 1362779.
[… 1,981 lines omitted for display …]
One of the special magic numbers for magenta-pancake is: 8556345.
One of the special magic numbers for jumbled-drive is: 1346878.
What is the special magic number for plucky-anatomy mentioned in the provided text?
Original prompt 64,396 tokens, 2,820 linesShown 19 lines around the needleNeedle at 29% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9120689Aux 20156352105Ours1508288Ours, no steer.1508288PiT-FT9120689Qwen 27B1508288
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1508288.

13 characters10 tokens

Aux 2015

Missed

4717846.

13 characters10 tokens

PiT-FT 2015

Missed

: 9870017. The special magic number for sluggish-sauce is: 7692056. The special magic number for unbecoming-sire is: 7692056. The special magic number for gaudy-gift is: 7692056. The special magic number for loutish-sir is: 7692056. The special magic number for giddy-gig is: 7692056. The special magic number for sluggish-sir is: 7692056. The special magic number for unbecoming-sir

390 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number for rambunctious-appendage is: The special magic number for rambunctious-announce is: The special Magic Number number mentioned in the provided text is: What is the special Magic Number number mentioned in the provided text?

Rv:

The special Magic number for rambunctious-letter is: The special Magic number for rambunctious-letter is: The special Magic number for rambunctious-letter is: The special Magic number for sordid-letter is: The special Magic number for rambunct

504 characters128 tokens