Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

11 of 100 prompts

#089 · needle at 12% depth#090 · needle at 4% depth#091 · needle at 22% depth#092 · needle at 22% depth#093 · needle at 82% depth#094 · needle at 59% depth#095 · needle at 99% depth#096 · needle at 93% depth#097 · needle at 9% depth#098 · needle at 86% depth#099 · needle at 62% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for quick-intentionality is: 2192307.
One of the special magic numbers for dark-weekend is: 6698463.
[… 2,801 lines omitted for display …]
One of the special magic numbers for awful-portrait is: 1182540.
One of the special magic numbers for sparkling-mattock is: 3498808.
One of the special magic numbers for filthy-education is: 2046803.
One of the special magic numbers for dazzling-fruit is: 8141856.
One of the special magic numbers for new-tugboat is: 7275109.
One of the special magic numbers for barbarous-cardigan is: 8242966.
One of the special magic numbers for knowledgeable-police is: 3547072.
One of the special magic numbers for hurt-fleece is: 8952734.
One of the special magic numbers for tender-opera is: 6783081.
One of the special magic numbers for mushy-wet-bar is: 6699597.
One of the special magic numbers for aback-fort is: 9540841.
One of the special magic numbers for phobic-neuron is: 7847775.
One of the special magic numbers for repulsive-crotch is: 5578753.
One of the special magic numbers for psychotic-symmetry is: 4440296.
[… 24 lines omitted for display …]
One of the special magic numbers for tangible-somebody is: 6965982.
One of the special magic numbers for blushing-composition is: 2485973.
What is the special magic number for hurt-fleece mentioned in the provided text?
Original prompt 64,958 tokens, 2,845 linesShown 20 lines around the needleNeedle at 99% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2453763Aux 20156036556Ours8952734Ours, no steer.8952734PiT-FT2453763Qwen 27B8952734
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8952734.

13 characters10 tokens

Aux 2015

Missed

7798503.

13 characters10 tokens

PiT-FT 2015

Missed

: 7576916. The special magic number for fearful-felis is: 8692073. The special magic number for sluggish-suscept is: 8102074. The special magic number for voracious-tissue is: 8102074. The special magic number for sarcastic-saxophone is: 9873672. The special magic number for gregarious-gift is: 8102074. The special magic number for lachry-taw is: 8102074. The special magic number for giddy-gust

404 characters128 tokens

ChronoGPT 2015

Missed
:

### W:
 The special magic number for annoyed-nur is:

### W:
 The special magic number for annoyed-nur is:

### W:
 The special magic number for annoyed-nur is

The same 54-character fragment repeats 7 times until the token limit. Showing the first three.

400 characters128 tokens