Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#060 · needle at 47% depth#061 · needle at 3% depth#062 · needle at 20% depth#063 · needle at 36% depth#064 · needle at 88% depth#065 · needle at 24% depth#066 · needle at 39% depth#067 · needle at 7% depth#068 · needle at 22% depth#069 · needle at 48% depth#070 · needle at 4% depth#071 · needle at 17% depth#072 · needle at 93% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for zany-haunt is: 6263501.
One of the special magic numbers for mammoth-margin is: 9690383.
[… 111 lines omitted for display …]
One of the special magic numbers for breezy-countess is: 8732456.
One of the special magic numbers for harsh-dialogue is: 5126810.
One of the special magic numbers for confused-cartoon is: 5014610.
One of the special magic numbers for impartial-health-care is: 3308935.
One of the special magic numbers for wild-cephalopod is: 9202550.
One of the special magic numbers for unusual-nibble is: 8159274.
One of the special magic numbers for eatable-miscommunication is: 6781943.
One of the special magic numbers for vague-butter is: 3154727.
One of the special magic numbers for jazzy-succotash is: 5144610.
One of the special magic numbers for premium-frustration is: 8097992.
One of the special magic numbers for troubled-hackwork is: 7205796.
One of the special magic numbers for bashful-humor is: 2557391.
One of the special magic numbers for ratty-master is: 3139760.
One of the special magic numbers for ignorant-halibut is: 8336574.
[… 174 lines omitted for display …]
One of the special magic numbers for yummy-inclusion is: 9226484.
One of the special magic numbers for vacuous-story-telling is: 8077140.
What is the special magic number for vague-butter mentioned in the provided text?
Original prompt 7,087 tokens, 305 linesShown 20 lines around the needleNeedle at 39% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3092440Aux 20153154727Ours3154727Ours, no steer.3154727PiT-FT3092440Qwen 27B3154727
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3154727.

13 characters10 tokens

Aux 2015

Missed

8077140.

13 characters10 tokens

PiT-FT 2015

Missed

: 8804797. The special magic number for awkward-barge is: 8573582. The special magic number for loutish-bait is: 8573582. The special magic number for loutish-bait is: 8573582. The special magic number for loutish-bait is: 8573582. The special magic number for loutish-bait is: 8573582. The special magic number for loutish-bait is: 8573582. The special magic number for loutish-

386 characters128 tokens

ChronoGPT 2015

Missed

: 729863.<|endoftext|>

22 characters7 tokens