Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#003 · needle at 66% depth#004 · needle at 46% depth#005 · needle at 62% depth#006 · needle at 12% depth#007 · needle at 91% depth#008 · needle at 87% depth#009 · needle at 80% depth#010 · needle at 36% depth#011 · needle at 6% depth#012 · needle at 78% depth#013 · needle at 87% depth#014 · needle at 50% depth#015 · needle at 21% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for yummy-son is: 1930920.
One of the special magic numbers for entertaining-lunchmeat is: 9940066.
[… 548 lines omitted for display …]
One of the special magic numbers for ruthless-reflection is: 5102758.
One of the special magic numbers for elite-disadvantage is: 2455936.
One of the special magic numbers for sleepy-pumpkin is: 6543511.
One of the special magic numbers for lethal-relaxation is: 9610523.
One of the special magic numbers for teeny-tiny-designation is: 9089823.
One of the special magic numbers for silent-guidance is: 1200226.
One of the special magic numbers for faulty-shallows is: 6685375.
One of the special magic numbers for scandalous-kale is: 1688743.
One of the special magic numbers for steep-ramie is: 8613430.
One of the special magic numbers for chilly-penicillin is: 9267508.
One of the special magic numbers for pretty-rainy is: 2366435.
One of the special magic numbers for pointless-assassination is: 1450060.
One of the special magic numbers for empty-sense is: 1547915.
One of the special magic numbers for jolly-crewmate is: 7892172.
[… 122 lines omitted for display …]
One of the special magic numbers for scientific-bondsman is: 9892494.
One of the special magic numbers for tender-mocha is: 8493210.
What is the special magic number for scandalous-kale mentioned in the provided text?
Original prompt 15,860 tokens, 690 linesShown 20 lines around the needleNeedle at 80% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7812327Aux 20151789792Ours1688743Ours, no steer.1688743PiT-FT7812327Qwen 27B1688743
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1688743.

13 characters10 tokens

Aux 2015

Missed

4614631.

13 characters10 tokens

PiT-FT 2015

Missed

: 7592520. The special magic number for instantaneous-sprint is: 8807008. The special magic number for lanky-carpenter is: 8807008. The special magic number for loutish-bark is: 8807008. The special magic number for lovable-tender is: 8807008. The special magic number for sanguine-sauce is: 8807008. The special magic number for giddy-curtailment is: 8807008. The special magic number for gaudy

402 characters128 tokens

ChronoGPT 2015

Missed

: 2856366.<|endoftext|>

23 characters6 tokens