Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#007 · needle at 91% depth#008 · needle at 87% depth#009 · needle at 80% depth#010 · needle at 36% depth#011 · needle at 6% depth#012 · needle at 78% depth#013 · needle at 87% depth#014 · needle at 50% depth#015 · needle at 21% depth#016 · needle at 90% depth#017 · needle at 46% depth#018 · needle at 95% depth#019 · needle at 40% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for empty-cleat is: 4663001.
One of the special magic numbers for uninterested-sidewalk is: 4306098.
[… 592 lines omitted for display …]
One of the special magic numbers for juvenile-swanling is: 2929175.
One of the special magic numbers for outrageous-diversity is: 7052857.
One of the special magic numbers for obscene-adult is: 1495869.
One of the special magic numbers for envious-makeover is: 3807665.
One of the special magic numbers for enthusiastic-competition is: 1230864.
One of the special magic numbers for scientific-dose is: 9821037.
One of the special magic numbers for rough-whey is: 1951051.
One of the special magic numbers for great-recording is: 3044243.
One of the special magic numbers for nonchalant-reversal is: 1050754.
One of the special magic numbers for stimulating-facet is: 5748109.
One of the special magic numbers for better-tower is: 8799005.
One of the special magic numbers for inquisitive-suite is: 1197757.
One of the special magic numbers for domineering-gum is: 5692181.
One of the special magic numbers for craven-office is: 4708353.
[… 78 lines omitted for display …]
One of the special magic numbers for ordinary-earmuffs is: 9488389.
One of the special magic numbers for smelly-murder is: 6854013.
What is the special magic number for great-recording mentioned in the provided text?
Original prompt 15,853 tokens, 690 linesShown 20 lines around the needleNeedle at 87% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8869583Aux 20151852295Ours3044243Ours, no steer.3044243PiT-FT8869583Qwen 27B3044243
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3044243.

13 characters10 tokens

Aux 2015

Missed

7509900.

13 characters10 tokens

PiT-FT 2015

Missed

: 8884051. The special magic number for sluggish-sherb is: 7584555. The special magic number for anxious-soul is: 8577059. The special magic number for giddy-suck is: 8872372. The special magic number for jagged-soul is: 8872354. The special magic number for unbecoming-turtle is: 7584555. The special magic number for daffy-pip is: 7584555. The special magic number for lanky-sock is:

392 characters128 tokens

ChronoGPT 2015

Missed

: 2859364.<|endoftext|>

23 characters6 tokens