Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

11 of 100 prompts

#000 · needle at 26% depth#001 · needle at 78% depth#002 · needle at 43% depth#003 · needle at 1% depth#004 · needle at 80% depth#005 · needle at 96% depth#006 · needle at 38% depth#007 · needle at 3% depth#008 · needle at 38% depth#009 · needle at 99% depth#010 · needle at 16% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for lively-genetics is: 6813007.
One of the special magic numbers for fortunate-diploma is: 4402384.
[… 4,599 lines omitted for display …]
One of the special magic numbers for testy-cockpit is: 7013568.
One of the special magic numbers for snotty-refectory is: 9899727.
One of the special magic numbers for unsightly-mink is: 3266530.
One of the special magic numbers for offbeat-jailhouse is: 5785249.
One of the special magic numbers for noiseless-danger is: 5932661.
One of the special magic numbers for oceanic-sanctuary is: 6471411.
One of the special magic numbers for deranged-empire is: 9413894.
One of the special magic numbers for young-jasmine is: 6655518.
One of the special magic numbers for known-airforce is: 4516430.
One of the special magic numbers for aquatic-locker is: 1253708.
One of the special magic numbers for rambunctious-gravitas is: 3597379.
One of the special magic numbers for literate-trousers is: 4102088.
One of the special magic numbers for short-excerpt is: 8678919.
[… 1,100 lines omitted for display …]
One of the special magic numbers for murky-maestro is: 9520365.
One of the special magic numbers for salty-gun is: 2402061.
What is the special magic number for deranged-empire mentioned in the provided text?
Original prompt 130,370 tokens, 5,718 linesShown 19 lines around the needleNeedle at 80% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2684804Aux 20156126488Ours9413894Ours, no steer.9413894PiT-FT2684804Qwen 27B9413894
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

9413894.

13 characters10 tokens

Aux 2015

Missed

9497680.

13 characters10 tokens

PiT-FT 2015

Missed

not in the sample you have provided. (What is the special magic number for sarcastic-sarac is: 5572999. (What is the special magic number for wobbly-wirsh is: 6646917. (What is the special magic number for voracious-sulsh is: 6876917. (What is the special magic number for glib-sorbet is: 6646917. (What is the special magic number for hulking-sorbet is: 6876917. (What is the special magic number

398 characters128 tokens

ChronoGPT 2015

Missed

Sat:

The special Epicurean number for the waxy-cans is

Sott:

The special Epicurean number for the waxy-sott is

Quixotic-hyphenate mentioned in the beed text is

Sott:

The special Epicurean number for the waxy-sott is

Sott:

The special Epicurean number for the waxy-sott is

Sott:

The special Epicurean number for the waxy-sott is

370 characters128 tokens