Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#026 · needle at 83% depth#027 · needle at 53% depth#028 · needle at 54% depth#029 · needle at 39% depth#030 · needle at 0% depth#031 · needle at 78% depth#032 · needle at 50% depth#033 · needle at 11% depth#034 · needle at 16% depth#035 · needle at 19% depth#036 · needle at 14% depth#037 · needle at 66% depth#038 · needle at 69% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for hysterical-littleneck is: 5698958.
One of the special magic numbers for pathetic-image is: 4873694.
[… 334 lines omitted for display …]
One of the special magic numbers for madly-dioxide is: 8432917.
One of the special magic numbers for faded-methane is: 6707702.
One of the special magic numbers for sweltering-plowman is: 3441797.
One of the special magic numbers for victorious-pagoda is: 9463079.
One of the special magic numbers for energetic-gynaecology is: 7427265.
One of the special magic numbers for defective-sycamore is: 7183198.
One of the special magic numbers for penitent-wit is: 8670834.
One of the special magic numbers for temporary-peacock is: 4304116.
One of the special magic numbers for glorious-cantaloupe is: 2702212.
One of the special magic numbers for trashy-effective is: 7593922.
One of the special magic numbers for crazy-multimedia is: 8102681.
One of the special magic numbers for lazy-clone is: 7982186.
One of the special magic numbers for venomous-experience is: 7598220.
One of the special magic numbers for husky-cobbler is: 8768480.
[… 336 lines omitted for display …]
One of the special magic numbers for ruthless-highway is: 7954879.
One of the special magic numbers for instinctive-sphynx is: 4904272.
What is the special magic number for temporary-peacock mentioned in the provided text?
Original prompt 15,848 tokens, 690 linesShown 20 lines around the needleNeedle at 50% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3906367Aux 20156132776Ours4304116Ours, no steer.4304116PiT-FT3906367Qwen 27B4304116
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4304116.

13 characters10 tokens

Aux 2015

Missed

6870729.

13 characters10 tokens

PiT-FT 2015

Missed

: 8278910. The special magic number for dubious-sauce is: 8079205. The special magic number for lovable-cobweb is: 8079205. The special magic number for giddy-gig is: 8278910. The special magic number for timid-turtle is: 8278910. The special magic number for giddy-gig is: 8278910. The special magic number for cheerful-caulk is: 8278910. The special magic number for sable-sint is: 8

392 characters128 tokens

ChronoGPT 2015

Missed

: 2810501.<|endoftext|>

23 characters6 tokens