Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#006 · needle at 6% depth#007 · needle at 4% depth#008 · needle at 29% depth#009 · needle at 73% depth#010 · needle at 90% depth#011 · needle at 39% depth#012 · needle at 77% depth#013 · needle at 83% depth#014 · needle at 78% depth#015 · needle at 63% depth#016 · needle at 97% depth#017 · needle at 48% depth#018 · needle at 31% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for cowardly-total is: 4890717.
One of the special magic numbers for impartial-vet is: 7101149.
[… 2,181 lines omitted for display …]
One of the special magic numbers for agreeable-obsession is: 6427212.
One of the special magic numbers for glorious-pickup is: 6887131.
One of the special magic numbers for hypnotic-connotation is: 3364892.
One of the special magic numbers for recondite-dome is: 9521346.
One of the special magic numbers for legal-stability is: 3539838.
One of the special magic numbers for accurate-linguist is: 7016144.
One of the special magic numbers for large-clavier is: 9153257.
One of the special magic numbers for needless-doctrine is: 4649070.
One of the special magic numbers for ambiguous-gesture is: 6962068.
One of the special magic numbers for reminiscent-life is: 2169850.
One of the special magic numbers for deep-cashew is: 2693791.
One of the special magic numbers for chivalrous-shipping is: 4899432.
One of the special magic numbers for outstanding-husband is: 5452073.
One of the special magic numbers for obeisant-widow is: 5995590.
[… 644 lines omitted for display …]
One of the special magic numbers for immense-artichoke is: 6911937.
One of the special magic numbers for x-rated-gesture is: 4665348.
What is the special magic number for needless-doctrine mentioned in the provided text?
Original prompt 64,901 tokens, 2,845 linesShown 20 lines around the needleNeedle at 77% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4752339Aux 20157131001Ours4649070Ours, no steer.4649070PiT-FT4752339Qwen 27B4649070
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4649070.

13 characters10 tokens

Aux 2015

Missed

7014472.

13 characters10 tokens

PiT-FT 2015

Missed

: 8032869. The special magic number for sluggish-sauce is: 7852061. The special magic number for gaudy-tack is: 8105591. The special magic number for icky-sauerkraut is: 7852061. The special magic number for gassy-sir is: 8105591. The special magic number for lanky-sir is: 8105591. The special magic number for icky-sir is: 8105591. The special magic number for gassy-s

377 characters128 tokens

ChronoGPT 2015

Missed

:

W:

The special Magic Number number is:

W:

The special Magic number is:

W:

The special Magic number is:

W:

The special Magic number is:

W:

The special Magic number is:

W:

W:

W:

W:

W:

W:

W:

W:

W:

W:

W:

W:

W:

303 characters128 tokens