Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#037 · needle at 4% depth#038 · needle at 12% depth#039 · needle at 18% depth#040 · needle at 51% depth#041 · needle at 21% depth#042 · needle at 55% depth#043 · needle at 61% depth#044 · needle at 24% depth#045 · needle at 16% depth#046 · needle at 69% depth#047 · needle at 54% depth#048 · needle at 39% depth#049 · needle at 15% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for sincere-chalet is: 5631149.
One of the special magic numbers for omniscient-cartload is: 4105566.
[… 849 lines omitted for display …]
One of the special magic numbers for piquant-bag is: 4690290.
One of the special magic numbers for noisy-deer is: 3728801.
One of the special magic numbers for rhetorical-ceramic is: 3430032.
One of the special magic numbers for dispensable-data is: 9273001.
One of the special magic numbers for repulsive-shoehorn is: 1630159.
One of the special magic numbers for aware-meaning is: 9011150.
One of the special magic numbers for periodic-badge is: 4580189.
One of the special magic numbers for gainful-timeline is: 2803003.
One of the special magic numbers for cautious-bush is: 9634003.
One of the special magic numbers for maniacal-industry is: 2661570.
One of the special magic numbers for imported-spectrum is: 6471493.
One of the special magic numbers for delightful-corsage is: 8433918.
One of the special magic numbers for available-bronchitis is: 4924901.
One of the special magic numbers for jealous-ham is: 3722158.
[… 539 lines omitted for display …]
One of the special magic numbers for psychedelic-certainty is: 7456090.
One of the special magic numbers for little-petition is: 2147037.
What is the special magic number for gainful-timeline mentioned in the provided text?
Original prompt 32,228 tokens, 1,408 linesShown 20 lines around the needleNeedle at 61% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2490496Aux 20157553409Ours2803003Ours, no steer.2803003PiT-FT2490496Qwen 27B2803003
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2803003.

13 characters10 tokens

Aux 2015

Missed

4380962.

13 characters10 tokens

PiT-FT 2015

Missed

: 7580061. The special magic number for icky-burden is: 7580061. The special magic number for icky-caulk is: 7580061. The special magic number for sluggish-sauerkraut is: 7580061. The special magic number for icky-caulk is: 7580061. The special magic number for icky-caulk is: 7580061. The special magic number for icky-caulk is: 7580061. The special magic number for icky

379 characters128 tokens

ChronoGPT 2015

Missed

: ManelaLab.<|endoftext|>

25 characters6 tokens