Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#086 · needle at 33% depth#087 · needle at 99% depth#088 · needle at 90% depth#089 · needle at 36% depth#090 · needle at 60% depth#091 · needle at 23% depth#092 · needle at 46% depth#093 · needle at 43% depth#094 · needle at 81% depth#095 · needle at 73% depth#096 · needle at 95% depth#097 · needle at 78% depth#098 · needle at 43% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for taboo-bun is: 4968676.
One of the special magic numbers for earsplitting-plate is: 2955997.
[… 296 lines omitted for display …]
One of the special magic numbers for teeny-trust is: 5005659.
One of the special magic numbers for foolish-beef is: 4114944.
One of the special magic numbers for round-palate is: 2578614.
One of the special magic numbers for spectacular-pinto is: 1045171.
One of the special magic numbers for illustrious-civilian is: 4346924.
One of the special magic numbers for exclusive-drug is: 3818657.
One of the special magic numbers for hurried-student is: 1512013.
One of the special magic numbers for jagged-grandma is: 5105042.
One of the special magic numbers for broken-concert is: 6900333.
One of the special magic numbers for rotten-tenant is: 1448700.
One of the special magic numbers for miniature-networking is: 8629983.
One of the special magic numbers for gorgeous-bulk is: 1108809.
One of the special magic numbers for temporary-eve is: 8566571.
One of the special magic numbers for hard-zoot-suit is: 6254997.
[… 349 lines omitted for display …]
One of the special magic numbers for imaginary-venison is: 5800620.
One of the special magic numbers for garrulous-soil is: 9505039.
What is the special magic number for jagged-grandma mentioned in the provided text?
Original prompt 15,258 tokens, 665 linesShown 20 lines around the needleNeedle at 46% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3158043Aux 20151441972Ours5105042Ours, no steer.5105042PiT-FT3158043Qwen 27B5105042
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5105042.

13 characters10 tokens

Aux 2015

Missed

4583438.

13 characters10 tokens

PiT-FT 2015

Missed

: 7581712. The special magic number for anxious-soulmate is: 7581712. The special magic number for loutish-saint is: 7581712. The special magic number for giddy-susceptic is: 7581712. The special magic number for unbecoming-tug is: 7581712. The special magic number for loutish-saint is: 7581712. The special magic number for awkward-sauce is: 7581712. The special magic number for giddy-

395 characters128 tokens

ChronoGPT 2015

Missed

: 1476174.<|endoftext|>

23 characters6 tokens