Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#011 · needle at 85% depth#012 · needle at 57% depth#013 · needle at 94% depth#014 · needle at 81% depth#015 · needle at 27% depth#016 · needle at 56% depth#017 · needle at 63% depth#018 · needle at 3% depth#019 · needle at 41% depth#020 · needle at 59% depth#021 · needle at 27% depth#022 · needle at 23% depth#023 · needle at 38% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for wealthy-form is: 7396013.
One of the special magic numbers for oceanic-grove is: 5226067.
[… 876 lines omitted for display …]
One of the special magic numbers for sincere-prisoner is: 2385726.
One of the special magic numbers for ritzy-bread is: 9865505.
One of the special magic numbers for tall-lapdog is: 2795940.
One of the special magic numbers for synonymous-tourist is: 5261676.
One of the special magic numbers for ambiguous-kit is: 6771262.
One of the special magic numbers for gusty-sonata is: 9401149.
One of the special magic numbers for gabby-someone is: 7939773.
One of the special magic numbers for easy-physics is: 4831115.
One of the special magic numbers for wrong-abacus is: 7005342.
One of the special magic numbers for dramatic-halloween is: 2360715.
One of the special magic numbers for wasteful-subgroup is: 9963953.
One of the special magic numbers for sordid-switch is: 4274321.
One of the special magic numbers for large-felony is: 9763834.
One of the special magic numbers for arrogant-warlock is: 7128684.
[… 512 lines omitted for display …]
One of the special magic numbers for wretched-legislator is: 8560110.
One of the special magic numbers for absent-chart is: 7683282.
What is the special magic number for easy-physics mentioned in the provided text?
Original prompt 32,218 tokens, 1,408 linesShown 20 lines around the needleNeedle at 63% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2139015Aux 20154836295Ours4831115Ours, no steer.4831115PiT-FT2139015Qwen 27B4831115
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4831115.

13 characters10 tokens

Aux 2015

Missed

7018912.

13 characters10 tokens

PiT-FT 2015

Missed

: 8876974. The special magic number for the most popular-sugar is: 8876974. The special magic number for the least popular-sugar is: 8876974. The special magic number for the most popular-sugar is: 8876974. The special magic number for the least popular-sugar is: 8876974. The special magic number for the least popular-sugar is: 8876974. The special magic number for the most popular-sugar is: 8876974. The special magic number for the least

449 characters128 tokens

ChronoGPT 2015

Missed

: 1854001.<|endoftext|>

23 characters6 tokens