Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#022 · needle at 35% depth#023 · needle at 12% depth#024 · needle at 11% depth#025 · needle at 58% depth#026 · needle at 80% depth#027 · needle at 24% depth#028 · needle at 46% depth#029 · needle at 3% depth#030 · needle at 21% depth#031 · needle at 99% depth#032 · needle at 75% depth#033 · needle at 7% depth#034 · needle at 57% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for materialistic-sorbet is: 7580194.
One of the special magic numbers for difficult-bail is: 4558737.
[… 2,641 lines omitted for display …]
One of the special magic numbers for symptomatic-randomization is: 8067396.
One of the special magic numbers for orange-working is: 4203967.
One of the special magic numbers for handsome-counsellor is: 5290241.
One of the special magic numbers for ruthless-subconscious is: 2381669.
One of the special magic numbers for clear-burrito is: 5654955.
One of the special magic numbers for exultant-tuition is: 3439955.
One of the special magic numbers for tacit-ceiling is: 6413955.
One of the special magic numbers for lonely-oeuvre is: 3090281.
One of the special magic numbers for adamant-soldier is: 7782403.
One of the special magic numbers for real-consensus is: 4159280.
One of the special magic numbers for faded-grade is: 1860299.
One of the special magic numbers for lethal-utilization is: 9543143.
One of the special magic numbers for delicious-owner is: 7208075.
One of the special magic numbers for godly-temple is: 5568800.
[… 3,057 lines omitted for display …]
One of the special magic numbers for attractive-specification is: 6984391.
One of the special magic numbers for outrageous-rifle is: 9495785.
What is the special magic number for lonely-oeuvre mentioned in the provided text?
Original prompt 130,453 tokens, 5,718 linesShown 20 lines around the needleNeedle at 46% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6267356Aux 20157929581Ours3090281Ours, no steer.3090281PiT-FT6267356Qwen 27B3090281
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3090281.

13 characters10 tokens

Aux 2015

Missed

6643682.

13 characters10 tokens

PiT-FT 2015

Missed

not available. [What is the special magic number for the following text? ]It is not available. ]Please provide the corresponding value. ]If you could, it would be very helpful. ]I need the special magic number for the following text. ]Please help me find it.

[Chat Transcript in OP Format] In reply to your query, the special magic number for the following text is: 6876974. The special magic number for the following text is not available. Please provide the corresponding value.

\List of

500 characters128 tokens

ChronoGPT 2015

Missed

:

Sore:

The special Epicurean-letter for sordid-cansity is:

Sore:

The special Epicurean-letter for rambunctious-cansity is:

Sore:

The special Sore for rambunctious-cansity is:

Sore:

The special Sore for rambunctious-mast mentioned in the beed text is:

Sore:

The special Sore for rambunctious-mast mentioned in the rambunctious-

361 characters128 tokens