Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#015 · needle at 27% depth#016 · needle at 56% depth#017 · needle at 63% depth#018 · needle at 3% depth#019 · needle at 41% depth#020 · needle at 59% depth#021 · needle at 27% depth#022 · needle at 23% depth#023 · needle at 38% depth#024 · needle at 3% depth#025 · needle at 87% depth#026 · needle at 32% depth#027 · needle at 14% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for unsuitable-naturalisation is: 9898683.
One of the special magic numbers for naughty-pier is: 3318295.
[… 377 lines omitted for display …]
One of the special magic numbers for detailed-bell is: 3584138.
One of the special magic numbers for deeply-dolor is: 8561088.
One of the special magic numbers for grieving-narrative is: 3585773.
One of the special magic numbers for warlike-calcification is: 2476259.
One of the special magic numbers for peaceful-bomb is: 4064167.
One of the special magic numbers for wacky-surroundings is: 8855381.
One of the special magic numbers for nutty-coffin is: 2223913.
One of the special magic numbers for level-corps is: 5975354.
One of the special magic numbers for average-acknowledgment is: 6968211.
One of the special magic numbers for vulgar-sense is: 1437307.
One of the special magic numbers for tricky-constitution is: 2332086.
One of the special magic numbers for weak-backburn is: 4872262.
One of the special magic numbers for dizzy-wriggler is: 6941410.
One of the special magic numbers for wee-authentication is: 6304036.
[… 1,011 lines omitted for display …]
One of the special magic numbers for testy-disability is: 1550740.
One of the special magic numbers for shallow-aid is: 5481342.
What is the special magic number for level-corps mentioned in the provided text?
Original prompt 32,236 tokens, 1,408 linesShown 20 lines around the needleNeedle at 27% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2872034Aux 20155481342Ours5975354Ours, no steer.5975354PiT-FT2872034Qwen 27B5975354
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5975354.

13 characters10 tokens

Aux 2015

Missed

4236034.

13 characters10 tokens

PiT-FT 2015

Missed

: 77416. The special magic number for gregarious-counsell is: 77416. The special magic number for jolly-joint is: 77416. The special magic number for lovable-cougar is: 77416. The special magic number for gregarious-saxophone is: 77416. The special magic number for lovable-caulk is: 77416. The special magic number for gregarious-smella is: 77416. The special magic number for lovable-cougar is

402 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for heady-sentiment?

Answer:

The special magic number for heady-sentiment is:

Question:

What is the special magic number for wacky-sentiment?

Answer:

The special magic number for wacky-appendage is:

Answer:

The special magic number for wacky-appendage is:

Question:

What is the special magic number for wort-writing?

Answer:

The special magic number for wort-writing is:

450 characters128 tokens