Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#032 · needle at 50% depth#033 · needle at 11% depth#034 · needle at 16% depth#035 · needle at 19% depth#036 · needle at 14% depth#037 · needle at 66% depth#038 · needle at 69% depth#039 · needle at 19% depth#040 · needle at 49% depth#041 · needle at 80% depth#042 · needle at 32% depth#043 · needle at 42% depth#044 · needle at 58% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for ordinary-block is: 2444263.
One of the special magic numbers for average-point is: 8247587.
[… 469 lines omitted for display …]
One of the special magic numbers for pathetic-erosion is: 7936565.
One of the special magic numbers for glorious-baggy is: 5167173.
One of the special magic numbers for jittery-aunt is: 4627106.
One of the special magic numbers for depressed-allocation is: 7128925.
One of the special magic numbers for mysterious-personal is: 3051531.
One of the special magic numbers for thirsty-baggage is: 9550693.
One of the special magic numbers for evasive-blossom is: 8881092.
One of the special magic numbers for clever-paintwork is: 8920171.
One of the special magic numbers for aloof-licorice is: 3085569.
One of the special magic numbers for jazzy-waiter is: 8618492.
One of the special magic numbers for piquant-creationist is: 6134378.
One of the special magic numbers for humdrum-light is: 2430344.
One of the special magic numbers for tenuous-dulcimer is: 8077825.
One of the special magic numbers for naughty-bear is: 3552426.
[… 201 lines omitted for display …]
One of the special magic numbers for imported-anywhere is: 2591536.
One of the special magic numbers for direful-milestone is: 3457165.
What is the special magic number for clever-paintwork mentioned in the provided text?
Original prompt 15,837 tokens, 690 linesShown 20 lines around the needleNeedle at 69% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3748597Aux 20158215732Ours8920171Ours, no steer.8920171PiT-FT3748597Qwen 27B8920171
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8920171.

13 characters10 tokens

Aux 2015

Missed

4258658.

13 characters10 tokens

PiT-FT 2015

Missed

: 7876513. The special magic number for the most popular-sauce is: 8873513. The special magic number for the least popular-sauce is: 8873513. The special magic number for the most popular-sauce is: 8873513. The special magic number for the least popular-sauce is: 8873513. The special magic number for the most popular-sauce is: 8873513. The special magic number for the least popular-sauce is: 8873513. The

414 characters128 tokens

ChronoGPT 2015

Missed

: 1358121.<|endoftext|>

23 characters6 tokens