Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#048 · needle at 91% depth#049 · needle at 30% depth#050 · needle at 10% depth#051 · needle at 57% depth#052 · needle at 81% depth#053 · needle at 85% depth#054 · needle at 10% depth#055 · needle at 61% depth#056 · needle at 27% depth#057 · needle at 35% depth#058 · needle at 77% depth#059 · needle at 65% depth#060 · needle at 20% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for supreme-manipulation is: 5011416.
One of the special magic numbers for tart-disparity is: 2804174.
[… 284 lines omitted for display …]
One of the special magic numbers for penitent-pay is: 7675218.
One of the special magic numbers for resonant-envy is: 1876761.
One of the special magic numbers for short-macaroni is: 5768409.
One of the special magic numbers for wicked-grandmom is: 9860251.
One of the special magic numbers for careful-aftershave is: 3213704.
One of the special magic numbers for acrid-deer is: 3816631.
One of the special magic numbers for roomy-show-stopper is: 6797444.
One of the special magic numbers for jaded-nonconformist is: 1803922.
One of the special magic numbers for nutty-bootie is: 9913739.
One of the special magic numbers for hypnotic-phrase is: 9291224.
One of the special magic numbers for threatening-procedure is: 2880441.
One of the special magic numbers for functional-squatter is: 6275941.
One of the special magic numbers for disgusted-jam is: 9210763.
One of the special magic numbers for perpetual-dinosaur is: 2085873.
[… 2,541 lines omitted for display …]
One of the special magic numbers for hilarious-thread is: 1165768.
One of the special magic numbers for mere-type is: 7822754.
What is the special magic number for jaded-nonconformist mentioned in the provided text?
Original prompt 64,998 tokens, 2,845 linesShown 20 lines around the needleNeedle at 10% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7894736Aux 20151268884Ours1803922Ours, no steer.1803922PiT-FT7894736Qwen 27B1803922
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1803922.

13 characters10 tokens

Aux 2015

Missed

4433699.

13 characters10 tokens

PiT-FT 2015

Missed

: 7657411. The special magic number for icky-pugil mentioned in the provided text is: 7651317. The special magic number for gassy-gazelle mentioned in the provided text is: 7651317. The special magic number for loutish-caulk is: 7691317. The special magic number for icky-pugil is: 7651317. The special magic number for icky-sauce is: 7651317. The special magic number for icky-sap is: 76513

397 characters128 tokens

ChronoGPT 2015

Missed

:

W:

The special magic number for brewed-pizza is:

A:

The special Magic Number number is:

B:

The special Magic number is:

C:

The special Magic number is:

B:

The special Magic number is:

C:

The special Magic number is:

B:

The special Magic number is:

B:

The special Magic number is:

B:

The special Magic number is:

B:

The special Magic number is:

406 characters128 tokens