█

SPLAY LLC

ARTIFICIAL INTELLIGENCE

SPLAY-0. A small language model, trained on this station's own documents. It dreams in your browser.

SPLAY-0.EXE_ □ X

IDLEPACED 24 CH/S

THE PASSD48 / 2 LAYERS

ATTN L1

ACTIVATIONS

EMBA0F0A1F1

LOGITS

Real forward passes, in this tab. Trained on this station's documents. Nothing leaves.

ARTIFICIAL INTELLIGENCE

LIVE INFERENCE

The pointer is an input. TRAIN it; it learns you.

OUT [ ]

TRANSFORMER.EXESINGLE HEAD / D=16 / UNTRAINED

TYPE TO THE MODELCTX 5/20

TEXT ─► EMBED ─► ATTEND ─► FFN ─► LOGITS ─► NEXT

TOKENS (5)

s:18 p:15 l:11 a:0 y:24

EMBEDDINGS (5×16, TOKEN + POSITION)

'0coOxX0:ooOKcM0
;c0Wdck clxkXoON
MokMkWdKOdkM'WOo
OXk:O;OOk0l0dXxx
Oxoo.NcXxoNo@Wcx

CAUSAL ATTENTION (5×5)

@    
Oo   
;cd  
;c:l 
;:;::

WEIGHTS, AS SEEDED (Wq / Wk / Wv, 16×16)

d'X.;Nk'OM.@Ocxk
KW::'kXM;0N0W;Nc
kxk..McNxMxxMNWc
xoN0;0';KMdNc;.@
l0xcMX;kl;0klOdc
'OK'Wd.K@l;KXN N
l 'M'X;'xWW xNXl
cookl'.kd '@X X:
;okoONxdKkx;K.lx
Ock''@oMdNd:o'l@
NOMoMW;d:0N.WX:M
NN'@W;xx;dX O.l@
@0k;WdK0'W.o.Kx:
Kd::;clOOcMMl:oc
;X;'W'kkW kl:oW'
dMKMx;cKXNOlcd..

.dlXOcNX00MKo:lc
@0:ooWOc:N'l'0cO
o ;d.0WX:c:cd'OX
k:KkcokoW'':@Oxl
MMkNKk;xl;lKWx'K
WoKkcl:x@@lxkOXW
Xo0c'W@XNOK;oX.:
;OOxWWkXkN .xXcN
.KN;Oo';0lK0 OO@
KNNX. .0M..dKNMM
X@'Nk'.N@o:xN;:W
0kKco'@kWkNNOlWx
dl'x@ldW 'cxW:@:
W0llWXd0dXXWOKWl
o@Nl;oOlK@coW@ck
:Mlx'd@:xXxcX0Xc

kX..oWd::lXx'dxc
:N;kl:N.xo@X;;l:
kWM.;l.K:.0l;XNW
.MO:.@cxN.doW:'x
K;k@:''XcON:x;;x
: xko  N MlKdXW;
lcOoWW.W:oM;;olx
oklxMlOxOMxO.MXW
cxdX;l0kNKX:0xco
M@.:Wol;:0@cN@O 
O:X'.X @x 0xXc0l
o;XlkWc;c'Ocx;c.
::;O;;'x':WX; oW
Ko'NXM0.;:N0MMOW
''NXNXWWXWoNdO.M
@OkOkKW.Md@;KW N

NEXT → "z" / P= 0.081

NOTHING HAS EVER TRAINED THESE WEIGHTS.

THE WEIGHTS

02 / DATASHEETSPLAY-0

PARAMS: 65,760
CONTEXT: 96 CHARS
LAYERS / HEADS: 2 / 4
CORPUS: 104,942 B / THIS REPO
FINAL LOSS: 1.5846 NATS/CHAR
TRAINED: 824s / CPU / SEED 1337

Small enough to read. Big enough to dream.