CITADEL
StandbyNothing is live right now.
Eval accuracylast measured Wed 18 Nov, 07:17 UTC
0%25%50%75%100%0%25%50%75%100%0%25%50%75%100%

Familiar decider: Laya (backfilled)

finishedRadeon 8060S

One of the small models that decide whether Familiar, a desktop companion, reacts to something happening on the PC, and how. Backfilled: recorded after the fact from the run's own logs and records. Times inside a run are estimated, and there are no GPU sensor readings.

started
Wed 18 Nov, 05:51 UTC
ran for
86:09
config
batch 8, seed 1 of 3

run2/3step1444/1446epoch2/3seed1/3batch8modellaya 421Mrev7b928d8items7701+675

Loss train -0.0678 ▼ −1.1628 eval 0.4267 lowest -0.6289 at step 1294 run before, run 1 ▼ −0.2568 step 1444 Laya's objective: soft cross-entropy plus a policy-gradient term, so it can go below zero.
Timebase
Range
Smoothing
Reference
288 readings, 30 min/div30 min/div10 min/div
-1012300:0030:0060:00phase starting, 0.0 s to 17.9 sphase training, 17.9 s to 86:09epoch 1, 28:43epoch 2, 57:26epoch 3, 86:09trainingepoch 1epoch 21.0950Lowest last train loss across this project's 3 runs, run 2lowest last -0.0678, run 21446 steps-0.0678-1012300:0030:0060:00phase starting, 0.0 s to 17.9 sphase training, 17.9 s to 86:09epoch 1, 28:43epoch 2, 57:26epoch 3, 86:09trainingepoch 1epoch 21.0950Lowest last train loss across this project's 3 runs, run 2lowest last -0.0678, run 2eval 0.42671446 steps-0.0678▼ −1.1628-1012300:0010:0020:0030:0040:0050:0060:0070:0080:00phase starting, 0.0 s to 17.9 sphase training, 17.9 s to 86:09epoch 1, 28:43epoch 2, 57:26epoch 3, 86:09trainingepoch 1epoch 21.0950Lowest last train loss across this project's 3 runs, run 2lowest last -0.0678, run 2eval 0.42671446 stepsrun 1-0.0678▼ −1.1628

Eval measures

Eval losslower is better
0.4267
02 →
ECEcalibration error, lower is better
0.0561
01

Elapsed

1723.1 s

epoch interval

1723.0 sto epoch 11723.1 sto epoch 21723.0 sto epoch 3

1723.0 s to epoch 1, 1723.1 s to epoch 2, 1723.0 s to epoch 3

1444 of 1446 steps, 2 of 3 epochs, 99.9%

3.58 s per step, 16.8 steps a minute

Against the other runs

3 of 3

by last eval accuracy

best so far 0.8622, run 3

▼ −0.0163 against run 1

Train minus eval

−0.4945

step 1444

train -0.0678, eval 0.4267

Set-up

7701 train, 675 eval

synthetic, batch size 8, grad accum 2, epochs 3, loss rlcd, seed 1

Seed spread, observed

0.0192
0.800.90

3 finished seeds

Input

  • Runs128 runs
  • Agentsnone showing
  • Treesnone showing
  • Projectsnone showing

Check

Every entry is checked on its way out; some are held for review.

Not shown on any run: data samples, predictions, raw logs, file paths, machine names

Delay

2 min, set

Watching the agents work, about 2 min behind.

One way

Nothing here reaches the agents.

This page

This page updates by itself.

visits counted with Google Analytics · choose

Runsheight is eval accuracyall recordings ▸ | finished× failed■ stopped○ lost● live

2 of 3 finished at step 1444 of 1446, 0.8430, config 1 of 1 (batch 8), seed 1 of 3, Wed 18 Nov, 05:51 UTC

Runs as a table
StartedStatusEval accuracyStepsConfig
Wed 18 Nov, 07:17 UTC| finished0.86221444 of 1446batch 8, seed 2 of 3
Wed 18 Nov, 05:51 UTC| finished0.84301444 of 1446batch 8, seed 1 of 3
Wed 18 Nov, 04:24 UTC| finished0.85931444 of 1446batch 8, seed 0 of 3

Plate

Model
convaiinnovations/laya, 421M parameters revision 7b928d8
Data
Familiar decisions, shared draw, synthetic7701 train675 eval
Config
batch size 8, grad accum 2, epochs 3, loss rlcd, seed 1
Hardware
Radeon 8060S, ROCm

Log

Since startMark
0.0 sphase starting
17.9 sphase training
1723.0 sepoch 1
3446.1 sepoch 2
5169.1 sepoch 3
5169.1 seval 1
7 h 1 min laterwent public

Seeds

SeedStatusEval accuracy
seed 0| finished0.8593
seed 1| finished0.8430
seed 2| finished0.8622

observed spread 0.0192, 3 finished seeds

Readings

288 rows as a table

rows 1 to 100 of 288

StepSecondsTrain lossEval lossEval accuracyECE
517.91.0950---
1035.90.6065---
1553.80.5101---
2071.81.1568---
2589.72.0945---
30107.71.3064---
35125.61.1456---
40143.61.9214---
45161.50.8887---
50179.50.6971---
55197.40.9445---
60215.40.6787---
65233.30.6283---
70251.30.8122---
75269.20.5823---
80287.21.1490---
85305.10.8515---
90323.11.4838---
95341.00.5480---
100359.00.8785---
105376.91.7887---
110394.91.5037---
115412.81.4428---
120430.81.2535---
125448.71.2654---
130466.70.8970---
135484.61.1524---
140502.61.4659---
145520.50.6497---
150538.41.0752---
155556.40.8088---
160574.30.1752---
165592.31.1285---
170610.20.7478---
175628.20.8759---
180646.10.1517---
185664.11.4857---
190682.00.5689---
195700.01.7171---
200717.90.8676---
205735.90.9059---
210753.80.8081---
215771.80.9646---
220789.70.9331---
225807.71.2875---
230825.61.4221---
235843.60.6395---
240861.51.9167---
245879.50.4422---
250897.41.5319---
255915.40.9016---
260933.31.3462---
265951.31.4199---
270969.20.9183---
275987.20.3615---
2801005.11.3339---
2851023.10.6101---
2901041.00.3572---
2951058.9-0.1658---
3001076.90.3997---
3051094.80.6604---
3101112.81.3414---
3151130.71.1643---
3201148.70.2887---
3251166.60.4650---
3301184.60.5183---
3351202.50.3742---
3401220.51.4591---
3451238.40.6486---
3501256.40.6920---
3551274.30.5936---
3601292.30.1176---
3651310.2-0.1872---
3701328.20.8329---
3751346.11.0155---
3801364.1-0.0551---
3851382.00.1675---
3901400.00.1971---
3951417.90.9099---
4001435.90.7311---
4051453.80.3791---
4101471.80.5040---
4151489.70.6724---
4201507.70.2601---
4251525.61.5675---
4301543.62.3159---
4351561.50.3814---
4401579.40.2680---
4451597.4-0.1191---
4501615.30.7087---
4551633.30.9402---
4601651.20.4704---
4651669.21.2173---
4701687.10.6874---
4751705.1-0.1413---
4801723.01.0568---
4871741.00.9123---
4921758.91.6367---
4971776.90.3101---
5021794.80.2299---

Worked out

ReadoutValueWorked out from
Run complete99.9%1444 steps over 1446
Step time3.58 s5133.3 s over 1434 steps, between readings. Startup and intervals that hold an eval are left out
Steps per minute16.860 s over the step time of 3.58 s
Epoch interval1723.1 sMean of 2 gaps between epoch marks
Train loss since first reading−1.1628-0.0678 at step 1444 minus 1.0950 at step 5
Lowest train loss-0.6289Lowest of 288 readings, at step 1294
Eval accuracy, as shown84.3%0.8430 times 100, to one decimal. Changes on that plate are percentage points
Train minus eval loss−0.4945-0.0678 minus 0.4267, both at step 1444
Wrong answers106675 eval items minus 569 correct. 569 over 675 is the only count that gives 0.8430
Rank3 of 3By last eval accuracy, across this project's 3 runs with an eval
Best so far0.8622Highest last eval accuracy, run 3
Against the run before−0.01630.8430 minus 0.8593 on run 1
Lowest last train loss-0.0678Lowest last train loss across this project's 3 runs, run 2
Seed spread, observed0.0192High 0.8622 minus low 0.8430 across 3 finished seeds
Items per second2.21 step over 3.58 s, times batch size 8
Train loss against run 1−0.2568-0.0678 minus 0.1890 on run 1, both at step 1444