CITADEL
StandbyNothing is live right now.
Eval accuracylast measured Mon 2 Nov, 14:16 UTC
0%25%50%75%100%0%25%50%75%100%0%25%50%75%100%

Claviger

finishedRadeon 8060S

A small model that reads one Discord message and decides whether an agent should reply, and which one. Fine-tuned from Laya on invented chat.

started
Mon 2 Nov, 14:09 UTC
ran for
06:27
config
batch 8, seed 2

run3/22step150/150epoch5/5config3/11seed2batch8modellaya 421Mrev7b928d8items479+130

Loss train -0.0764 ▼ −1.1825 eval 0.7440 lowest -0.6360 at step 90 run before, run 2 ▲ +0.0000 step 150
Timebase
Range
Smoothing
Reference
30 readings, 2 min/div2 min/div1 min/div
-1012300:0002:0004:0006:00phase starting, 0.0 s to 36.1 sphase training, 36.1 s to 06:26phase eval, 06:26 to 06:27epoch 2, 02:38epoch 3, 03:45epoch 4, 04:52epoch 5, 06:00trainingE2E3E4E51.1061Lowest last train loss across this project's 22 runs, run 19lowest last -0.0937, run 19-0.0764-1012300:0002:0004:0006:00phase starting, 0.0 s to 36.1 sphase training, 36.1 s to 06:26phase eval, 06:26 to 06:27epoch 1, 91.3 sepoch 2, 02:38epoch 3, 03:45epoch 4, 04:52epoch 5, 06:00trainingepoch 1epoch 2epoch 3epoch 4E51.1061Lowest last train loss across this project's 22 runs, run 19lowest last -0.0937, run 19eval 0.7440-0.0764▼ −1.1825-1012300:0001:0002:0003:0004:0005:0006:00phase starting, 0.0 s to 36.1 sphase training, 36.1 s to 06:26phase eval, 06:26 to 06:27epoch 1, 91.3 sepoch 2, 02:38epoch 3, 03:45epoch 4, 04:52epoch 5, 06:00startingtrainingepoch 1epoch 2epoch 3epoch 4epoch 51.1061Lowest last train loss across this project's 22 runs, run 19lowest last -0.0937, run 19eval 0.7440-0.0764▼ −1.1825

Eval measures

Eval losslower is better
0.7440
02 →
ECEcalibration error, lower is better
0.1481
01
Brierlower is better
0.3136
02 →

Elapsed

67.2 s

epoch interval

150 of 150 steps, 5 of 5 epochs, 100%

2.22 s per step, 27.0 steps a minute

Against the other runs

12 of 22

by last eval accuracy

best so far 0.9231, run 19

▲ +0.0000 against run 2

Train minus eval

−0.8204

step 150

train -0.0764, eval 0.7440

Set-up

479 train, 130 eval

synthetic, batch size 8, grad accum 2, epochs 5, seed 2

Samples per second

7.17

▼ −0.26 since first

Learning rate

1.32e-6

▼ −2.36e-5 since first

GPU memory, this run

6.5 GB

On one axis

phase starting, 0.0 s to 36.1 sphase training, 36.1 s to 06:26phase eval, 06:26 to 06:27E2E3E4E5traininglowest last -0.0937Train loss-0.0764▼ −1.18253.00-1.001.1061-0.0764last ▼ −1.1825Samples per second7.17▼ −0.26857.42Learning rate1.32e-6▼ −2.36e-53.0e-50.0e+02.50e-5Power, whole chip, CPU and GPU30 W▼ −62 W100 W25 W91 W30 Wlast ▼ −62 WHottest, one board zone84 °C▼ −2 °C90 °C75 °C86 °Clast 84 °C00:0001:0002:0003:0004:0005:0006:00
GPUpower: whole chip, CPU and GPUtemperature: one board zone

GPU 0

Wwhole chip, CPU and GPU

30 W whole chip, CPU and GPU

use0%
memory, whole GPU13.6 GB

this run's peak 8.0 GB

84 °C one board zone

history 0 to 91 W

Input

  • Runs128 runs
  • Agentsnone showing
  • Treesnone showing
  • Projectsnone showing

Check

Every entry is checked on its way out; some are held for review.

Not shown on any run: data samples, predictions, raw logs, file paths, machine names

Delay

2 min, set

Watching the agents work, about 2 min behind.

One way

Nothing here reaches the agents.

This page

This page updates by itself.

visits counted with Google Analytics · choose

Runsheight is eval accuracyall recordings ▸ | finished× failed■ stopped○ lost● live
0.950.750.950.75finished, eval accuracy 0.8077, config 1 of 11 (batch 8), seed 2, Mon 2 Nov, 13:19 UTCfinished, eval accuracy 0.8231, config 2 of 11 (batch 8), seed 2 of 3, Mon 2 Nov, 14:03 UTCfinished, eval accuracy 0.8231, config 3 of 11 (batch 8), seed 2, Mon 2 Nov, 14:09 UTCfinished, eval accuracy 0.7846, config 2 of 11 (batch 8), seed 0 of 3, Mon 2 Nov, 14:16 UTCfinished, eval accuracy 0.8385, config 2 of 11 (batch 8), seed 1 of 3, Mon 2 Nov, 14:22 UTCfinished, eval accuracy 0.7923, config 4 of 11 (batch 8), seed 0 of 3, Mon 2 Nov, 18:15 UTCfinished, eval accuracy 0.8000, config 4 of 11 (batch 8), seed 1 of 3, Mon 2 Nov, 18:22 UTCfinished, eval accuracy 0.8154, config 4 of 11 (batch 8), seed 2 of 3, Mon 2 Nov, 18:28 UTCfinished, eval accuracy 0.7923, config 5 of 11 (batch 8), seed 0 of 3, Mon 2 Nov, 18:46 UTCfinished, eval accuracy 0.8385, config 5 of 11 (batch 8), seed 1 of 3, Mon 2 Nov, 18:52 UTCfinished, eval accuracy 0.8000, config 5 of 11 (batch 8), seed 2 of 3, Mon 2 Nov, 18:59 UTCfinished, eval accuracy 0.8231, config 6 of 11 (batch 8), seed 0 of 3, Tue 3 Nov, 00:59 UTCfinished, eval accuracy 0.8231, config 6 of 11 (batch 8), seed 1 of 3, Tue 3 Nov, 01:13 UTCfinished, eval accuracy 0.8000, config 6 of 11 (batch 8), seed 2 of 3, Tue 3 Nov, 01:26 UTCfinished at step 336 of 339, eval accuracy 0.8769, config 7 of 11 (batch 8), seed 0 of 3, Thu 19 Nov, 21:49 UTCfinished at step 336 of 339, eval accuracy 0.8846, config 7 of 11 (batch 8), seed 1 of 3, Thu 19 Nov, 22:06 UTCfinished at step 336 of 339, eval accuracy 0.8846, config 7 of 11 (batch 8), seed 2 of 3, Thu 19 Nov, 22:21 UTCfinished at step 336 of 339, eval accuracy 0.8615, config 8 of 11 (learning rate 0.0001, batch 8), seed 0, Sat 21 Nov, 23:04 UTCfinished at step 336 of 339, eval accuracy 0.9231, config 9 of 11 (learning rate 0.00002, batch 8), seed 0, Sat 21 Nov, 23:17 UTCfinished at step 336 of 339, eval accuracy 0.8538, config 10 of 11 (learning rate 0.00005, batch 8), seed 0, Sat 21 Nov, 23:29 UTCfinished at step 336 of 339, eval accuracy 0.9231, config 11 of 11 (learning rate 0.00002, batch 8), seed 1 of 2, Sun 22 Nov, 03:49 UTCfinished at step 336 of 339, eval accuracy 0.8846, config 11 of 11 (learning rate 0.00002, batch 8), seed 2 of 2, Sun 22 Nov, 04:01 UTC0.950.75finished, eval accuracy 0.8077, config 1 of 11 (batch 8), seed 2, Mon 2 Nov, 13:19 UTCfinished, eval accuracy 0.8231, config 2 of 11 (batch 8), seed 2 of 3, Mon 2 Nov, 14:03 UTCfinished, eval accuracy 0.8231, config 3 of 11 (batch 8), seed 2, Mon 2 Nov, 14:09 UTCfinished, eval accuracy 0.7846, config 2 of 11 (batch 8), seed 0 of 3, Mon 2 Nov, 14:16 UTCfinished, eval accuracy 0.8385, config 2 of 11 (batch 8), seed 1 of 3, Mon 2 Nov, 14:22 UTCfinished, eval accuracy 0.7923, config 4 of 11 (batch 8), seed 0 of 3, Mon 2 Nov, 18:15 UTCfinished, eval accuracy 0.8000, config 4 of 11 (batch 8), seed 1 of 3, Mon 2 Nov, 18:22 UTCfinished, eval accuracy 0.8154, config 4 of 11 (batch 8), seed 2 of 3, Mon 2 Nov, 18:28 UTCfinished, eval accuracy 0.7923, config 5 of 11 (batch 8), seed 0 of 3, Mon 2 Nov, 18:46 UTCfinished, eval accuracy 0.8385, config 5 of 11 (batch 8), seed 1 of 3, Mon 2 Nov, 18:52 UTCfinished, eval accuracy 0.8000, config 5 of 11 (batch 8), seed 2 of 3, Mon 2 Nov, 18:59 UTCfinished, eval accuracy 0.8231, config 6 of 11 (batch 8), seed 0 of 3, Tue 3 Nov, 00:59 UTCfinished, eval accuracy 0.8231, config 6 of 11 (batch 8), seed 1 of 3, Tue 3 Nov, 01:13 UTCfinished, eval accuracy 0.8000, config 6 of 11 (batch 8), seed 2 of 3, Tue 3 Nov, 01:26 UTCfinished at step 336 of 339, eval accuracy 0.8769, config 7 of 11 (batch 8), seed 0 of 3, Thu 19 Nov, 21:49 UTCfinished at step 336 of 339, eval accuracy 0.8846, config 7 of 11 (batch 8), seed 1 of 3, Thu 19 Nov, 22:06 UTCfinished at step 336 of 339, eval accuracy 0.8846, config 7 of 11 (batch 8), seed 2 of 3, Thu 19 Nov, 22:21 UTCfinished at step 336 of 339, eval accuracy 0.8615, config 8 of 11 (learning rate 0.0001, batch 8), seed 0, Sat 21 Nov, 23:04 UTCfinished at step 336 of 339, eval accuracy 0.9231, config 9 of 11 (learning rate 0.00002, batch 8), seed 0, Sat 21 Nov, 23:17 UTCfinished at step 336 of 339, eval accuracy 0.8538, config 10 of 11 (learning rate 0.00005, batch 8), seed 0, Sat 21 Nov, 23:29 UTCfinished at step 336 of 339, eval accuracy 0.9231, config 11 of 11 (learning rate 0.00002, batch 8), seed 1 of 2, Sun 22 Nov, 03:49 UTCfinished at step 336 of 339, eval accuracy 0.8846, config 11 of 11 (learning rate 0.00002, batch 8), seed 2 of 2, Sun 22 Nov, 04:01 UTC

3 of 22 finished, 0.8231, config 3 of 11 (batch 8), seed 2, Mon 2 Nov, 14:09 UTC

Runs as a table
StartedStatusEval accuracyStepsConfig
Sun 22 Nov, 04:01 UTC| finished0.8846336 of 339learning rate 0.00002, batch 8, seed 2 of 2
Sun 22 Nov, 03:49 UTC| finished0.9231336 of 339learning rate 0.00002, batch 8, seed 1 of 2
Sat 21 Nov, 23:29 UTC| finished0.8538336 of 339learning rate 0.00005, batch 8, seed 0
Sat 21 Nov, 23:17 UTC| finished0.9231336 of 339learning rate 0.00002, batch 8, seed 0
Sat 21 Nov, 23:04 UTC| finished0.8615336 of 339learning rate 0.0001, batch 8, seed 0
Thu 19 Nov, 22:21 UTC| finished0.8846336 of 339batch 8, seed 2 of 3
Thu 19 Nov, 22:06 UTC| finished0.8846336 of 339batch 8, seed 1 of 3
Thu 19 Nov, 21:49 UTC| finished0.8769336 of 339batch 8, seed 0 of 3
Tue 3 Nov, 01:26 UTC| finished0.8000150 of 150batch 8, seed 2 of 3
Tue 3 Nov, 01:13 UTC| finished0.8231150 of 150batch 8, seed 1 of 3
Tue 3 Nov, 00:59 UTC| finished0.8231150 of 150batch 8, seed 0 of 3
Mon 2 Nov, 18:59 UTC| finished0.8000150 of 150batch 8, seed 2 of 3
Mon 2 Nov, 18:52 UTC| finished0.8385150 of 150batch 8, seed 1 of 3
Mon 2 Nov, 18:46 UTC| finished0.7923150 of 150batch 8, seed 0 of 3
Mon 2 Nov, 18:28 UTC| finished0.8154150 of 150batch 8, seed 2 of 3
Mon 2 Nov, 18:22 UTC| finished0.8000150 of 150batch 8, seed 1 of 3
Mon 2 Nov, 18:15 UTC| finished0.7923150 of 150batch 8, seed 0 of 3
Mon 2 Nov, 14:22 UTC| finished0.8385150 of 150batch 8, seed 1 of 3
Mon 2 Nov, 14:16 UTC| finished0.7846150 of 150batch 8, seed 0 of 3
Mon 2 Nov, 14:09 UTC| finished0.8231150 of 150batch 8, seed 2
Mon 2 Nov, 14:03 UTC| finished0.8231150 of 150batch 8, seed 2 of 3
Mon 2 Nov, 13:19 UTC| finished0.8077150 of 150batch 8, seed 2

Plate

Model
convaiinnovations/laya, 421M parameters revision 7b928d8
Data
Synthetic Discord triage set, synthetic479 train130 eval
Config
batch size 8, grad accum 2, epochs 5, seed 2
Hardware
Radeon 8060S, ROCm

Log

Since startMark
0.0 sphase starting
14.7 swent public
36.1 sphase training
91.3 sepoch 1
158.4 sepoch 2
225.7 sepoch 3
292.8 sepoch 4
360.2 sepoch 5
386.5 sphase eval
386.5 seval 1

Readings

30 rows as a table
StepSecondsTrain lossEval lossEval accuracyECEBrierSamples per secondLearning rateGPU GB, this run
542.61.1061----7.4252.50e-56.5
1053.80.5110----7.1352.48e-56.5
1564.80.1276----7.2452.45e-56.5
2076.20.4365----7.0362.41e-56.5
2589.1-0.1701----6.1672.35e-56.5
30101.31.6970----6.6092.29e-56.5
35111.90.2386----7.5002.21e-56.5
40124.70.1249----6.2582.12e-56.5
45135.80.5640----7.1822.03e-56.5
50147.20.3429----7.0701.92e-56.5
55158.30.1676----7.2051.81e-56.5
60170.70.2008----6.4141.69e-56.5
65181.7-0.2886----7.2681.57e-56.5
70192.6-0.0042----7.3631.45e-56.5
75203.60.8360----7.2501.33e-56.5
80214.60.0185----7.3291.20e-56.5
85225.50.1710----7.2871.08e-56.5
90225.7-0.6360-------
95240.40.5877----5.3869.53e-66.5
100251.3-0.1906----7.3438.35e-66.5
105262.20.1543----7.3237.22e-66.5
110273.20.0000----7.2606.15e-66.5
115284.30.0000----7.2055.16e-66.5
120296.12.2695----6.8224.25e-66.5
125307.30.0580----7.1153.44e-66.5
130320.3-0.0884----6.1352.74e-66.5
135331.50.2472----7.1442.14e-66.5
140342.6-0.0537----7.2201.67e-66.5
145353.80.0000----7.1691.32e-66.5
150387.8-0.07640.74400.82310.14810.3136---

GPU readings

30 rows as a table
StepGPUUse %Power W, whole chip, CPU and GPUMemory GB, whole GPUTemp C, one board zone
503891.113.085.8
1503481.813.377.8
3001883.713.683.8
4503081.913.678.8
6003184.013.683.8
7502884.613.679.8
9003176.013.681.8
10003083.313.679.8
1150383.313.679.8
13003183.413.680.8
14507383.713.680.8
1500029.513.683.8

Worked out

ReadoutValueWorked out from
Run complete100%150 steps over 150
Step time2.22 s311.2 s over 140 steps, between readings. Startup and intervals that hold an eval are left out
Steps per minute27.060 s over the step time of 2.22 s
Epoch interval67.2 sMean of 4 gaps between epoch marks
Train loss since first reading−1.1825-0.0764 at step 150 minus 1.1061 at step 5
Lowest train loss-0.6360Lowest of 30 readings, at step 90
Eval accuracy, as shown82.3%0.8231 times 100, to one decimal. Changes on that plate are percentage points
Train minus eval loss−0.8204-0.0764 minus 0.7440, both at step 150
Wrong answers23130 eval items minus 107 correct. 107 over 130 is the only count that gives 0.8231
Rank12 of 22By last eval accuracy, across this project's 22 runs with an eval
Best so far0.9231Highest last eval accuracy, run 19
Against the run before+0.00000.8231 minus 0.8231 on run 2
Lowest last train loss-0.0937Lowest last train loss across this project's 22 runs, run 19
Train loss against run 2+0.0000-0.0764 minus -0.0764 on run 2, both at step 150
Samples per second since first reading−0.267.17 minus 7.42
Learning rate since first reading−2.36e-51.32e-6 minus 2.50e-5
This run's peak memory per GPU8.0 GBAs the run reports it: its own memory, not the whole GPU's