CITADEL
StandbyNothing is live right now.
Eval accuracylast measured Thu 19 Nov, 23:24 UTC
%
0.9000117 of 130 eval, 13 wrong
▲ +39.23 pts across 2 evals▲ +39.23 pts on the eval before
0%25%50%75%100%0%25%50%75%100%0%25%50%75%100%

Claviger: OneJev 0.8B

finishedRadeon 8060S

A small model that reads one Discord message and decides whether an agent should reply, and which one. OneJev 0.8B fine-tuned on invented chat, beside the Laya model.

started
Thu 19 Nov, 22:36 UTC
ran for
46:34
config
learning rate 0.000005, batch 8, seed 0 of 3

run1/7step339/339epoch3/3config1/4seed0/3lr0.000005batch8modelOneJev1.6-0.8B 0.8Brevc89933citems1800+130

Loss train 0.0000 ▼ −0.9689 eval 0.5833 lowest 0.0000 at step 300
Timebase
Range
Smoothing
68 readings, 30 min/div10 min/div5 min/div
00.511.500:0030:00phase starting, 0.0 s to 02:31phase training, 02:31 to 46:34epoch 1, 02:31epoch 2, 18:49epoch 3, 32:36trainingepoch 2epoch 3−0.9689since first0.9689Lowest last train loss across this project's 6 runs, run 2lowest last 0.0000, run 20.000000.511.500:0010:0020:0030:0040:00phase starting, 0.0 s to 02:31phase training, 02:31 to 46:34epoch 1, 02:31epoch 2, 18:49epoch 3, 32:36trainingepoch 2epoch 30.9689Lowest last train loss across this project's 6 runs, run 2lowest last 0.0000, run 2eval 0.58330.0000▼ −0.968900.511.500:0005:0010:0015:0020:0025:0030:0035:0040:0045:00phase starting, 0.0 s to 02:31phase training, 02:31 to 46:34epoch 1, 02:31epoch 2, 18:49epoch 3, 32:36trainingepoch 2epoch 30.9689Lowest last train loss across this project's 6 runs, run 2lowest last 0.0000, run 2eval 0.58330.0000▼ −0.9689

Eval measures

Eval losslower is better
0.5833▼ −0.4793 since first
02 →
ECEcalibration error, lower is better
0.0928▼ −0.1108 since first
01

Elapsed

902.4 s

epoch interval

339 of 339 steps, 3 of 3 epochs, 100%

7.91 s per step, 7.6 steps a minute

Eval accuracy by eval

+0.3923

▲ on the eval before

eval 1 0.5077, eval 2 0.9000

Against the other runs

3 of 7

by last eval accuracy

best so far 0.9385, run 7

Train minus eval

−0.5833

step 339

train 0.0000, eval 0.5833

Set-up

1800 train, 130 eval

synthetic, learning rate 0.000005, batch size 8, grad accum 2, epochs 3, optimizer adamw, scheduler cosine, seed 0

Seed spread, observed

0.0385
0.900.95

3 finished seeds

Learning rate

0.00e+0

▼ −2.50e-6 since first

On one axis

phase starting, 0.0 s to 02:31phase training, 02:31 to 46:34E1E2E3traininglowest last 0.0000Train loss0.0000▼ −0.96891.500.000.96890.0000last ▼ −0.9689best 0.9385, run 7Last-value range, 7 runs, 0.3000 to 0.9385Eval accuracy0.9000▲ +0.39231.000.250.50770.9000last ▲ +0.3923Learning rate0.00e+0▼ −2.50e-66.0e-60.0e+02.50e-6last 0.00e+0Power, whole chip, CPU and GPU53 W▼ −1 W55 W52 W53 Wlast 53 WHottest, one board zone69 °C▲ +1 °C72 °C66 °C68 °Clast 69 °C00:0005:0010:0015:0020:0025:0030:0035:0040:0045:00
GPUpower: whole chip, CPU and GPUtemperature: one board zone

GPU 0

Wwhole chip, CPU and GPU

53 W whole chip, CPU and GPU

use49%
memory, whole GPU38.5 GB

peak 42.2 GB, whole GPU

69 °C one board zone

history 0 to 55 W

Input

  • Runs128 runs
  • Agentsnone showing
  • Treesnone showing
  • Projectsnone showing

Check

Every entry is checked on its way out; some are held for review.

Not shown on any run: data samples, predictions, raw logs, file paths, machine names

Delay

2 min, set

Watching the agents work, about 2 min behind.

One way

Nothing here reaches the agents.

This page

This page updates by itself.

visits counted with Google Analytics · choose

Runsheight is eval accuracyall recordings ▸ | finished× failed■ stopped○ lost● live ◂ older
0.950.300.950.30finished, eval accuracy 0.9000, config 1 of 4 (learning rate 0.000005, batch 8), seed 0 of 3, Thu 19 Nov, 22:36 UTCfinished, eval accuracy 0.9154, config 1 of 4 (learning rate 0.000005, batch 8), seed 1 of 3, Thu 19 Nov, 23:24 UTCfailed, eval accuracy 0.5077, config 1 of 4 (learning rate 0.000005, batch 8), seed 2 of 3, Fri 20 Nov, 00:08 UTCfinished, eval accuracy 0.3000, config 2 of 4 (learning rate 0.0001, batch 8), seed 0, Sat 21 Nov, 23:42 UTCfinished, eval accuracy 0.8769, config 3 of 4 (learning rate 0.00002, batch 8), seed 0, Sun 22 Nov, 00:18 UTCfinished, eval accuracy 0.5615, config 4 of 4 (learning rate 0.00005, batch 8), seed 0, Sun 22 Nov, 00:55 UTCfinished, eval accuracy 0.9385, config 1 of 4 (learning rate 0.000005, batch 8), seed 2 of 3, Sun 22 Nov, 01:31 UTC0.950.30finished, eval accuracy 0.9000, config 1 of 4 (learning rate 0.000005, batch 8), seed 0 of 3, Thu 19 Nov, 22:36 UTCfinished, eval accuracy 0.9154, config 1 of 4 (learning rate 0.000005, batch 8), seed 1 of 3, Thu 19 Nov, 23:24 UTCfailed, eval accuracy 0.5077, config 1 of 4 (learning rate 0.000005, batch 8), seed 2 of 3, Fri 20 Nov, 00:08 UTCfinished, eval accuracy 0.3000, config 2 of 4 (learning rate 0.0001, batch 8), seed 0, Sat 21 Nov, 23:42 UTCfinished, eval accuracy 0.8769, config 3 of 4 (learning rate 0.00002, batch 8), seed 0, Sun 22 Nov, 00:18 UTCfinished, eval accuracy 0.5615, config 4 of 4 (learning rate 0.00005, batch 8), seed 0, Sun 22 Nov, 00:55 UTCfinished, eval accuracy 0.9385, config 1 of 4 (learning rate 0.000005, batch 8), seed 2 of 3, Sun 22 Nov, 01:31 UTC

1 of 7 finished, 0.9000, config 1 of 4 (learning rate 0.000005, batch 8), seed 0 of 3, Thu 19 Nov, 22:36 UTC

◂
Runs as a table
StartedStatusEval accuracyStepsConfig
Sun 22 Nov, 01:31 UTC| finished0.9385339 of 339learning rate 0.000005, batch 8, seed 2 of 3
Sun 22 Nov, 00:55 UTC| finished0.5615339 of 339learning rate 0.00005, batch 8, seed 0
Sun 22 Nov, 00:18 UTC| finished0.8769339 of 339learning rate 0.00002, batch 8, seed 0
Sat 21 Nov, 23:42 UTC| finished0.3000339 of 339learning rate 0.0001, batch 8, seed 0
Fri 20 Nov, 00:08 UTC× failed0.50770learning rate 0.000005, batch 8, seed 2 of 3
Thu 19 Nov, 23:24 UTC| finished0.9154339 of 339learning rate 0.000005, batch 8, seed 1 of 3
Thu 19 Nov, 22:36 UTC| finished0.9000339 of 339learning rate 0.000005, batch 8, seed 0 of 3

Plate

Model
OmniJev/OneJev1.6-0.8B, 0.8B parameters revision c89933c
Data
Synthetic Discord triage set, 2,000-row draw, synthetic1800 train130 eval
Config
learning rate 0.000005, batch size 8, grad accum 2, epochs 3, optimizer adamw, scheduler cosine, seed 0
Hardware
Radeon 8060S, ROCm

Log

Since startMark
0.0 sphase starting
2.6 swent public
61.0 seval 1
151.8 sphase training
151.8 sepoch 1
1129.9 sepoch 2
1956.6 sepoch 3
2794.5 seval 2

Seeds

SeedStatusEval accuracy
seed 0| finished0.9000
seed 1| finished0.9154
seed 2× failed0.5077
seed 2| finished0.9385

observed spread 0.0385, 3 finished seeds

Readings

69 rows as a table
StepSecondsTrain lossEval lossEval accuracyECELearning rate
061.0-1.06260.50770.2036-
5151.80.9689---2.50e-6
10212.10.9832---5.00e-6
15272.80.6249---5.00e-6
20325.11.4373---4.99e-6
25382.80.3863---4.97e-6
30435.20.2929---4.95e-6
35492.80.4802---4.93e-6
40531.60.4481---4.90e-6
45574.10.7195---4.86e-6
50623.90.1897---4.82e-6
55669.30.5076---4.77e-6
60711.60.6777---4.72e-6
65760.80.0857---4.66e-6
70795.90.3481---4.60e-6
75831.00.3244---4.53e-6
80865.50.2992---4.46e-6
85914.70.1902---4.39e-6
90955.70.0238---4.31e-6
95990.80.3469---4.22e-6
1001024.90.7629---4.13e-6
1051063.20.2424---4.04e-6
1101100.90.3814---3.94e-6
1151129.90.2791---3.85e-6
1201172.00.0081---3.74e-6
1251202.70.3894---3.64e-6
1301238.00.0342---3.53e-6
1351272.10.1210---3.42e-6
1401321.90.0066---3.31e-6
1451353.90.0373---3.19e-6
1501385.80.4198---3.08e-6
1551425.20.0119---2.96e-6
1601466.00.0527---2.85e-6
1651497.10.0002---2.73e-6
1701537.80.5512---2.61e-6
1751573.50.0238---2.49e-6
1801603.60.5777---2.37e-6
1851635.80.0601---2.25e-6
1901667.90.0004---2.13e-6
1951700.70.0490---2.01e-6
2001743.20.0008---1.90e-6
2051779.10.0005---1.78e-6
2101818.30.0004---1.67e-6
2151856.40.0011---1.56e-6
2201887.90.5626---1.45e-6
2251919.70.0005---1.34e-6
2301956.60.0004---1.24e-6
2351995.60.0002---1.13e-6
2402037.00.2836---1.04e-6
2452067.70.3766---9.41e-7
2502103.71.0095---8.50e-7
2552136.40.0001---7.62e-7
2602170.90.0001---6.78e-7
2652212.10.0001---5.99e-7
2702243.80.0001---5.23e-7
2752278.20.0000---4.53e-7
2802326.00.0001---3.86e-7
2852358.00.2734---3.25e-7
2902389.10.0000---2.69e-7
2952423.50.0003---2.17e-7
3002464.30.0000---1.71e-7
3052508.90.0001---1.31e-7
3102540.50.1042---9.52e-8
3152577.10.0000---6.54e-8
3202607.40.0000---4.10e-8
3252646.10.2431---2.23e-8
3302678.60.0000---9.23e-9
3352710.50.0000---1.82e-9
3392794.50.00000.58330.90000.09280.00e+0

GPU readings

69 rows as a table
StepGPUUse %Power W, whole chip, CPU and GPUMemory GB, whole GPUTemp C, one board zone
002453.229.467.8
501353.132.767.8
100853.033.166.8
150052.830.366.8
2002954.818.467.8
2502054.116.267.8
300053.030.467.8
3502053.033.266.8
4002452.617.167.8
450253.135.467.8
500052.927.866.8
5504053.531.067.8
6002153.133.466.8
6502653.020.266.8
700053.027.966.8
750253.434.966.8
800053.032.667.8
850152.934.466.8
900553.333.666.8
950953.233.866.8
1000052.732.166.8
10502553.228.566.8
11001453.033.566.8
11502053.023.266.8
1200053.235.366.8
12502553.219.366.8
1300053.134.966.8
1350153.133.868.8
1400053.542.266.8
1450253.242.266.8
1500053.042.266.8
1550053.142.266.8
16002653.142.266.8
1650052.942.266.8
17001252.942.266.8
1750152.934.666.8
1800153.134.666.8
1850053.034.666.8
1900052.936.866.8
1950252.636.866.8
20001053.237.966.8
2050553.337.966.8
2100053.037.966.8
2150153.134.166.8
2200453.038.366.8
2250053.038.366.8
2300053.038.366.8
2350052.838.366.8
2400653.438.366.8
2450553.138.366.8
2500253.333.867.8
2550053.030.967.8
2600952.338.067.8
2650053.238.066.8
27002953.131.067.8
2750053.034.767.8
2800053.134.766.8
2850753.034.766.8
2900053.134.766.8
2950053.434.566.8
3000053.535.566.8
30502852.735.566.8
31002152.827.367.8
3150252.735.066.8
3200253.035.070.8
32501353.036.066.8
3300053.338.566.8
3350053.138.566.8
33904952.638.568.8

Worked out

ReadoutValueWorked out from
Run complete100%339 steps over 339
Step time7.91 s2649.5 s over 335 steps, between readings. Startup and intervals that hold an eval are left out
Steps per minute7.660 s over the step time of 7.91 s
Epoch interval902.4 sMean of 2 gaps between epoch marks
Train loss since first reading−0.96890.0000 at step 339 minus 0.9689 at step 5
Lowest train loss0.0000Lowest of 68 readings, at step 300
Eval accuracy, as shown90.0%0.9000 times 100, to one decimal. Changes on that plate are percentage points
Eval accuracy since first eval+0.39230.9000 minus 0.5077
Eval loss since first eval−0.47930.5833 minus 1.0626
ECE since first eval−0.11080.0928 minus 0.2036
Eval change+0.3923Eval 2 at 0.9000 minus eval 1 at 0.5077
Train minus eval loss−0.58330.0000 minus 0.5833, both at step 339
Wrong answers13130 eval items minus 117 correct. 117 over 130 is the only count that gives 0.9000
Rank3 of 7By last eval accuracy, across this project's 7 runs with an eval
Best so far0.9385Highest last eval accuracy, run 7
Lowest last train loss0.0000Lowest last train loss across this project's 6 runs, run 2
Seed spread, observed0.0385High 0.9385 minus low 0.9000 across 3 finished seeds
Items per second1.01 step over 7.91 s, times batch size 8
Learning rate since first reading−2.50e-60.00e+0 minus 2.50e-6
Peak memory per GPU, whole GPU42.2 GBHighest sensor reading of any GPU, GPU 0, counting every process on it