CITADEL
StandbyNothing is live right now.
Eval accuracylast measured Thu 19 Nov, 20:45 UTC
%
0.9100455 of 500 eval, 45 wrong
▲ +35.40 pts across 2 evals▲ +35.40 pts on the eval before
0%25%50%75%100%0%25%50%75%100%0%25%50%75%100%

Familiar decider: OneJev 0.8B

finishedRadeon 8060S

One of the small models that decide whether Familiar, a desktop companion, reacts to something happening on the PC, and how. Every candidate trains on the same 6,000 decision points from synthetic timelines.

started
Thu 19 Nov, 16:26 UTC
ran for
259:14
config
learning rate 0.000005, batch 8, seed 2 of 3

run3/3step1446/1446epoch3/3seed2/3lr0.000005batch8modelOneJev1.6-0.8B 0.8Brevc89933citems6000+500

Loss train 0.0043 ▼ −1.1365 eval 0.3689 lowest 0.0009 at step 1435 run before, run 2 ▼ −0.0925 step 1446
Timebase
Range
Smoothing
Reference
290 readings, 120 min/div60 min/div30 min/div
00.511.522.500:00120:00240:00phase starting, 0.0 s to 06:46phase training, 06:46 to 259:14epoch 1, 06:46epoch 2, 93:02epoch 3, 173:47trainingepoch 2epoch 3−1.1365since first1.1408Lowest last train loss across this project's 3 runs, run 1lowest last 0.0002, run 10.004300.511.522.500:0060:00120:00180:00240:00phase starting, 0.0 s to 06:46phase training, 06:46 to 259:14epoch 1, 06:46epoch 2, 93:02epoch 3, 173:47trainingepoch 2epoch 31.1408Lowest last train loss across this project's 3 runs, run 1lowest last 0.0002, run 1eval 0.36890.0043▼ −1.136500.511.522.500:0030:0060:0090:00120:00150:00180:00210:00240:00phase starting, 0.0 s to 06:46phase training, 06:46 to 259:14epoch 1, 06:46epoch 2, 93:02epoch 3, 173:47trainingepoch 2epoch 31.1408Lowest last train loss across this project's 3 runs, run 1lowest last 0.0002, run 1eval 0.36890.0043▼ −1.1365

Eval measures

Eval losslower is better
0.3689▼ −1.0015 since first
02 →
ECEcalibration error, lower is better
0.0656▼ −0.0468 since first
01

Elapsed

5010.6 s

epoch interval

1446 of 1446 steps, 3 of 3 epochs, 100%

10.4 s per step, 5.8 steps a minute

Eval accuracy by eval

+0.3540

▲ on the eval before

eval 1 0.5560, eval 2 0.9100

Against the other runs

2 of 3

by last eval accuracy

best so far 0.9120, run 2

▼ −0.0020 against run 2

Train minus eval

−0.3646

step 1446

train 0.0043, eval 0.3689

Set-up

6000 train, 500 eval

synthetic, learning rate 0.000005, batch size 8, grad accum 2, epochs 3, optimizer adamw, scheduler cosine, seed 2

Seed spread, observed

0.0120
0.900.95

3 finished seeds

Learning rate

0.00e+0

▼ −5.81e-7 since first

On one axis

phase starting, 0.0 s to 06:46phase training, 06:46 to 259:14E2E3traininglowest last 0.0002Train loss0.0043▼ −1.13652.000.001.14080.0043last ▼ −1.1365best 0.9120, run 2Last-value range, 3 runs, 0.9000 to 0.9120Eval accuracy0.9100▲ +0.35401.000.400.55600.9100last ▲ +0.3540Learning rate0.00e+0▼ −5.81e-76.0e-60.0e+05.81e-7last 0.00e+0Power, whole chip, CPU and GPU53 W▼ −1 W55 W52 W54 Wlast 53 WHottest, one board zone69 °C▲ +2 °C69 °C65 °C67 °Clast 69 °C00:0030:0060:0090:00120:00150:00180:00210:00240:00
GPUpower: whole chip, CPU and GPUtemperature: one board zone

GPU 0

Wwhole chip, CPU and GPU

53 W whole chip, CPU and GPU

use0%
memory, whole GPU27.5 GB

peak 47.8 GB, whole GPU

69 °C one board zone

history 0 to 55 W

Input

  • Runs128 runs
  • Agentsnone showing
  • Treesnone showing
  • Projectsnone showing

Check

Every entry is checked on its way out; some are held for review.

Not shown on any run: data samples, predictions, raw logs, file paths, machine names

Delay

2 min, set

Watching the agents work, about 2 min behind.

One way

Nothing here reaches the agents.

This page

This page updates by itself.

visits counted with Google Analytics · choose

Runsheight is eval accuracyall recordings ▸ | finished× failed■ stopped○ lost● live newer ▸

3 of 3 finished, 0.9100, config 1 of 1 (learning rate 0.000005, batch 8), seed 2 of 3, Thu 19 Nov, 16:26 UTC

▸
Runs as a table
StartedStatusEval accuracyStepsConfig
Thu 19 Nov, 16:26 UTC| finished0.91001446 of 1446learning rate 0.000005, batch 8, seed 2 of 3
Thu 19 Nov, 12:06 UTC| finished0.91201446 of 1446learning rate 0.000005, batch 8, seed 1 of 3
Thu 19 Nov, 07:46 UTC| finished0.90001446 of 1446learning rate 0.000005, batch 8, seed 0 of 3

Plate

Model
OmniJev/OneJev1.6-0.8B, 0.8B parameters revision c89933c
Data
Familiar decisions, shared draw, synthetic6000 train500 eval
Config
learning rate 0.000005, batch size 8, grad accum 2, epochs 3, optimizer adamw, scheduler cosine, seed 2
Hardware
Radeon 8060S, ROCm

Log

Since startMark
0.0 sphase starting
7.1 swent public
309.4 seval 1
406.0 sphase training
406.0 sepoch 1
5582.9 sepoch 2
10427.2 sepoch 3
15554.2 seval 2

Seeds

SeedStatusEval accuracy
seed 0| finished0.9000
seed 1| finished0.9120
seed 2| finished0.9100

observed spread 0.0120, 3 finished seeds

Readings

291 rows as a table

rows 1 to 100 of 291

StepSecondsTrain lossEval lossEval accuracyECELearning rate
0309.4-1.37040.55600.1124-
5406.01.1408---5.81e-7
10487.71.3051---1.16e-6
15572.10.5855---1.74e-6
20643.90.6025---2.33e-6
25716.90.9714---2.91e-6
30789.30.6342---3.49e-6
35869.60.8709---4.07e-6
40924.10.7302---4.65e-6
45984.00.6677---5.00e-6
501051.71.1703---5.00e-6
551103.50.5516---5.00e-6
601164.10.7573---5.00e-6
651224.51.1866---5.00e-6
701284.00.2573---5.00e-6
751344.10.8402---4.99e-6
801398.80.3783---4.99e-6
851452.81.2375---4.99e-6
901515.80.4333---4.99e-6
951574.50.6880---4.98e-6
1001624.40.7236---4.98e-6
1051680.80.4960---4.98e-6
1101729.51.0410---4.97e-6
1151787.90.6044---4.97e-6
1201842.00.2162---4.96e-6
1251896.70.5027---4.96e-6
1301951.60.2426---4.95e-6
1352010.40.6481---4.95e-6
1402062.00.3879---4.94e-6
1452119.60.4063---4.94e-6
1502169.50.2290---4.93e-6
1552223.41.3462---4.92e-6
1602279.50.2679---4.91e-6
1652329.60.2399---4.91e-6
1702380.30.3970---4.90e-6
1752431.80.3054---4.89e-6
1802485.30.1193---4.88e-6
1852534.20.7976---4.87e-6
1902583.70.6595---4.87e-6
1952633.70.2596---4.86e-6
2002684.30.2273---4.85e-6
2052734.40.4138---4.84e-6
2102785.00.1330---4.83e-6
2152835.10.2200---4.82e-6
2202885.90.6695---4.81e-6
2252936.30.1611---4.80e-6
2302987.50.3195---4.78e-6
2353038.10.2924---4.77e-6
2403088.70.2563---4.76e-6
2453139.20.4990---4.75e-6
2503193.60.3837---4.74e-6
2553245.00.1986---4.72e-6
2603294.70.3469---4.71e-6
2653344.80.9127---4.70e-6
2703400.60.4901---4.68e-6
2753450.70.4750---4.67e-6
2803509.60.4620---4.66e-6
2853560.50.3003---4.64e-6
2903610.80.3211---4.63e-6
2953661.00.4837---4.61e-6
3003711.00.8230---4.60e-6
3053761.60.1747---4.58e-6
3103810.20.5175---4.57e-6
3153859.90.6640---4.55e-6
3203912.80.7094---4.53e-6
3253964.20.4432---4.52e-6
3304014.90.3014---4.50e-6
3354066.10.2545---4.48e-6
3404116.40.2062---4.47e-6
3454166.40.2985---4.45e-6
3504215.50.8634---4.43e-6
3554265.20.5007---4.41e-6
3604315.70.3776---4.40e-6
3654365.90.2979---4.38e-6
3704416.40.3763---4.36e-6
3754466.00.7393---4.34e-6
3804517.20.2765---4.32e-6
3854567.70.1341---4.30e-6
3904618.20.9510---4.28e-6
3954675.80.1718---4.26e-6
4004726.90.7184---4.24e-6
4054777.20.2708---4.22e-6
4104828.10.2467---4.20e-6
4154879.20.6050---4.18e-6
4204929.50.1051---4.16e-6
4254980.40.5291---4.14e-6
4305031.90.3550---4.12e-6
4355081.50.0895---4.10e-6
4405131.50.4068---4.08e-6
4455180.90.0458---4.05e-6
4505234.80.2436---4.03e-6
4555285.60.5209---4.01e-6
4605336.20.6293---3.99e-6
4655387.10.2775---3.96e-6
4705436.70.0766---3.94e-6
4755486.50.1549---3.92e-6
4805537.20.2810---3.90e-6
4855582.90.4412---3.87e-6
4905636.20.2549---3.85e-6
4955687.40.1303---3.83e-6

GPU readings

291 rows as a table

rows 1 to 100 of 291

StepGPUUse %Power W, whole chip, CPU and GPUMemory GB, whole GPUTemp C, one board zone
003053.841.466.8
50053.340.666.8
100053.038.766.8
150053.040.766.8
200053.041.965.8
250053.040.466.8
300052.940.167.8
350853.245.766.8
400253.344.166.8
4503453.441.367.8
500253.541.466.8
5503754.723.267.8
6003353.919.367.8
6503352.824.766.8
700053.241.966.8
750052.840.467.8
800052.844.166.8
850053.337.767.8
900753.045.366.8
950053.242.466.8
1000052.938.667.8
1050053.142.966.8
11001553.340.566.8
1150053.042.366.8
1200052.942.366.8
1250253.941.367.8
1300053.335.867.8
13502453.246.666.8
1400053.144.866.8
1450153.344.366.8
15001453.044.366.8
15503152.735.967.8
1600053.041.266.8
1650053.142.166.8
1700053.042.166.8
17501352.939.367.8
1800053.146.466.8
1850153.046.466.8
1900053.046.466.8
1950153.146.566.8
2000252.946.566.8
2050053.046.566.8
21002453.346.666.8
2150053.346.666.8
2200053.146.666.8
22502152.346.667.8
2300152.746.666.8
2350053.246.666.8
2400053.046.666.8
2450053.042.266.8
2500053.042.266.8
2550052.742.266.8
26001552.942.266.8
2650053.042.366.8
2700153.142.366.8
2750053.144.767.8
2800053.142.266.8
2850053.442.266.8
2900153.242.266.8
29502252.942.266.8
3000453.342.266.8
3050053.042.266.8
3100153.042.266.8
31501352.945.066.8
3200153.247.566.8
3250053.047.566.8
3300053.147.566.8
3350152.947.566.8
3400053.047.666.8
3450153.447.666.8
3500053.547.866.8
3550153.447.866.8
3600153.347.866.8
3650052.847.866.8
3700053.147.866.8
3750053.147.866.8
3800053.347.866.8
3850053.247.866.8
3900053.047.867.8
3950052.947.866.8
4000053.147.866.8
4050052.847.866.8
4100653.047.866.8
4150053.147.866.8
4200053.447.866.8
4250053.047.866.8
4300053.147.866.8
4350153.047.866.8
4400053.247.866.8
4450152.947.866.8
4500052.945.266.8
45501952.745.266.8
4600153.245.266.8
4650053.245.266.8
4700353.345.266.8
4750053.545.266.8
4800053.146.166.8
4850053.139.467.8
4900053.346.466.8
49502452.946.466.8

Worked out

ReadoutValueWorked out from
Run complete100%1446 steps over 1446
Step time10.4 s14955.8 s over 1445 steps, between readings. Startup and intervals that hold an eval are left out
Steps per minute5.860 s over the step time of 10.35 s
Epoch interval5010.6 sMean of 2 gaps between epoch marks
Train loss since first reading−1.13650.0043 at step 1446 minus 1.1408 at step 5
Lowest train loss0.0009Lowest of 290 readings, at step 1435
Eval accuracy, as shown91.0%0.9100 times 100, to one decimal. Changes on that plate are percentage points
Eval accuracy since first eval+0.35400.9100 minus 0.5560
Eval loss since first eval−1.00150.3689 minus 1.3704
ECE since first eval−0.04680.0656 minus 0.1124
Eval change+0.3540Eval 2 at 0.9100 minus eval 1 at 0.5560
Train minus eval loss−0.36460.0043 minus 0.3689, both at step 1446
Wrong answers45500 eval items minus 455 correct. 455 over 500 is the only count that gives 0.9100
Rank2 of 3By last eval accuracy, across this project's 3 runs with an eval
Best so far0.9120Highest last eval accuracy, run 2
Against the run before−0.00200.9100 minus 0.9120 on run 2
Lowest last train loss0.0002Lowest last train loss across this project's 3 runs, run 1
Seed spread, observed0.0120High 0.9120 minus low 0.9000 across 3 finished seeds
Items per second0.81 step over 10.35 s, times batch size 8
Train loss against run 2−0.09250.0043 minus 0.0968 on run 2, both at step 1446
Learning rate since first reading−5.81e-70.00e+0 minus 5.81e-7
Peak memory per GPU, whole GPU47.8 GBHighest sensor reading of any GPU, GPU 0, counting every process on it