CITADEL
StandbyNothing is live right now.
Eval accuracylast measured Sun 22 Nov, 13:32 UTC
%
0.9180459 of 500 eval, 41 wrong
▲ +8.60 pts across 3 evals▲ +2.00 pts on the eval before
0%25%50%75%100%0%25%50%75%100%0%25%50%75%100%

Familiar decider: decider-nano's encoder

finishedRadeon 8060S

One of the small models that decide whether Familiar, a desktop companion, reacts to something on the PC, and how. Trained on the same 6,000 synthetic decision points as every candidate, two ways: the reaction itself, and the plain-case intent that rules adjust for her traits.

started
Sun 22 Nov, 13:14 UTC
ran for
14:00
config
batch 16, seed 2 of 2

run8/10step1125/1125epoch3/3config7/8seed2/2batch16modeltasksource-decider-nano 149Mrev2c7c01fitems6000+500

Loss train 0.0399 ▼ −2.8962 lowest 0.0069 at step 970 run before, run 7 ▲ +0.0381 step 1125
Timebase
Range
Smoothing
Reference
113 readings, 5 min/div5 min/div2 min/div
0123400:0005:0010:00phase starting, 0.0 s to 23.1 sphase training, 23.1 s to 14:00epoch 1, 04:54epoch 2, 09:16epoch 3, 13:51trainingepoch 1epoch 2−2.8962since first2.9361Lowest last train loss across this project's 10 runs, run 7lowest last 0.0018, run 70.03990123400:0005:0010:00phase starting, 0.0 s to 23.1 sphase training, 23.1 s to 14:00epoch 1, 04:54epoch 2, 09:16epoch 3, 13:51trainingepoch 1epoch 22.9361Lowest last train loss across this project's 10 runs, run 7lowest last 0.0018, run 70.0399▼ −2.89620123400:0002:0004:0006:0008:0010:0012:0014:00phase starting, 0.0 s to 23.1 sphase training, 23.1 s to 14:00epoch 1, 04:54epoch 2, 09:16epoch 3, 13:51trainingepoch 1epoch 22.9361Lowest last train loss across this project's 10 runs, run 7lowest last 0.0018, run 70.0399▼ −2.8962

Eval measures

Elapsed

268.6 s

epoch interval

1125 of 1125 steps, 3 of 3 epochs, 100%

0.72 s per step, 83.7 steps a minute

Eval accuracy by eval

+0.0200

▲ on the eval before

eval 1 0.8320, eval 3 0.9180

Against the other runs

3 of 10

by last eval accuracy

best so far 0.9360, run 2

▲ +0.0040 against run 7

Set-up

6000 train, 500 eval

synthetic, batch size 16, epochs 3, max length 512, precision bf16-mixed, loss ce, optimizer adamw, scheduler linear, seed 2

Seed spread, observed

0.0040
0.900.95

2 finished seeds

Learning rate

0.00e+0

▼ −2.99e-6 since first

On one axis

phase starting, 0.0 s to 23.1 sphase training, 23.1 s to 14:00E1E2E3traininglowest last 0.0018Train loss0.0399▼ −2.89623.000.002.93610.0399last ▼ −2.8962best 0.9360, run 2Last-value range, 10 runs, 0.8854 to 0.9360Eval accuracy0.9180▲ +0.08600.950.800.83200.9180last ▲ +0.0860Learning rate0.00e+0▼ −2.99e-62.0e-50.0e+02.99e-6last 0.00e+0Power, whole chip, CPU and GPU117 W▼ −14 W140 W110 W131 Wlast 117 WHottest, one board zone91 °C▼ −7 °C100 °C80 °C98 °Clast 91 °C00:0002:0004:0006:0008:0010:0012:0014:00
GPUpower: whole chip, CPU and GPUtemperature: one board zone

GPU 0

Wwhole chip, CPU and GPU

117 W whole chip, CPU and GPU

use90%
memory, whole GPU1.1 GB

peak 14.4 GB, whole GPU

91 °C one board zone

history 0 to 131 W

Input

  • Runs128 runs
  • Agentsnone showing
  • Treesnone showing
  • Projectsnone showing

Check

Every entry is checked on its way out; some are held for review.

Not shown on any run: data samples, predictions, raw logs, file paths, machine names

Delay

2 min, set

Watching the agents work, about 2 min behind.

One way

Nothing here reaches the agents.

This page

This page updates by itself.

visits counted with Google Analytics · choose

Runsheight is eval accuracyall recordings ▸ | finished× failed■ stopped○ lost● live
0.950.850.950.85finished, eval accuracy 0.9100, config 1 of 8 (learning rate 0.0001, batch 16), seed 0, Sun 22 Nov, 10:33 UTCfinished, eval accuracy 0.9360, config 2 of 8 (learning rate 0.00002, batch 16), seed 0, Sun 22 Nov, 10:51 UTCfinished, eval accuracy 0.9220, config 3 of 8 (learning rate 0.00005, batch 16), seed 0, Sun 22 Nov, 11:09 UTCfinished, eval accuracy 0.8966, config 4 of 8 (learning rate 0.0001, batch 16), seed 0, Sun 22 Nov, 11:27 UTCfinished, eval accuracy 0.8944, config 5 of 8 (learning rate 0.00002, batch 16), seed 0, Sun 22 Nov, 11:44 UTCfinished, eval accuracy 0.8944, config 6 of 8 (learning rate 0.00005, batch 16), seed 0, Sun 22 Nov, 12:01 UTCfinished, eval accuracy 0.9140, config 7 of 8 (batch 16), seed 1 of 2, Sun 22 Nov, 12:56 UTCfinished, eval accuracy 0.9180, config 7 of 8 (batch 16), seed 2 of 2, Sun 22 Nov, 13:14 UTCfinished, eval accuracy 0.8966, config 8 of 8 (batch 16), seed 1 of 2, Sun 22 Nov, 13:32 UTCfinished, eval accuracy 0.8854, config 8 of 8 (batch 16), seed 2 of 2, Sun 22 Nov, 13:49 UTC0.950.85finished, eval accuracy 0.9100, config 1 of 8 (learning rate 0.0001, batch 16), seed 0, Sun 22 Nov, 10:33 UTCfinished, eval accuracy 0.9360, config 2 of 8 (learning rate 0.00002, batch 16), seed 0, Sun 22 Nov, 10:51 UTCfinished, eval accuracy 0.9220, config 3 of 8 (learning rate 0.00005, batch 16), seed 0, Sun 22 Nov, 11:09 UTCfinished, eval accuracy 0.8966, config 4 of 8 (learning rate 0.0001, batch 16), seed 0, Sun 22 Nov, 11:27 UTCfinished, eval accuracy 0.8944, config 5 of 8 (learning rate 0.00002, batch 16), seed 0, Sun 22 Nov, 11:44 UTCfinished, eval accuracy 0.8944, config 6 of 8 (learning rate 0.00005, batch 16), seed 0, Sun 22 Nov, 12:01 UTCfinished, eval accuracy 0.9140, config 7 of 8 (batch 16), seed 1 of 2, Sun 22 Nov, 12:56 UTCfinished, eval accuracy 0.9180, config 7 of 8 (batch 16), seed 2 of 2, Sun 22 Nov, 13:14 UTCfinished, eval accuracy 0.8966, config 8 of 8 (batch 16), seed 1 of 2, Sun 22 Nov, 13:32 UTCfinished, eval accuracy 0.8854, config 8 of 8 (batch 16), seed 2 of 2, Sun 22 Nov, 13:49 UTC

8 of 10 finished, 0.9180, config 7 of 8 (batch 16), seed 2 of 2, Sun 22 Nov, 13:14 UTC

Runs as a table
StartedStatusEval accuracyStepsConfig
Sun 22 Nov, 13:49 UTC| finished0.88541032 of 1032batch 16, seed 2 of 2
Sun 22 Nov, 13:32 UTC| finished0.89661032 of 1032batch 16, seed 1 of 2
Sun 22 Nov, 13:14 UTC| finished0.91801125 of 1125batch 16, seed 2 of 2
Sun 22 Nov, 12:56 UTC| finished0.91401125 of 1125batch 16, seed 1 of 2
Sun 22 Nov, 12:01 UTC| finished0.89441032 of 1032learning rate 0.00005, batch 16, seed 0
Sun 22 Nov, 11:44 UTC| finished0.89441032 of 1032learning rate 0.00002, batch 16, seed 0
Sun 22 Nov, 11:27 UTC| finished0.89661032 of 1032learning rate 0.0001, batch 16, seed 0
Sun 22 Nov, 11:09 UTC| finished0.92201125 of 1125learning rate 0.00005, batch 16, seed 0
Sun 22 Nov, 10:51 UTC| finished0.93601125 of 1125learning rate 0.00002, batch 16, seed 0
Sun 22 Nov, 10:33 UTC| finished0.91001125 of 1125learning rate 0.0001, batch 16, seed 0

Plate

Model
tasksource/tasksource-decider-nano, 149M parameters revision 2c7c01f
Data
Familiar decisions, shared draw, synthetic6000 train500 eval
Config
batch size 16, epochs 3, max length 512, precision bf16-mixed, loss ce, optimizer adamw, scheduler linear, seed 2
Hardware
Radeon 8060S, ROCm

Log

Since startMark
0.0 sphase starting
14.7 swent public
23.1 sphase training
290.1 seval 1
294.7 sepoch 1
556.7 sepoch 2
565.5 seval 2
831.9 sepoch 3
840.7 seval 3

Seeds

SeedStatusEval accuracy
seed 1| finished0.9140
seed 2| finished0.9180

observed spread 0.0040, 2 finished seeds

Readings

114 rows as a table

rows 1 to 100 of 114

StepSecondsTrain lossEval accuracyLearning rate
1023.12.9361-2.99e-6
2030.12.0541-5.97e-6
3037.01.1411-8.96e-6
4044.10.9445-1.19e-5
5051.11.6987-1.49e-5
6058.21.7786-1.79e-5
7065.11.6545-1.99e-5
8072.31.3803-1.98e-5
9079.41.7214-1.96e-5
10086.41.7011-1.94e-5
11093.41.0497-1.92e-5
120100.61.5865-1.90e-5
130107.81.2902-1.88e-5
140114.81.0573-1.86e-5
150121.80.5942-1.84e-5
160128.90.8453-1.82e-5
170135.81.0038-1.81e-5
180143.10.5555-1.79e-5
190150.00.5599-1.77e-5
200157.11.2638-1.75e-5
210164.21.1739-1.73e-5
220171.20.9452-1.71e-5
230178.20.6024-1.69e-5
240185.30.6647-1.67e-5
250192.40.2557-1.65e-5
260199.30.3343-1.64e-5
270206.50.2381-1.62e-5
280213.60.8827-1.60e-5
290220.70.6274-1.58e-5
300227.90.6920-1.56e-5
310235.10.1446-1.54e-5
320242.30.2820-1.52e-5
330249.40.6677-1.50e-5
340256.50.9924-1.48e-5
350263.50.8149-1.47e-5
360270.60.4218-1.45e-5
370277.70.3719-1.43e-5
375290.1-0.8320-
380294.70.1409-1.41e-5
390301.90.1040-1.39e-5
400309.00.1686-1.37e-5
410316.10.0891-1.35e-5
420323.10.7469-1.33e-5
430330.31.2581-1.31e-5
440337.40.4367-1.29e-5
450344.30.2525-1.28e-5
460351.50.2258-1.26e-5
470358.50.0947-1.24e-5
480365.50.5469-1.22e-5
490372.60.5397-1.20e-5
500379.60.8291-1.18e-5
510386.70.0720-1.16e-5
520393.70.8179-1.14e-5
530400.90.6381-1.12e-5
540407.90.7965-1.11e-5
550415.10.3198-1.09e-5
560422.20.0882-1.07e-5
570429.20.7399-1.05e-5
580436.10.1962-1.03e-5
590443.10.4844-1.01e-5
600450.10.3627-9.92e-6
610457.30.6198-9.74e-6
620464.50.1793-9.55e-6
630471.40.3031-9.36e-6
640478.50.8739-9.17e-6
650485.50.0822-8.98e-6
660492.50.1006-8.79e-6
670499.60.0095-8.60e-6
680506.70.4015-8.41e-6
690513.90.8986-8.22e-6
700521.10.0531-8.03e-6
710528.20.3694-7.84e-6
720535.30.1756-7.66e-6
730542.50.0519-7.47e-6
740549.50.4946-7.28e-6
750565.50.29650.89807.09e-6
760573.80.2820-6.90e-6
770580.70.2957-6.71e-6
780587.90.1910-6.52e-6
790595.00.1904-6.33e-6
800602.00.0355-6.14e-6
810609.20.3115-5.95e-6
820616.20.4062-5.77e-6
830623.20.6380-5.58e-6
840630.30.2367-5.39e-6
850637.50.5765-5.20e-6
860644.50.4003-5.01e-6
870651.40.1443-4.82e-6
880658.50.0100-4.63e-6
890665.50.0374-4.44e-6
900672.50.2636-4.25e-6
910679.80.1405-4.06e-6
920686.90.3388-3.88e-6
930694.00.3174-3.69e-6
940700.90.0989-3.50e-6
950707.90.0551-3.31e-6
960714.90.7540-3.12e-6
970722.00.0069-2.93e-6
980729.00.0097-2.74e-6
990736.10.1188-2.55e-6

GPU readings

114 rows as a table
StepGPUUse %Power W, whole chip, CPU and GPUMemory GB, whole GPUTemp C, one board zone
10068130.810.197.8
40071119.412.284.8
90067119.512.285.8
140067119.914.486.8
180066119.714.487.8
230067119.814.487.8
2700100116.814.488.8
320068119.514.488.8
370067120.514.488.8
4000100115.914.488.8
4400100115.814.488.8
4900100115.714.488.8
540068116.214.489.8
5800100115.414.489.8
6300100114.214.489.8
670071116.514.489.8
7200100115.614.489.8
7500100127.814.492.8
800071118.414.489.8
840068119.914.488.8
890068119.514.488.8
930067120.714.488.8
980066119.514.488.8
1020070120.014.488.8
1070069119.214.488.8
1120067120.114.488.8
1125090116.61.190.8

Worked out

ReadoutValueWorked out from
Run complete100%1125 steps over 1125
Step time0.72 s784.7 s over 1095 steps, between readings. Startup and intervals that hold an eval are left out
Steps per minute83.760 s over the step time of 0.72 s
Epoch interval268.6 sMean of 2 gaps between epoch marks
Train loss since first reading−2.89620.0399 at step 1125 minus 2.9361 at step 10
Lowest train loss0.0069Lowest of 113 readings, at step 970
Eval accuracy, as shown91.8%0.9180 times 100, to one decimal. Changes on that plate are percentage points
Eval accuracy since first eval+0.08600.9180 minus 0.8320
Eval change+0.0200Eval 3 at 0.9180 minus eval 2 at 0.8980
Wrong answers41500 eval items minus 459 correct. 459 over 500 is the only count that gives 0.9180
Rank3 of 10By last eval accuracy, across this project's 10 runs with an eval
Best so far0.9360Highest last eval accuracy, run 2
Against the run before+0.00400.9180 minus 0.9140 on run 7
Lowest last train loss0.0018Lowest last train loss across this project's 10 runs, run 7
Seed spread, observed0.0040High 0.9180 minus low 0.9140 across 2 finished seeds
Items per second22.31 step over 0.72 s, times batch size 16
Train loss against run 7+0.03810.0399 minus 0.0018 on run 7, both at step 1125
Learning rate since first reading−2.99e-60.00e+0 minus 2.99e-6
Peak memory per GPU, whole GPU14.4 GBHighest sensor reading of any GPU, GPU 0, counting every process on it