This directory contains results updated in real time from an experiment about the partly supervised learning of representations and concepts.

The code is available on https://fleuret.org/git/culture and a summary of the whole experiment is available as a thread on X.com.

plots.png

performance graphs

w_quizzes/

examples of quizzes from the reference hand-designed tasks.

c_quizzes/

quizzes that have been created by the generative models.

prediction/

prediction on quizzes. Green and red frames indicate what has been predicted and if it is correct.

generation/

generation of quizzes.

other/

other files

20241105-22:35:32 current_test_accuracies 0.9556 0.9548 0.9044 0.9348 0.9556
20241105-22:35:32 nb_c_quizzes 45067
20241105-22:35:32 weakest_accuracies [0.9044, 0.9348]
20241105-22:35:32 dummy_rand tensor([0.4499])
20241105-22:35:32 dummy_rand tensor([0.8007])
20241105-22:35:32 quiz_set nb_w_quizzes 25000 nb_c_quizzes 25000
20241105-22:35:32 quiz_set nb_w_quizzes 25000 nb_c_quizzes 25000
20241105-22:38:03 train_loss 2270 model 2 0.033767749786376956
20241105-22:38:03 quiz_set nb_w_quizzes 1250 nb_c_quizzes 1250
20241105-22:38:03 train_loss 2270 model 3 0.03444969367980957
20241105-22:38:03 quiz_set nb_w_quizzes 1250 nb_c_quizzes 1250
20241105-22:38:06 test_loss 2270 model 2 0.03007986068725586
20241105-22:38:06 quiz_set nb_w_quizzes 1250 nb_c_quizzes 1250
20241105-22:38:06 test_loss 2270 model 3 0.02910858154296875
20241105-22:38:06 quiz_set nb_w_quizzes 1250 nb_c_quizzes 1250
20241105-22:38:08 test_accuracy 2270 model 2 nb_correct 2349 / 2500 (93.96%)
20241105-22:38:08 quiz_set nb_w_quizzes 75 nb_c_quizzes 75
20241105-22:38:08 test_accuracy 2270 model 3 nb_correct 2384 / 2500 (95.36%)
20241105-22:38:08 quiz_set nb_w_quizzes 75 nb_c_quizzes 75
20241105-22:38:18 wrote ae_*.pth
20241105-22:38:18 epoch_duration 2min46s next_finish 22:41:04
20241105-22:38:18 wrote state.pth
20241105-22:38:18 --- epoch 2271 ----------------------------------------
20241105-22:38:18 current_test_accuracies 0.9556 0.9548 0.9396 0.9536 0.9556
20241105-22:38:18 nb_c_quizzes 45067
20241105-22:38:18 weakest_accuracies [0.9396, 0.9536]
20241105-22:38:18 dummy_rand tensor([0.7388])
20241105-22:38:18 dummy_rand tensor([0.3036])
20241105-22:38:18 quiz_set nb_w_quizzes 25000 nb_c_quizzes 25000
20241105-22:38:18 quiz_set nb_w_quizzes 25000 nb_c_quizzes 25000