This directory contains results updated in real time from an experiment about the partly supervised learning of representations and concepts.

The code is available on https://fleuret.org/git/culture and a summary of the whole experiment is available as a thread on X.com.

plots.png

performance graphs

w_quizzes/

examples of quizzes from the reference hand-designed tasks.

c_quizzes/

quizzes that have been created by the generative models.

prediction/

prediction on quizzes. Green and red frames indicate what has been predicted and if it is correct.

generation/

generation of quizzes.

other/

other files

20241027-00:18:11 current_test_accuracies 0.9428
20241027-00:18:11 no_c_quiz
20241027-00:18:11 weakest_accuracies [0.9428]
20241027-00:18:11 quiz_set nb_w_quizzes 50000 nb_c_quizzes 0
20241027-00:36:36 train_loss 16 model 0 0.03089874274432659
20241027-00:36:36 quiz_set nb_w_quizzes 2500 nb_c_quizzes 0
20241027-00:36:52 test_loss 16 model 0 0.024968827426433565
20241027-00:36:52 quiz_set nb_w_quizzes 2500 nb_c_quizzes 0
20241027-00:37:08 test_accuracy 16 model 0 nb_correct 2293 / 2500 (91.72%)
20241027-00:37:08 quiz_set nb_w_quizzes 150 nb_c_quizzes 0
20241027-00:37:37 wrote ae_*.pth
20241027-00:37:37 epoch_duration 19min25s next_finish 00:57:02
20241027-00:37:37 wrote state.pth
20241027-00:37:37 --- epoch 17 ----------------------------------------
20241027-00:37:37 current_test_accuracies 0.9172
20241027-00:37:37 no_c_quiz
20241027-00:37:37 weakest_accuracies [0.9172]
20241027-00:37:37 quiz_set nb_w_quizzes 50000 nb_c_quizzes 0
20241027-00:56:08 train_loss 17 model 0 0.030611307680606843
20241027-00:56:08 quiz_set nb_w_quizzes 2500 nb_c_quizzes 0
20241027-00:56:25 test_loss 17 model 0 0.02509162476658821
20241027-00:56:25 quiz_set nb_w_quizzes 2500 nb_c_quizzes 0
20241027-00:56:41 test_accuracy 17 model 0 nb_correct 2395 / 2500 (95.80%)
20241027-00:56:41 quiz_set nb_w_quizzes 150 nb_c_quizzes 0
20241027-00:57:10 wrote ae_*.pth
20241027-00:57:10 epoch_duration 19min33s next_finish 01:16:43
20241027-00:57:10 wrote state.pth
20241027-00:57:10 --- epoch 18 ----------------------------------------
20241027-00:57:10 current_test_accuracies 0.9580
20241027-00:57:14 wrote ae_*_naive.pth