This directory contains results updated in real time from an experiment about the partly supervised learning of representations and concepts.

The code is available on https://fleuret.org/git/culture and a summary of the whole experiment is available as a thread on X.com.

plots.png

performance graphs

w_quizzes/

examples of quizzes from the reference hand-designed tasks.

c_quizzes/

quizzes that have been created by the generative models.

prediction/

prediction on quizzes. Green and red frames indicate what has been predicted and if it is correct.

generation/

generation of quizzes.

other/

other files

20241029-16:08:58 weakest_accuracies [0.9816]
20241029-16:08:58 quiz_set nb_w_quizzes 50000 nb_c_quizzes 0
20241029-16:43:55 train_loss 54 model 0 0.02318080147534609
20241029-16:43:55 quiz_set nb_w_quizzes 2500 nb_c_quizzes 0
20241029-16:44:17 test_loss 54 model 0 0.017535675332229585
20241029-16:44:17 quiz_set nb_w_quizzes 2500 nb_c_quizzes 0
20241029-16:44:39 test_accuracy 54 model 0 nb_correct 2461 / 2500 (98.44%)
20241029-16:44:39 quiz_set nb_w_quizzes 150 nb_c_quizzes 0
20241029-16:45:20 wrote ae_*.pth
20241029-16:45:20 epoch_duration 36min21s next_finish 17:21:41
20241029-16:45:20 wrote state.pth
20241029-16:45:20 --- epoch 55 ----------------------------------------
20241029-16:45:20 current_test_accuracies 0.9844
20241029-16:45:20 no_c_quiz
20241029-16:45:20 weakest_accuracies [0.9844]
20241029-16:45:20 quiz_set nb_w_quizzes 50000 nb_c_quizzes 0
20241029-17:20:18 train_loss 55 model 0 0.023381758998781442
20241029-17:20:18 quiz_set nb_w_quizzes 2500 nb_c_quizzes 0
20241029-17:20:40 test_loss 55 model 0 0.02016963384952396
20241029-17:20:40 quiz_set nb_w_quizzes 2500 nb_c_quizzes 0
20241029-17:21:02 test_accuracy 55 model 0 nb_correct 2457 / 2500 (98.28%)
20241029-17:21:02 quiz_set nb_w_quizzes 150 nb_c_quizzes 0
20241029-17:21:42 wrote ae_*.pth
20241029-17:21:42 epoch_duration 36min22s next_finish 17:58:05
20241029-17:21:42 wrote state.pth
20241029-17:21:42 --- epoch 56 ----------------------------------------
20241029-17:21:42 current_test_accuracies 0.9828
20241029-17:21:42 no_c_quiz
20241029-17:21:42 weakest_accuracies [0.9828]
20241029-17:21:42 quiz_set nb_w_quizzes 50000 nb_c_quizzes 0