This directory contains results updated in real time from an experiment about the partly supervised learning of representations and concepts.

The code is available on https://fleuret.org/git/culture and a summary of the whole experiment is available as a thread on X.com.

plots.png

performance graphs

w_quizzes/

examples of quizzes from the reference hand-designed tasks.

c_quizzes/

quizzes that have been created by the generative models.

prediction/

prediction on quizzes. Green and red frames indicate what has been predicted and if it is correct.

generation/

generation of quizzes.

other/

other files

20241027-12:06:43 wrote reasoning.pth
20241027-12:06:43 quiz_set nb_w_quizzes 256 nb_c_quizzes 0
20241027-12:06:46 quiz_set nb_w_quizzes 50000 nb_c_quizzes 0
20241027-12:14:59 train_loss 159 model 0 1605.5896
20241027-12:14:59 quiz_set nb_w_quizzes 2500 nb_c_quizzes 0
20241027-12:15:07 test_loss 159 model 0 2755.68
20241027-12:15:07 quiz_set nb_w_quizzes 2500 nb_c_quizzes 0
20241027-12:15:15 test_accuracy 159 model 0 nb_correct 0 / 2500 (0.00%)
20241027-12:15:15 quiz_set nb_w_quizzes 150 nb_c_quizzes 0
20241027-12:15:31 wrote reasoning.pth
20241027-12:15:31 quiz_set nb_w_quizzes 256 nb_c_quizzes 0
20241027-12:15:35 quiz_set nb_w_quizzes 50000 nb_c_quizzes 0
20241027-12:23:31 train_loss 160 model 0 1627.5744
20241027-12:23:31 quiz_set nb_w_quizzes 2500 nb_c_quizzes 0
20241027-12:23:39 test_loss 160 model 0 3838.368
20241027-12:23:39 quiz_set nb_w_quizzes 2500 nb_c_quizzes 0
20241027-12:23:47 test_accuracy 160 model 0 nb_correct 0 / 2500 (0.00%)
20241027-12:23:47 quiz_set nb_w_quizzes 150 nb_c_quizzes 0
20241027-12:24:03 wrote reasoning.pth
20241027-12:24:03 quiz_set nb_w_quizzes 256 nb_c_quizzes 0
20241027-12:24:07 quiz_set nb_w_quizzes 50000 nb_c_quizzes 0
20241027-12:31:47 train_loss 161 model 0 1671.2904
20241027-12:31:47 quiz_set nb_w_quizzes 2500 nb_c_quizzes 0
20241027-12:31:55 test_loss 161 model 0 1841.456
20241027-12:31:55 quiz_set nb_w_quizzes 2500 nb_c_quizzes 0
20241027-12:32:03 test_accuracy 161 model 0 nb_correct 0 / 2500 (0.00%)
20241027-12:32:03 quiz_set nb_w_quizzes 150 nb_c_quizzes 0
20241027-12:32:19 wrote reasoning.pth
20241027-12:32:19 quiz_set nb_w_quizzes 256 nb_c_quizzes 0
20241027-12:32:23 quiz_set nb_w_quizzes 50000 nb_c_quizzes 0