X-Git-Url: https://fleuret.org/cgi-bin/gitweb/gitweb.cgi?a=blobdiff_plain;f=README.txt;h=a4cd46b3ab7feaf839fac3b94e8268eb2d9f01ca;hb=291c38d093894d46fba6eb45f82e5b65a2a1cb8b;hp=d4cb93d405a81f0d3d3b6118ab06860f2953cb68;hpb=2175a87ad4304a97c63ac9cca6224d0c0b74c64e;p=picoclvr.git diff --git a/README.txt b/README.txt index d4cb93d..a4cd46b 100644 --- a/README.txt +++ b/README.txt @@ -1,10 +1,12 @@ +====================================================================== For the stack experiment: ./main.py --task=stack Takes ~1h10min on a 4090. +====================================================================== For the arithmetic expressions experiments # 38M parameters / 250k samples @@ -15,3 +17,4 @@ For the arithmetic expressions experiments learning rate schedule is obviously terrible ./main.py --task=expr --nb_blocks=48 --dim_model=1024 --nb_train_samples=2500000 --result_dir=results_expr_48b_d1024_2.5M +======================================================================