projects
/
culture.git
/ commitdiff
commit
grep
author
committer
pickaxe
?
search:
re
summary
|
shortlog
|
log
|
commit
| commitdiff |
tree
raw
|
patch
|
inline
| side by side (parent:
703baba
)
Update.
author
François Fleuret
<francois@fleuret.org>
Fri, 7 Jul 2023 22:51:41 +0000
(
00:51
+0200)
committer
François Fleuret
<francois@fleuret.org>
Fri, 7 Jul 2023 22:51:41 +0000
(
00:51
+0200)
README.txt
patch
|
blob
|
history
diff --git
a/README.txt
b/README.txt
index
223565e
..
bf6180a
100644
(file)
--- a/
README.txt
+++ b/
README.txt
@@
-1,5
+1,16
@@
+
For the stack experiment:
For the stack experiment:
-./main.py --task=stack
--stack_fraction_values_for_train=0.75 --stack_nb_stacks=3
+./main.py --task=stack
Takes ~1h10min on a 4090.
Takes ~1h10min on a 4090.
+
+For the arithmetic expressions experiments
+
+# 38M parameters / 250k samples
+
+./main.py --task=expr
+
+# 352M parameters / 2.5M samples
+
+./main.py --task=expr --nb_blocks=48 --result_dir=results_expr_48b_d1024_2.5M --dim_model=1024 --nb_train_samples=2500000 --learning_rate_schedule="1:2e-5,3:4e-6"