projects
/
mygpt.git
/ summary
commit
grep
author
committer
pickaxe
?
search:
re
summary |
shortlog
|
log
|
commit
|
commitdiff
|
tree
description
A minimal implementation of a GPT-like model.
last change
Sat, 21 Jan 2023 15:32:53 +0000
(16:32 +0100)
URL
https://fleuret.org/git/mygpt
shortlog
2023-01-21
François Fleuret
Added default configurations and reformated with black.
master
commit
|
commitdiff
|
tree
|
snapshot
2022-12-03
François Fleuret
Update.
commit
|
commitdiff
|
tree
|
snapshot
2022-12-03
François Fleuret
Update.
commit
|
commitdiff
|
tree
|
snapshot
2022-08-27
Francois Fleuret
The "mask" array actually specifies what attention...
commit
|
commitdiff
|
tree
|
snapshot
2022-08-20
Francois Fleuret
Replaced --synthesis_sampling with --deterministic_synt...
commit
|
commitdiff
|
tree
|
snapshot
2022-08-08
Francois Fleuret
Added args.learning_rate_end for an exponential decay.
commit
|
commitdiff
|
tree
|
snapshot
2022-08-08
Francois Fleuret
Added the small weight embedding + id layer norm inits.
commit
|
commitdiff
|
tree
|
snapshot
2022-08-07
Francois Fleuret
Added the rng state in the checkpoint.
commit
|
commitdiff
|
tree
|
snapshot
2022-08-07
Francois Fleuret
Added the small-weight embedding initialization.
commit
|
commitdiff
|
tree
|
snapshot
2022-07-30
Francois Fleuret
Update.
commit
|
commitdiff
|
tree
|
snapshot
2022-07-30
Francois Fleuret
Update.
commit
|
commitdiff
|
tree
|
snapshot
2022-07-30
Francois Fleuret
Update.
commit
|
commitdiff
|
tree
|
snapshot
2022-07-30
Francois Fleuret
Fixed a bug when there are no squares.
commit
|
commitdiff
|
tree
|
snapshot
2022-07-29
Francois Fleuret
OCDC
commit
|
commitdiff
|
tree
|
snapshot
2022-07-29
Francois Fleuret
Update.
commit
|
commitdiff
|
tree
|
snapshot
2022-07-29
Francois Fleuret
Update.
commit
|
commitdiff
|
tree
|
snapshot
...
heads
22 months ago
master
shortlog
|
log
|
tree