cm2435
|
b62c88600f
|
updated tests
|
2024-02-04 12:44:52 +00:00 |
|
cm2435
|
b6d224bc82
|
fixed incorrect bwd pass for GeLU, wrapped functions in pytorch convience handlers
|
2024-01-24 18:03:00 +00:00 |
|
cm2435
|
4a7c20c823
|
impliment forward and backward kernels for GeLU
|
2024-01-24 17:45:01 +00:00 |
|
cm2435
|
48eb887037
|
update test to use common torch.allclose function util
|
2024-01-24 17:44:40 +00:00 |
|
cm2435
|
3954f16976
|
Contributed relu triton kernl, removed a small amount of boilerplate from the layernorm, added test suite for kernls.
|
2024-01-22 21:34:21 +00:00 |
|
cm2435
|
598dda3a5b
|
starting to structure out test suite
|
2024-01-22 20:34:31 +00:00 |
|