-
Notifications
You must be signed in to change notification settings - Fork 108
Pull requests: pytorch/torchtitan
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
[POC] Showed more memory efficient FSDP wrapping
CLA Signed
This label is managed by the Meta Open Source bot.
Add PP tracer + DP test
CLA Signed
This label is managed by the Meta Open Source bot.
#379
opened Jun 1, 2024 by
kwen2501
Loading…
IBM experimental dataloaders
CLA Signed
This label is managed by the Meta Open Source bot.
#376
opened May 31, 2024 by
daviswer
Loading…
expose optimizer params, log optimizer type and settings for the run
CLA Signed
This label is managed by the Meta Open Source bot.
#365
opened May 26, 2024 by
lessw2020
Loading…
enable TritonFusedRMSNorm with local_map annotation
CLA Signed
This label is managed by the Meta Open Source bot.
#364
opened May 25, 2024 by
XilunWu
Loading…
Fix 1D PP tracer test
CLA Signed
This label is managed by the Meta Open Source bot.
#362
opened May 24, 2024 by
wconstab
Loading…
Remove PP+TP rmsnorm workaround
CLA Signed
This label is managed by the Meta Open Source bot.
#361
opened May 24, 2024 by
wconstab
Loading…
[RFC] Allow ModelWrapper and OptimizerWrapper to accept multiple models
CLA Signed
This label is managed by the Meta Open Source bot.
#360
opened May 24, 2024 by
fegin
Loading…
add todos mocking changes for looped PP support
CLA Signed
This label is managed by the Meta Open Source bot.
#358
opened May 23, 2024 by
wconstab
Loading…
[torchtitan][optim] Add fused as an option in train config
CLA Signed
This label is managed by the Meta Open Source bot.
#355
opened May 22, 2024 by
wz337
Loading…
use local_map to annotate fusedrmsnorm
CLA Signed
This label is managed by the Meta Open Source bot.
Add a 3-stage PP config
CLA Signed
This label is managed by the Meta Open Source bot.
#345
opened May 18, 2024 by
wconstab
Loading…
Add 3D support
CLA Signed
This label is managed by the Meta Open Source bot.
#344
opened May 17, 2024 by
wconstab
Loading…
selective compilation - norm layers only
CLA Signed
This label is managed by the Meta Open Source bot.
#320
opened May 10, 2024 by
lessw2020
Loading…
Add support of DDP and CompiledAutograd.
CLA Signed
This label is managed by the Meta Open Source bot.
#319
opened May 9, 2024 by
fegin
Loading…
[fused_rmsnorm] Register as a custom operator for tracing
CLA Signed
This label is managed by the Meta Open Source bot.
#303
opened May 3, 2024 by
wconstab
Loading…
[fused_rmsnorm] Avoid querying device inside forward
CLA Signed
This label is managed by the Meta Open Source bot.
#301
opened May 3, 2024 by
wconstab
Loading…
[fused_rmsnorm] Avoid conditional on dynamic stride
CLA Signed
This label is managed by the Meta Open Source bot.
#300
opened May 3, 2024 by
wconstab
Loading…
register fused rmsnorm as pytorch custom op
CLA Signed
This label is managed by the Meta Open Source bot.
[wip] differentiate Rstd vs rstd
CLA Signed
This label is managed by the Meta Open Source bot.
#294
opened May 2, 2024 by
lessw2020
Loading…
RFC for ckpt apis
CLA Signed
This label is managed by the Meta Open Source bot.
#226
opened Apr 13, 2024 by
wconstab
Loading…
[RFC] Sharded embeddings in separate FSDP group
CLA Signed
This label is managed by the Meta Open Source bot.
run sdpa with dtensor
CLA Signed
This label is managed by the Meta Open Source bot.
#180
opened Mar 30, 2024 by
tianyu-l
Loading…
Implement fast checkpoint path
CLA Signed
This label is managed by the Meta Open Source bot.
#127
opened Mar 12, 2024 by
fegin
Loading…
ProTip!
Type g p on any issue or pull request to go back to the pull request listing page.