Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[aDAG] Support all reduce collective in aDAG #47621

Merged
merged 96 commits into from
Oct 21, 2024

Commits on Aug 8, 2024

  1. (WIP) chore: Add input index in reader

    The input index is used when a task returns multiple values. An index is used to get the corresponding value of the tuple.
    
    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    dd8afbe View commit details
    Browse the repository at this point in the history
  2. chore: Clean up

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    d957669 View commit details
    Browse the repository at this point in the history
  3. (WIP) chore: Update channel allocation for TaskReturnNode

    The downstream tasks of a TaskReturnNode should be readers of a output channel. The task of a TaskRetureNode should have a copy of the output channel in the task of its upstream ClassMethodNode.
    
    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    0df4191 View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2024

  1. (WIP) chore: Add tests

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    952daa0 View commit details
    Browse the repository at this point in the history
  2. chore: Return TaskReturnNode only when num_returns > 1

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    3479587 View commit details
    Browse the repository at this point in the history
  3. chore: Add test for two returns three actors

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    3312712 View commit details
    Browse the repository at this point in the history
  4. chore: Clean up

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    97faeb7 View commit details
    Browse the repository at this point in the history
  5. chore: Adjust input_idxs

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    197e65e View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2024

  1. (WIP) chore: Allocate an output channel for each output value

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    a48fecd View commit details
    Browse the repository at this point in the history
  2. (WIP) chore: Remove legacy dependencies

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    16e0323 View commit details
    Browse the repository at this point in the history
  3. (WIP) chore: Remove legacy dependencies

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    d12f28b View commit details
    Browse the repository at this point in the history
  4. chore: Update async writer

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    00a6de7 View commit details
    Browse the repository at this point in the history
  5. chore: Update comments

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    99a42f6 View commit details
    Browse the repository at this point in the history
  6. chore: Remove legacy

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    40c6bb2 View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2024

  1. chore: Update tests

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    6ef6e60 View commit details
    Browse the repository at this point in the history
  2. chore: Revert read_by_multi_output_node

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    6772b3a View commit details
    Browse the repository at this point in the history
  3. chore: Add comment

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    b35e632 View commit details
    Browse the repository at this point in the history
  4. chore: Rename output task to upstream/downstream task

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    f2004a3 View commit details
    Browse the repository at this point in the history
  5. chore: Update tests

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    a65b053 View commit details
    Browse the repository at this point in the history
  6. chore: Update private fields

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    db1d796 View commit details
    Browse the repository at this point in the history
  7. Merge branch 'master' into master

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn authored Aug 22, 2024
    Configuration menu
    Copy the full SHA
    ce4694e View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2024

  1. feat: Merge ClassMethodOutputNode into ClassMethodNode

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    d2d50f3 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e64a3da View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2024

  1. chore: Add tests and unify internal fields

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    007f656 View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2024

  1. chore: Adjust comments and tests

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    c8e6a5b View commit details
    Browse the repository at this point in the history
  2. chore: Format code

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    c729e68 View commit details
    Browse the repository at this point in the history
  3. chore: Merge master

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    39b1953 View commit details
    Browse the repository at this point in the history
  4. chore: Fix check of readers for each output

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    39a76c5 View commit details
    Browse the repository at this point in the history
  5. chore: Format code

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    a84ad8b View commit details
    Browse the repository at this point in the history
  6. chore: Format code

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    ce472ae View commit details
    Browse the repository at this point in the history
  7. chore: Format code

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    d04e687 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2024

  1. chore: Fix typo

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    315a192 View commit details
    Browse the repository at this point in the history
  2. chore: Fix typo

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    f050638 View commit details
    Browse the repository at this point in the history
  3. chore: Fix typo

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    8fc7cd0 View commit details
    Browse the repository at this point in the history
  4. chore: Fix typo

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    a88defb View commit details
    Browse the repository at this point in the history
  5. chore: Merge master

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    7e3eb68 View commit details
    Browse the repository at this point in the history
  6. chore: Format code

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    1d08bd7 View commit details
    Browse the repository at this point in the history
  7. chore: Fix output channels

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    28bc144 View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2024

  1. Configuration menu
    Copy the full SHA
    81915af View commit details
    Browse the repository at this point in the history
  2. chore: Fix reader_handles_set

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Aug 31, 2024
    Configuration menu
    Copy the full SHA
    dbb85dc View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    9af6490 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    e463a61 View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2024

  1. chore: Fix mock class method call in tests

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Sep 1, 2024
    Configuration menu
    Copy the full SHA
    b8173b7 View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2024

  1. Configuration menu
    Copy the full SHA
    d76a106 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    39a4452 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2024

  1. Configuration menu
    Copy the full SHA
    dc2586d View commit details
    Browse the repository at this point in the history
  2. chore: Boot waterfront

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    5a83526 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    f10d357 View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2024

  1. Configuration menu
    Copy the full SHA
    ef71af5 View commit details
    Browse the repository at this point in the history
  2. chore: Clean up

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    2a476de View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. refactor: Merge ccar-0905

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    6ae63c8 View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. refactor: Merge ccar-0905

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    76f57c9 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    8292346 View commit details
    Browse the repository at this point in the history
  3. chore: Fix type check

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    6d262fa View commit details
    Browse the repository at this point in the history
  4. refactor: Fix remove in edges

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    204581e View commit details
    Browse the repository at this point in the history
  5. chore: Revert file

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    88c7dc6 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. refactor: Fix api

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    b3e1742 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. refactor: Fix api

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    7236505 View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2024

  1. feat: Merge upstream

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 13, 2024
    Configuration menu
    Copy the full SHA
    283869b View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    6e59d3d View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2024

  1. Merge branch 'master' into ccar-0905

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn authored Oct 14, 2024
    Configuration menu
    Copy the full SHA
    c94ffa9 View commit details
    Browse the repository at this point in the history
  2. refactor: Inherit from ClassMethodNode

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    a045889 View commit details
    Browse the repository at this point in the history

Commits on Oct 15, 2024

  1. test: Change size

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    c73efd6 View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2024

  1. refactor: Code review

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    7be6954 View commit details
    Browse the repository at this point in the history
  2. refactor: Unify update candidate nodes

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    b58d27e View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2024

  1. fix: Union two sets of nccl group ids

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    6e81470 View commit details
    Browse the repository at this point in the history
  2. merge: Upstream master

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    bd7ba01 View commit details
    Browse the repository at this point in the history
  3. test: Reduce op values

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    c013bc7 View commit details
    Browse the repository at this point in the history
  4. refactor: Fix reduce op values

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    8e570c9 View commit details
    Browse the repository at this point in the history
  5. fix: API annotations

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    406dcd0 View commit details
    Browse the repository at this point in the history
  6. merge: Polish tests

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    f90270b View commit details
    Browse the repository at this point in the history
  7. chore: Polish tests

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    f41904a View commit details
    Browse the repository at this point in the history
  8. test: Check num

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    789b9bc View commit details
    Browse the repository at this point in the history
  9. test: Remove non-tensor input case

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    7e05f85 View commit details
    Browse the repository at this point in the history
  10. test: Remove allocate tensor case

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    a0f1381 View commit details
    Browse the repository at this point in the history
  11. chore: Polish tests

    Signed-off-by: Yuhan Ruan <[email protected]>
    AndyUB committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    00949bd View commit details
    Browse the repository at this point in the history
  12. merge: Upstream

    Signed-off-by: Yuhan Ruan <[email protected]>
    AndyUB committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    6c80c59 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2024

  1. refactor: Test separate types

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    6e71c93 View commit details
    Browse the repository at this point in the history
  2. refactor: Test original types

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    ccea7a3 View commit details
    Browse the repository at this point in the history
  3. refactor: Use separate types by if-else

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    f634bbb View commit details
    Browse the repository at this point in the history
  4. refactor: Use separate types by if-else

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    ccbf68b View commit details
    Browse the repository at this point in the history
  5. refactor: Convert to ray op

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    70ea96d View commit details
    Browse the repository at this point in the history
  6. revert: Skip ray types

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    4b77907 View commit details
    Browse the repository at this point in the history
  7. revert: Skip ray types

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    c5e2c20 View commit details
    Browse the repository at this point in the history
  8. merge: Upstream

    Signed-off-by: Yuhan Ruan <[email protected]>
    AndyUB committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    5e94216 View commit details
    Browse the repository at this point in the history
  9. chore: Cleanup tests

    Signed-off-by: Yuhan Ruan <[email protected]>
    AndyUB committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    09c6709 View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2024

  1. chore: Code review

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    b8d1891 View commit details
    Browse the repository at this point in the history
  2. chore: Simplify tests

    Signed-off-by: Yuhan Ruan <[email protected]>
    AndyUB committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    b3770a6 View commit details
    Browse the repository at this point in the history
  3. merge: Upstream

    Signed-off-by: Yuhan Ruan <[email protected]>
    AndyUB committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    c249ec3 View commit details
    Browse the repository at this point in the history
  4. chore: Polish tests

    Signed-off-by: Yuhan Ruan <[email protected]>
    AndyUB committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    ff7f720 View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2024

  1. Merge pull request #15 from AndyUB/test-1017

    Move Deduplicate P2P & Collective
    dengwxn authored Oct 20, 2024
    Configuration menu
    Copy the full SHA
    d8c85fb View commit details
    Browse the repository at this point in the history
  2. refactor: Polish tests

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    0486914 View commit details
    Browse the repository at this point in the history
  3. chore: Format

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    6d0db72 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    2d59839 View commit details
    Browse the repository at this point in the history
  5. test: Mock gpus

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    860139c View commit details
    Browse the repository at this point in the history
  6. merge: Upstream branch

    Signed-off-by: Weixin Deng <[email protected]>
    dengwxn committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    7df480f View commit details
    Browse the repository at this point in the history