Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[RLlib; Offline RL] Enable GPU and multi-GPU training for offline algorithms. #47929

Open
wants to merge 13 commits into
base: master
Choose a base branch
from
Open

[RLlib; Offline RL] Enable GPU and multi-GPU training for offline algorithms. #47929

wants to merge 13 commits into from

Commits on Oct 8, 2024

  1. Enabled GPU and multi-GPU training for offline algorithms and induced… 

    … a couple more simplifications. Tuned offline examples to the new settings.

Signed-off-by: simonsays1980 <[email protected]>
    @simonsays1980
    simonsays1980 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    fa6f6f8 View commit details
    Browse the repository at this point in the history

  2. Added gpu tests for offline algorithms. 

    Signed-off-by: simonsays1980 <[email protected]>
    @simonsays1980
    simonsays1980 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    a7c2335 View commit details
    Browse the repository at this point in the history

  3. Some minor changes in docstrings. 

    Signed-off-by: simonsays1980 <[email protected]>
    @simonsays1980
    simonsays1980 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    bd322ba View commit details
    Browse the repository at this point in the history

  4. Fixed some minor bugs in setup of 'OfflineLearner' and 'OfflinePreLea… 

    …rner'. Removed 'NumpyToTensor' connector from learner connector prior to 'OfflinePreLearner'.

Signed-off-by: simonsays1980 <[email protected]>
    @simonsays1980
    simonsays1980 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    c612eea View commit details
    Browse the repository at this point in the history

  5. Fixed a couple of small nits in 'test_marwil' due to changes in learn… 

    …er connector.

Signed-off-by: simonsays1980 <[email protected]>
    @simonsays1980
    simonsays1980 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    a4a0f77 View commit details
    Browse the repository at this point in the history

  6. Apply suggestions from code review 

    Signed-off-by: Sven Mika <[email protected]>
    @sven1977
    sven1977 authored Oct 8, 2024
    Configuration menu
    Copy the full SHA
    21039a8 View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2024

  1. Merge branch 'master' into offline-enable-gpu-training

    @simonsays1980
    simonsays1980 committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    f320c66 View commit details
    Browse the repository at this point in the history

  2. Added extra CPU to offline GPU tests because tests were failing due t… 

    …o resources not avilable.

Signed-off-by: simonsays1980 <[email protected]>
    @simonsays1980
    simonsays1980 committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    5dcd344 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'offline-enable-gpu-training' of github.com:simonsays198… 

    …0/ray into offline-enable-gpu-training
    @simonsays1980
    simonsays1980 committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    ec4d65c View commit details
    Browse the repository at this point in the history

  4. Fixed 'OfflinePreLearner' tests. 

    Signed-off-by: simonsays1980 <[email protected]>
    @simonsays1980
    simonsays1980 committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    bba1346 View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2024

  1. Added extra logging information for 'OfflineData'. 

    Signed-off-by: simonsays1980 <[email protected]>
    @simonsays1980
    simonsays1980 committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    ed6c7c1 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2024

  1. Merged Master 

    Signed-off-by: simonsays1980 <[email protected]>
    @simonsays1980
    simonsays1980 committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    ed170bf View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2024

  1. Merge branch 'master' into offline-enable-gpu-training

    @simonsays1980
    simonsays1980 committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    348589b View commit details
    Browse the repository at this point in the history