Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Core] Pipeline Parallel Support #4412

Merged
merged 6 commits into from
Jul 2, 2024
Merged

[Core] Pipeline Parallel Support #4412

merged 6 commits into from
Jul 2, 2024

Commits on Jul 2, 2024

  1. Pipeline Parallelism 

    Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
    @andoorve
    andoorve committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    c85cde4 View commit details
    Browse the repository at this point in the history

  2. Make scheduler use pipeline parallel size directly 

    Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
    @andoorve
    andoorve committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    beba5ed View commit details
    Browse the repository at this point in the history

  3. Change ABC defaults for prepare_model_input 

    Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
    @andoorve
    andoorve committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    6fd17a3 View commit details
    Browse the repository at this point in the history

  4. Add basic comm ops tests with TP and PP. 

    Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
    @andoorve
    andoorve committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    ef62774 View commit details
    Browse the repository at this point in the history

  5. Fix phi3v for test 

    Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
    @andoorve
    andoorve committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    d9257a2 View commit details
    Browse the repository at this point in the history

  6. Address Nick nits and fix CUDAGraph correctness 

    Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
    @andoorve
    andoorve committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    f9351fb View commit details
    Browse the repository at this point in the history