Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Reassign topics uniformly after partition is added #9622

Merged
merged 5 commits into from
Mar 31, 2023
Merged

Reassign topics uniformly after partition is added #9622

merged 5 commits into from
Mar 31, 2023

Commits on Mar 30, 2023

  1. c/allocator: add const state accessor 

    Signed-off-by: Michal Maslanka <michal@redpanda.com>
    @mmaslankaprv
    mmaslankaprv committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    fd7caa8 View commit details
    Browse the repository at this point in the history

  2. c/members_backend: extracted some const methods to static functions 

    Signed-off-by: Michal Maslanka <michal@redpanda.com>
    @mmaslankaprv
    mmaslankaprv committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    a308539 View commit details
    Browse the repository at this point in the history

  3. c/members_backend: introduced reallocation strategy 

    Introduced a reallation strategy type to make reallocation code testable
and customizable outside of the members backend.

Signed-off-by: Michal Maslanka <michal@redpanda.com>
    @mmaslankaprv
    mmaslankaprv committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    d5716ab View commit details
    Browse the repository at this point in the history

Commits on Mar 31, 2023

  1. c/tests: added backend reallocation strategy test 

    Added simple test validating correctness of backend reallcation
strategy.

Signed-off-by: Michal Maslanka <michal@redpanda.com>
    @mmaslankaprv
    mmaslankaprv committed Mar 31, 2023
    Configuration menu
    Copy the full SHA
    7059fd1 View commit details
    Browse the repository at this point in the history

  2. c/members_backend: use reservoir sampling to chose replicas to move 

    Using reservoir sampling to chose the replicas that are going to be
reallocated to the new node provides better uniformity of topic replicas
distribution across the cluster. Additionally reservoir sampling
algorithm isn't prone to not selecting enough reallocations.

Signed-off-by: Michal Maslanka <michal@redpanda.com>
    @mmaslankaprv
    mmaslankaprv committed Mar 31, 2023
    Configuration menu
    Copy the full SHA
    d2456cc View commit details
    Browse the repository at this point in the history