Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

storage: shrink index vectors on flush #9904

Merged
merged 1 commit into from
Apr 10, 2023

Conversation

jcsp
Copy link
Contributor

@jcsp jcsp commented Apr 6, 2023

This saves up to 24kib of memory per index, where
a segment is closed with very few entries in its index.

Related: #9375

Backports Required

  • none - not a bug fix
  • none - this is a backport
  • none - issue does not exist in previous branches
  • none - papercut/not impactful enough to backport
  • v23.1.x
  • v22.3.x
  • v22.2.x

Release Notes

Improvements

  • Reduced memory consumption on configurations with very large numbers of small segments.

This saves up to 24kib of memory per index, where
a segment is closed with very few entries in its index.

Related: redpanda-data#9375
Copy link
Member

@dotnwat dotnwat left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice

@dotnwat dotnwat merged commit 671984a into redpanda-data:dev Apr 10, 2023
@emaxerrno
Copy link
Contributor

this is nice!

@vshtokman
Copy link
Contributor

@jcsp , do we need to backport? Also, should the backports go into the next minor release?

@jcsp
Copy link
Contributor Author

jcsp commented Apr 11, 2023

/backport v23.1.x

@jcsp
Copy link
Contributor Author

jcsp commented Apr 11, 2023

/backport v22.3.x

@jcsp jcsp deleted the issue-9375-trim-indices branch April 11, 2023 14:39
@vbotbuildovich
Copy link
Collaborator

Failed to run cherry-pick command. I executed the below command:

git cherry-pick -x f5e6b57c45c9ca58a612ad045f3eeaf385069898

Workflow run logs.

@vbotbuildovich
Copy link
Collaborator

Failed to run cherry-pick command. I executed the below command:

git cherry-pick -x f5e6b57c45c9ca58a612ad045f3eeaf385069898

Workflow run logs.

@jcsp
Copy link
Contributor Author

jcsp commented Apr 11, 2023

Will backport manually

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants