Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reduce Bloom Filter Sizes #139

Closed
joe-elliott opened this issue Aug 6, 2020 · 0 comments · Fixed by #192
Closed

Reduce Bloom Filter Sizes #139

joe-elliott opened this issue Aug 6, 2020 · 0 comments · Fixed by #192
Assignees

Comments

@joe-elliott
Copy link
Member

Bloom filters can be multiple MBs, result in our largest GCS accesses and will be difficult to cache.

Review options for bitmap compression. This came up recently:
http://roaringbitmap.org/about/

Review options and consider things like compression ratio and ability to retrieve in a paged manner: #32.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants