Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

gsutil in-place GCS bucket compression feature #1679

Open
RahulDubey391 opened this issue Mar 4, 2023 · 0 comments
Open

gsutil in-place GCS bucket compression feature #1679

RahulDubey391 opened this issue Mar 4, 2023 · 0 comments

Comments

@RahulDubey391
Copy link

Requesting a new feature!!

Problem Statement:
gsutil lacks a feature to allow in-place compression for same bucket.

For example, if you have a bucket named 'test-bucket' and you want to compress large amount of data in the same bucket, you either have to download or transfer the data out of the bucket to some other services in GCP like VM Instance's File System or local system, then fire up the gsutil command to upload the same data to bucket, you have apply the '-z/Z' argument for compression.

Or worst case, you have to implement a pipeline for bulk compression like with Data Flow Service in GCP or custom program.

It could be possible that I am not aware of any such functionality but if there isn't none, would like to work on creating such feature based on suggestions.

Thanks!!!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant