Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ObjectStore] MultipartUpload::complete fails on WSL when writing to /mnt/ #6423

Open
madesroches opened this issue Sep 19, 2024 · 1 comment
Labels

Comments

@madesroches
Copy link

madesroches commented Sep 19, 2024

Describe the bug
Using LocalFileSystem on WSL + BufWriter I get the following error:
file.metadata() fails after std::fs::rename with FileNotFound but is reported as an aborted upload

To Reproduce
Use object_store::buffered::BufWriter to write a big enough file to the windows filesystem when running though WSL.

Expected behavior
File write succeeds.

Additional context
Using object_store-0.11.0.
Our services are actually writing to S3, but the local dev environment writes to the local filesystem. I could not reproduce the bug when writing to the linux filesystem, but it happens every time I write a 50MB+ file to the windows file system with the exe running on the linux side.

@tustvold
Copy link
Contributor

Possibly related to #5094

My guess is that the WSL bind mounts don't quite match standard filesystem semantics, much like blobfuse, and so issues like this arise. It may be that a similar workaround to #5094 is possible for multipart uploads. An interesting data point might be to confirm that this always occurs with the multipart codepath, e.g. by using ObjectStore::put_multipart manually.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants