-
Notifications
You must be signed in to change notification settings - Fork 5
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add mover/copy stage #67
Conversation
Ok some of the jobs (example) fail with
what is the best way to get gustil on the runner? @yuvipanda @cisaacstern If that is hard I might consider using the beam IO module... but would be nice if this simple stage would work... |
Lets see if adding |
So I am running into this issue when calling gusti via subprocess.run:
So we do not have the right permissions. How is access actually set within a Ptransform? Wondering if @yuvipanda or @cisaacstern have an idea here. Quick summary: I just want to copy the zarr store from a given path to another within a Ptransform |
Ok so using |
Towards #33 and will help keeping the ultimate target store 'clean' as in there will be no empty or half-written stores.