Feature: Add concurrent library to ParallelComputingInterface #667
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Feature: add
concurrent
to ParallelComputingInterface classThis PR adds the ability to use the
concurrent
library for parallel computing.concurrent
is an alternative to themultiprocessing
library that is deemed to be more reliable at times, e..g, see the comments in https://stackoverflow.com/questions/20776189/concurrent-futures-vs-multiprocessing-in-python-3.Related issue
No official issues reported. I have personally experienced some time-out issues with
multiprocessing
and its interaction withstreamlit
. Workers may time out due to local errors but that never escalates back up to the main process, and therefore a job may hang forever. Supposedlyconcurrent
is better at handling this.Impacted areas of the software
Parallel Computing Interface.
Additional supporting information
N/A
Test results, if applicable
The yaw optimization in
12_optimize_yaw_in_parallel.py
withinterface = "multiprocessing"
reports:with
interface = "concurrent"
I find generally a slight improvement in computation time: