-
Notifications
You must be signed in to change notification settings - Fork 18
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add JRC-IDEES data processing pipeline #133
Add JRC-IDEES data processing pipeline #133
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Only very few comments about functionality, but a lot about structuring the code and readability.
I still think readability is important here. These kinds of data processing scripts are in most cases super difficult to read but structure and descriptions can ease the pain to some degree. You may not agree with all my comments and that's fine of course.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just a few more minor changes.
Need to fix some bugs found on running the script before it's ready. |
First step to fixing #17 & #102 and blocking #119.
Now that the JRC IDEES database is available via FTP, we can roll the processing of the data into Euro-Calliope. This allows the transport, industry, and tertiary (commercial) sector data to be processed for the components that we need down the line. The processing takes the largely machine-unreadable data from JRC-IDEES and turns into tidy dataframes for use elsewhere.
Checklist
Any checks which are not relevant to the PR can be pre-checked by the PR creator. All others should be checked by the reviewer. You can add extra checklist items here if required by the PR.