🔨 Move chart configs into chart_configs table

[Marigold]

TODO

• Update ORM
• Update all queries with strings from charts and join charts
• Check all usages of type and slug in queries

TODO before merging

• Check that ORM is up to date with MySQL schema

Testing

• Test chart-diff
• Test upserts to MySQL in ETL

[Marigold]

@sophiamersmann this is ready for review (though not tested properly, yet). Let me know when you're ready or when you change schema.

[sophiamersmann]

@Marigold the grapher pr also needs to go through review first (and I need to do another round of testing), so it won't be before next week :)

[owidbot]

Quick links (staging server):

Site	Admin	Wizard

Login: ssh owid@staging-site-db-chart-configs

chart-diff: ✅

No charts for review.

data-diff: ❌ Found differences

= Dataset garden/artificial_intelligence/2024-08-05/epoch_aggregates_affiliation
  = Table epoch_aggregates_affiliation
    ~ Column cumulative_count (changed metadata)
-       -   Describes the sector where the authors of a notable AI system have their primary affiliations. The 2024 data is incomplete and was last updated 05 August 2024.
        ?                                                                                                                                                   ^^^^^^^^
+       +   Describes the sector where the authors of a notable AI system have their primary affiliations. The 2024 data is incomplete and was last updated 2 September 2024.
        ?                                                                                                                                                   ^^^^^ +++++
    ~ Column yearly_count (changed metadata)
-       -   Describes the sector where the authors of a notable AI system have their primary affiliations. The 2024 data is incomplete and was last updated 05 August 2024.
        ?                                                                                                                                                   ^^^^^^^^
+       +   Describes the sector where the authors of a notable AI system have their primary affiliations. The 2024 data is incomplete and was last updated 2 September 2024.
        ?                                                                                                                                                   ^^^^^ +++++


Legend: +New  ~Modified  -Removed  =Identical  Details
Hint: Run this locally with etl diff REMOTE data/ --include yourdataset --verbose --snippet

Automatically updated datasets matching weekly_wildfires|excess_mortality|covid|fluid|flunet|country_profile|garden/ihme_gbd/2019/gbd_risk are not included

Edited: 2024-09-03 06:50:58 UTC
Execution time: 12.39 seconds

[sophiamersmann]

Hey @Marigold, the chart_configs PR on the Grapher side should be ready to merge soon-ish (this or next week). How do things look on the ETL side? (I'd be happy to look over this PR if you want me to)

[Marigold]

@sophiamersmann all look good, both schema renames and calling Admin endpoint. Ready whenever you are!