Upgrade Dockerfile to 3.11

[dbeatty10]

Originally posted by @jelstongreen in #6147 (comment)

Folks the Dockerfile is currently pinned to 3.10 due to a bug - any plans to upgrade to 3.11?

Acceptance criteria

• The Dockerfile is using 3.11
• Notify [chore][python] upgrade python to latest LTS apache/incubator-devlake#6918 that the Dockerfile has been updated to 3.11

Implementation

Reverse #8445 to restore python:3.11.

Additional information

Since the Dockerfile was refactored within #4487, the version of the build platform has mostly been bumped by dependabot:

• Bump python from 3.11.1-slim-bullseye to 3.11.2-slim-bullseye in /docker #7196
• Bump python from 3.10.7-slim-bullseye to 3.11.1-slim-bullseye in /docker #6424
• Bump python from 3.10.7-slim-bullseye to 3.11.0-slim-bullseye in /docker #6180
• Bump python from 3.10.6-slim-bullseye to 3.10.7-slim-bullseye in /docker #5805
• Bump python from 3.10.5-slim-bullseye to 3.10.6-slim-bullseye in /docker #5623
• Bump python from 3.10.3-slim-bullseye to 3.10.5-slim-bullseye in /docker #5367
• [Snyk] Security upgrade python from 3.9.9-slim-bullseye to 3.10.3-slim-bullseye #4963

The two exceptions were manual reverts of version bumps:

• revert python version for docker images #8445
• Revert "Bump python from 3.10.7-slim-bullseye to 3.11.0-slim-bullseye in /docker" #6281

3.12

There are a couple issues in-flight to support Python 3.12:

• [Python 3.12] Support + test against python 3.12 in dbt-semantic-interfaces dbt-semantic-interfaces#257
• [CT-3325] [Tech Debt][Spike+] Test dbt-core with Python 3.12 #9007

[dbeatty10]

Thanks for raising this @jelstongreen !

As you noted, the current blocker to upgrading the Dockerfile in dbt-core to use python 3.11 is that dbt-spark is not currently compatible with python 3.11. This is covered by dbt-labs/dbt-spark#864.

So I just asked about it here: dbt-labs/dbt-spark#864 (comment)

[dbeatty10]

Since this is resolved, restoring python:3.11 by reversing #8445 should be un-blocked:

• [ADAP-789] [Feature] Upgrade PyHive to support Python 3.11 dbt-spark#864