Apple Silicon support for tensorflow-transform not available as tfx-bsl does not support it?

[oonisim]

As in Any plans to support Apple silicon devices like M1 Macs? #48, tfx-bsl has the issue open for Apple Silicon.

Does this mean tensorflow transform does not work on Apple Silicon?

[gaikwadrahul8]

Hi, @oonisim

Apologize for the delayed response and As far as I know TFX and it's supported libraries like tensorflow-transform does not support for Apple Mac M1 and M2 at the moment and We are currently working on Apple Mac M1, M2 support, and will have an update in the fairly near future. In the meantime, Other option include using a VM. We understand that option is not ideal.

We don’t have a firm ETA yet. As similar issues are already being tracked #1864 , #48 and TF Forum thread so I would request you to please follow the same issues or TF-Forum thread to get latest updates on this issue and close this issue. Thank You!

For your reference I have added error log output below and I tested with 3 different versions including latest version for tensorflow-transform==1.12.0 on Apple M1 Mac :

(tf-macos-2.11) gaikwadrahul-macbookpro:~ gaikwadrahul$ pip install tensorflow-transform==1.12.0
Collecting tensorflow-transform==1.12.0
  Downloading tensorflow_transform-1.12.0-py3-none-any.whl (439 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 439.8/439.8 kB 6.6 MB/s eta 0:00:00
Requirement already satisfied: absl-py<2.0.0,>=0.9 in ./miniconda/envs/tf-macos-2.11/lib/python3.8/site-packages (from tensorflow-transform==1.12.0) (1.4.0)
Collecting apache-beam[gcp]<3,>=2.41
  Downloading apache-beam-2.46.0.zip (3.1 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.1/3.1 MB 3.4 MB/s eta 0:00:00
  Preparing metadata (setup.py) ... done
Collecting tensorflow-metadata<1.13.0,>=1.12.0
  Using cached tensorflow_metadata-1.12.0-py3-none-any.whl (52 kB)
Collecting pydot<2,>=1.2
  Downloading pydot-1.4.2-py2.py3-none-any.whl (21 kB)
Collecting pyarrow<7,>=6
  Downloading pyarrow-6.0.1-cp38-cp38-macosx_11_0_arm64.whl (13.7 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13.7/13.7 MB 3.2 MB/s eta 0:00:00
Requirement already satisfied: protobuf<4,>=3.13 in ./miniconda/envs/tf-macos-2.11/lib/python3.8/site-packages (from tensorflow-transform==1.12.0) (3.19.6)
ERROR: Ignored the following versions that require a different python version: 0.11.0 Requires-Python >=2.7,<3; 0.12.0 Requires-Python >=2.7,<3; 0.5.0 Requires-Python >=2.7,<3; 0.6.0 Requires-Python >=2.7,<3; 0.6.0 Requires-Python >=2.7,<=3.7; 0.8.0 Requires-Python >=2.7,<3; 0.9.0 Requires-Python >=2.7,<3; 0.9.0 Requires-Python >=2.7,<=3.7; 2.10.0 Requires-Python >=2.7,<3.0; 2.3.0 Requires-Python >=2.7,<3.0; 2.4.0 Requires-Python >=2.7,<3.0; 2.5.0 Requires-Python >=2.7,<3.0; 2.6.0 Requires-Python >=2.7,<3.0; 2.7.0 Requires-Python >=2.7,<3.0; 2.8.0 Requires-Python >=2.7,<3.0; 2.9.0 Requires-Python >=2.7,<3.0
ERROR: Could not find a version that satisfies the requirement tensorflow<2.12,>=2.11.0 (from tensorflow-transform) (from versions: none)
ERROR: No matching distribution found for tensorflow<2.12,>=2.11.0
(tf-macos-2.11) gaikwadrahul-macbookpro:~ gaikwadrahul$ pip install tensorflow-transform==1.11.0
Collecting tensorflow-transform==1.11.0
  Using cached tensorflow_transform-1.11.0-py3-none-any.whl (446 kB)
Collecting apache-beam[gcp]<3,>=2.41
  Using cached apache-beam-2.46.0.zip (3.1 MB)
  Preparing metadata (setup.py) ... done
Requirement already satisfied: protobuf<4,>=3.13 in ./miniconda/envs/tf-macos-2.11/lib/python3.8/site-packages (from tensorflow-transform==1.11.0) (3.19.6)
Collecting tensorflow-metadata<1.12.0,>=1.11.0
  Using cached tensorflow_metadata-1.11.0-py3-none-any.whl (52 kB)
Requirement already satisfied: absl-py<2.0.0,>=0.9 in ./miniconda/envs/tf-macos-2.11/lib/python3.8/site-packages (from tensorflow-transform==1.11.0) (1.4.0)
Requirement already satisfied: numpy<2,>=1.16 in ./miniconda/envs/tf-macos-2.11/lib/python3.8/site-packages (from tensorflow-transform==1.11.0) (1.22.3)
ERROR: Ignored the following versions that require a different python version: 0.11.0 Requires-Python >=2.7,<3; 0.12.0 Requires-Python >=2.7,<3; 0.5.0 Requires-Python >=2.7,<3; 0.6.0 Requires-Python >=2.7,<3; 0.6.0 Requires-Python >=2.7,<=3.7; 0.8.0 Requires-Python >=2.7,<3; 0.9.0 Requires-Python >=2.7,<3; 0.9.0 Requires-Python >=2.7,<=3.7; 2.10.0 Requires-Python >=2.7,<3.0; 2.3.0 Requires-Python >=2.7,<3.0; 2.4.0 Requires-Python >=2.7,<3.0; 2.5.0 Requires-Python >=2.7,<3.0; 2.6.0 Requires-Python >=2.7,<3.0; 2.7.0 Requires-Python >=2.7,<3.0; 2.8.0 Requires-Python >=2.7,<3.0; 2.9.0 Requires-Python >=2.7,<3.0
ERROR: Could not find a version that satisfies the requirement tensorflow!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,!=2.9.*,<2.11,>=1.15.5 (from tensorflow-transform) (from versions: none)
ERROR: No matching distribution found for tensorflow!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,!=2.9.*,<2.11,>=1.15.5
(tf-macos-2.11) gaikwadrahul-macbookpro:~ gaikwadrahul$ pip install tensorflow-transform==1.10.1
Collecting tensorflow-transform==1.10.1
  Using cached tensorflow_transform-1.10.1-py3-none-any.whl (439 kB)
Requirement already satisfied: numpy<2,>=1.16 in ./miniconda/envs/tf-macos-2.11/lib/python3.8/site-packages (from tensorflow-transform==1.10.1) (1.22.3)
ERROR: Ignored the following versions that require a different python version: 0.11.0 Requires-Python >=2.7,<3; 0.12.0 Requires-Python >=2.7,<3; 0.5.0 Requires-Python >=2.7,<3; 0.6.0 Requires-Python >=2.7,<3; 0.8.0 Requires-Python >=2.7,<3; 0.9.0 Requires-Python >=2.7,<3
ERROR: Could not find a version that satisfies the requirement tensorflow!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,<2.10,>=1.15.5 (from tensorflow-transform) (from versions: none)
ERROR: No matching distribution found for tensorflow!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,<2.10,>=1.15.5
(tf-macos-2.11) gaikwadrahul-macbookpro:~ gaikwadrahul$ 

[oonisim]

@gaikwadrahul8 , thanks for the update. Appreciate it.

[Cunoo]

Thanks ! i'll just leave comment here