[AO][Inductor] Enable WOQ fusion pattern with permute

[leslie-fang-intel]

Stack from ghstack (oldest at bottom):

• -> [AO][Inductor] Enable WOQ fusion pattern with permute #135928

Summary
Fix #135831 and pytorch/ao#890. The root cause of the numerical failure was that the customized woq-int8 kernel was not triggered due to changes in the pattern. After re-adding the fusion pattern, the accuracy check now passes. I will open a separate TorchAO PR to enable these unit tests in TorchAO.

Test Plan

python test/inductor/test_mkldnn_pattern_matcher.py -k test_woq_int8

cc @voznesenskym @penguinwu @EikanWang @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @wenzhe-nrv @jiayisunx @ipiszy @yf225 @chenyang78 @kadeng @muchulee8 @ColinPeppler @amjames @desertfire @chauhang

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/135928

• 📄 Preview Python docs built from this PR
• 📄 Preview C++ docs built from this PR
• ❓ Need help or want to give feedback on the CI? Visit the bot commands wiki or our office hours

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• High MacOS queue

✅ No Failures

As of commit 335c2fb with merge base failed to retrieve merge base, please contact dev infra:
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[leslie-fang-intel]

cc @Valentine233 @Xia-Weiwen we also need to audit of the WOQ patterns in current lowering passes to check if they are still needed.

[leslie-fang-intel]

Adding the TorchAO PR: pytorch/ao#884

[leslie-fang-intel]

Hi @bdhirsh @jerryzh168, could you help to take a look of this PR? It should resolve the TorchAO CPU woq int8 UT numerical issue.

[bdhirsh]

@eellison who would be a good person to review the inductor bits?

[leslie-fang-intel]

@pytorchbot merge

[pytorchmergebot]

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging

Check the merge workflow status
here