[inductor] Check if n is the input tensor of conv_pointwise (#125119)

Fix #124837.
Check whether n is the input tensor of convolution_pointwise or qconv2d_pointwise, if so freeze the layout to channels_last.

Pull Request resolved: #125119
Approved by: https://github.com/leslie-fang-intel, https://github.com/jansel

torch/_inductor/graph.py

@@ -1313,7 +1313,10 @@ def debug(msg):
                                 ir.get_stride_order(n.meta["val"].stride()),
                                 allow_padding=True,
                             )
-                        if user.target in need_fixed_channels_last_layout:
+                        if (
+                            user.target in need_fixed_channels_last_layout
+                            and n is user.args[0]
+                        ):
                             result = ir.ExternKernel.require_stride_order(
                                 result,
                                 ir.get_stride_order(