llvm
/
torch-mlir
mirror of https://github.com/llvm/torch-mlir
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
torch-mlir/projects/pt1/e2e_testing/xfail_sets.py

2544 lines
99 KiB
Python
Raw Normal View History

Dual license the torch-mlir project. This commit (with approval from all contributors) dual licenses the torch-mlir project under both the standard LLVM license and the standard PyTorch license. This will facilitate moving code between torch-mlir and the two upstream projects. The standard file comment is now: ``` // This file is licensed under the Apache License v2.0 with LLVM Exceptions. // See https://llvm.org/LICENSE.txt for license information. // SPDX-License-Identifier: Apache-2.0 WITH LLVM-exception // Also available under a BSD-style license. See LICENSE. ``` See `LICENSE` in the project root for the terms of both licenses.
2021-09-30 00:03:40 +08:00
# Part of the LLVM Project, under the Apache License v2.0 with LLVM Exceptions.
# See https://llvm.org/LICENSE.txt for license information.
# SPDX-License-Identifier: Apache-2.0 WITH LLVM-exception
# Also available under a BSD-style license. See LICENSE.
Add IREE support in TorchScript e2e tests. - Add support for "expected failures" in test reporting. The new error reports look like [this](https://gist.github.com/silvasean/6ffd95e1d55302b699673da201da210d). - We will now be able to put these tests into CI, since the harness understand which tests are expected to pass and fail. - Refactor RefBackendTestConfig to NpcompBackendTestConfig which supports both RefBackend and IREE. - Add instructions for installing IREE dependencies (both from packages and for local builds of IREE) - Add `tools/torchscript_e2e_test.sh` for invoking the e2e test harness (this makes invoking a bit easier, as it doesn't rely on a loose Python invocation).
2021-07-01 05:13:21 +08:00
# This file describes the sets of tests expected to fail for each config.
# This information is deliberately kept in a side table, rather than
# in-situ on the test, as a deliberate layering decision: tests should
# have unique keys to identify them and enable side tables of various kinds
# (this includes down into lower parts of the stack, where a side table
# might be used to keep more elaborate sets of testing configurations).
Move COMMON_TORCH_MLIR_LOWERING_XFAILS into test_suite That way, downstreams don't have to duplicate this list. Also, remove "external config" feature, since it is subsumed by just importing the test suite.
2022-04-20 03:35:56 +08:00
from torch_mlir_e2e_test.test_suite import COMMON_TORCH_MLIR_LOWERING_XFAILS
Add make_fx_tosa variant to end2end tests (#2240) * Add make_fx_tosa variant to end2end tests * e2e_testing/xfail_sets.py: Add make_fx_tosa xfail for stable
2023-07-13 21:07:54 +08:00
from torch_mlir._version import torch_version_for_comparison, version
Move COMMON_TORCH_MLIR_LOWERING_XFAILS into test_suite That way, downstreams don't have to duplicate this list. Also, remove "external config" feature, since it is subsumed by just importing the test suite.
2022-04-20 03:35:56 +08:00
Advance llvm-project and stablehlo. (#2619) llvm-project: bbd2b08b95fe76bea138c1b03c1cd42ed3ee04df stablehlo: ab709fe48de88c67717abfbd7ef17425eb95ddaf These commits were chosen in order to account for an MLIR API break from https://github.com/llvm/llvm-project/commit/3dbac2c007c114a720300d2a4d79abe9ca1351e7 which required a patch to stablehlo. We integrate a bit beyond that commit to deal with some revert/reapply cycles in the intervening range which were discovered in another downstream. Further, it requires adaptation to the stablehlo API breaks introduced from https://github.com/openxla/stablehlo/pull/1872 which are along for the ride. Since some stablehlo builders were changed to directly take int64_t array refs, also traced that up some call stacks to eliminate some signed/unsigned mismatches that result. Also adds a few TOSA tests to the passing set that seem to work now.
2023-12-08 15:13:42 +08:00
print(f"TORCH_VERSION_FOR_COMPARISON =", torch_version_for_comparison())
[TOSA] Fix conversion for depthwise convolutions (#2398) * [TOSA] Fix conversion for depthwise convolutions * Add e2e tests for depthwise and grouped convolutions Co-authored-by: Lucas Camphausen <lucas.camphausen@iml.fraunhofer.de>
2023-08-18 23:15:54 +08:00
LINALG_XFAIL_SET = COMMON_TORCH_MLIR_LOWERING_XFAILS | {
# Lowering Torch Backend IR -> Linalg-on-Tensors Backend IR failed
# 'linalg.depthwise_conv_2d_nchw_chw' op inferred input/output operand #1 has shape's dimension #0 to be 4, but found 8
[Torch Dialect][stablehlo] emit aten.rand op and add converter to stablehlo (#2413) * [Torch Dialect] emit aten.rand op and add converter to stablehlo * add failed tests for torchdynamo backend * add failed test for linalg backend
2023-08-27 21:56:36 +08:00
"Conv2dWithPaddingDilationStrideStaticModule_depthwise_multiplier",
Add aten.isclose support and its torch-to-tosa lowering (#2512) Add aten.isclose op Add its torch-to-tosa lowering Update the TorchToTosa/basic.mlir tests To test e2e tosa lowering: `python -m e2e_testing.main -v -c=tosa` --------- Co-authored-by: Ze Zhang <ze.zhang@getcruise.com>
2023-10-17 00:44:53 +08:00
"IscloseStaticModule_basic",
[torch] Add support for `torch.split_with_sizes` via decompose (#2979) Convert to individiual slices and tuple together as a list. --------- Co-authored-by: Scott Todd <scott.todd0@gmail.com>
2024-03-06 07:01:21 +08:00
"IscloseStaticModuleTrue_basic",
"SplitWithSizes_Module_basic",
[TOSA] Fix conversion for depthwise convolutions (#2398) * [TOSA] Fix conversion for depthwise convolutions * Add e2e tests for depthwise and grouped convolutions Co-authored-by: Lucas Camphausen <lucas.camphausen@iml.fraunhofer.de>
2023-08-18 23:15:54 +08:00
}
E2E framework: Add support for list/dict/scalar values Most of the change is in the reporting code to give error messages that are useful, and adjusting TraceItem to be semantically correct w.r.t. Python's modeling of return values. This allows writing a test like `ListLiteralModule_basic` for list functionality, which we will soon be hooking up to IREE. The IR for that test currently gets this far: ``` builtin.func @forward(%arg0: f64) -> !torch.list<!torch.float> { %0 = torch.from_f64 %arg0 %1 = torch.prim.ListConstruct %0, %0 : (!torch.float, !torch.float) -> !torch.list<!torch.float> return %1 : !torch.list<!torch.float> } ``` It should be sufficient to just add a conversion of `torch.prim.ListConstruct` (+ relevant type conversion) to necessary IREE primitives. For lists of *tensors* (rather than scalar floats), it gets more complicated, as we need to deal with changing their element type to ValueTensorType first (by default, they will all be NonValueTensorType). It seems that IREE might have a type we can lower into for non-value tensors as well, TBD.
2021-08-11 07:10:31 +08:00
[torchdynamo] Initial TorchDynamo support This adds a basic e2e Config for TorchDynamo using Linalg-on-Tensors/RefBackend. But TorchDynamo is pretty orthogonal to various other pieces, so it should compose nicely with variations like: - Switching out all the backends (Linalg-on-Tensors, TOSA, MHLO) - PyTorch functionalization and decompositions - Taking the example inputs and compiling with all dynamic or all static shapes without duplicating tests. This adds it to the CI, but there are still a lot of XFAIL's. This also adds a helper `from torch_mlir.dynamo import make_simple_dynamo_backend` which simplifies some of the steps for making a Torch-MLIR-based TorchDynamo backend. We include "simple" in the name because we are going to be exploring various things next from the long-term roadmap. The next steps are: - Burn down all the XFAIL's. - Start working on the pieces from the [long-term roadmap](https://github.com/llvm/torch-mlir/blob/main/docs/long_term_roadmap.md). - Add functionalization/decompositions into the TorchDynamo flow and remove reliance on the current Torch-MLIR "frontend". - Write a pure-Python direct FX->MLIR importer. - Hook up the new PyTorch symbolic shape stuff. - Explore PrimTorch decompositions for simplifying backends.
2022-11-18 20:21:19 +08:00
TORCHDYNAMO_XFAIL_SET = {
#### General TorchDynamo/PyTorch errors
[torch] Add folders for `torch.fill`, `torch.ones`, `torch.zeros` and `aten.getItem` (#2849) So that the CumSum Op in OPT can get the constant that it requires to be lowered to TMTensor --------- Co-authored-by: Rob Suderman <rob.suderman@gmail.com> Co-authored-by: Xida Ren <xida.ren.dev@gmail.com>
2024-02-03 02:46:33 +08:00
# torch._dynamo.exc.Unsupported: Tensor.item
"CumsumModule_basic",
[torchdynamo] Initial TorchDynamo support This adds a basic e2e Config for TorchDynamo using Linalg-on-Tensors/RefBackend. But TorchDynamo is pretty orthogonal to various other pieces, so it should compose nicely with variations like: - Switching out all the backends (Linalg-on-Tensors, TOSA, MHLO) - PyTorch functionalization and decompositions - Taking the example inputs and compiling with all dynamic or all static shapes without duplicating tests. This adds it to the CI, but there are still a lot of XFAIL's. This also adds a helper `from torch_mlir.dynamo import make_simple_dynamo_backend` which simplifies some of the steps for making a Torch-MLIR-based TorchDynamo backend. We include "simple" in the name because we are going to be exploring various things next from the long-term roadmap. The next steps are: - Burn down all the XFAIL's. - Start working on the pieces from the [long-term roadmap](https://github.com/llvm/torch-mlir/blob/main/docs/long_term_roadmap.md). - Add functionalization/decompositions into the TorchDynamo flow and remove reliance on the current Torch-MLIR "frontend". - Write a pure-Python direct FX->MLIR importer. - Hook up the new PyTorch symbolic shape stuff. - Explore PrimTorch decompositions for simplifying backends.
2022-11-18 20:21:19 +08:00
# TypeError: new_empty(): argument 'size' (position 1) must be tuple of ints, but found element of type NoneType at pos 0
# RuntimeError: Failed running call_function aten.convolution_backward(...
[torchdynamo] Update XFAIL sets with upstream bug numbers.
2022-11-24 22:36:13 +08:00
# https://github.com/pytorch/pytorch/issues/89629
[torchdynamo] Initial TorchDynamo support This adds a basic e2e Config for TorchDynamo using Linalg-on-Tensors/RefBackend. But TorchDynamo is pretty orthogonal to various other pieces, so it should compose nicely with variations like: - Switching out all the backends (Linalg-on-Tensors, TOSA, MHLO) - PyTorch functionalization and decompositions - Taking the example inputs and compiling with all dynamic or all static shapes without duplicating tests. This adds it to the CI, but there are still a lot of XFAIL's. This also adds a helper `from torch_mlir.dynamo import make_simple_dynamo_backend` which simplifies some of the steps for making a Torch-MLIR-based TorchDynamo backend. We include "simple" in the name because we are going to be exploring various things next from the long-term roadmap. The next steps are: - Burn down all the XFAIL's. - Start working on the pieces from the [long-term roadmap](https://github.com/llvm/torch-mlir/blob/main/docs/long_term_roadmap.md). - Add functionalization/decompositions into the TorchDynamo flow and remove reliance on the current Torch-MLIR "frontend". - Write a pure-Python direct FX->MLIR importer. - Hook up the new PyTorch symbolic shape stuff. - Explore PrimTorch decompositions for simplifying backends.
2022-11-18 20:21:19 +08:00
"ConvolutionBackwardModule2DPadded_basic",
"ConvolutionBackwardModule2D_basic",
build: update llvm tag to ba8b8a73f (#1856) * build: update llvm tag to ba8b8a73f * skip ConvolutionModule2DGroups_basic
2023-02-07 23:25:59 +08:00
[torch-mlir][sparse] add sparsification to linalg reference backend (#2887) This adds a few passes that will ensure linalg with sparse tensors are properly lowered to loops and can run using the ExecutionEngine for testing (a few details on parameter passing from PyTorch still TBD) Test results: $ ./tools/e2e_test.sh --config linalg Summary: Passed: 1144 Expectedly Failed: 8 $ python -m e2e_testing.main --config=torchdynamo -v Summary: Passed: 960 Expectedly Failed: 163 Filed issue: https://github.com/pytorch/pytorch/issues/119407
2024-02-09 01:37:31 +08:00
# Size result mismatch (exposed by downstream canonicalizer
# on incompatabile casts).
# https://github.com/pytorch/pytorch/issues/119407
"ConvolutionBackwardModule2DStrided_basic",
[torchdynamo] Initial TorchDynamo support This adds a basic e2e Config for TorchDynamo using Linalg-on-Tensors/RefBackend. But TorchDynamo is pretty orthogonal to various other pieces, so it should compose nicely with variations like: - Switching out all the backends (Linalg-on-Tensors, TOSA, MHLO) - PyTorch functionalization and decompositions - Taking the example inputs and compiling with all dynamic or all static shapes without duplicating tests. This adds it to the CI, but there are still a lot of XFAIL's. This also adds a helper `from torch_mlir.dynamo import make_simple_dynamo_backend` which simplifies some of the steps for making a Torch-MLIR-based TorchDynamo backend. We include "simple" in the name because we are going to be exploring various things next from the long-term roadmap. The next steps are: - Burn down all the XFAIL's. - Start working on the pieces from the [long-term roadmap](https://github.com/llvm/torch-mlir/blob/main/docs/long_term_roadmap.md). - Add functionalization/decompositions into the TorchDynamo flow and remove reliance on the current Torch-MLIR "frontend". - Write a pure-Python direct FX->MLIR importer. - Hook up the new PyTorch symbolic shape stuff. - Explore PrimTorch decompositions for simplifying backends.
2022-11-18 20:21:19 +08:00
# RuntimeError: Index tensor must have the same number of dimensions as self tensor
# RuntimeError: Failed running call_function aten.nll_loss_backward(...
[torchdynamo] Update XFAIL sets with upstream bug numbers.
2022-11-24 22:36:13 +08:00
# https://github.com/pytorch/pytorch/issues/89630
[torchdynamo] Initial TorchDynamo support This adds a basic e2e Config for TorchDynamo using Linalg-on-Tensors/RefBackend. But TorchDynamo is pretty orthogonal to various other pieces, so it should compose nicely with variations like: - Switching out all the backends (Linalg-on-Tensors, TOSA, MHLO) - PyTorch functionalization and decompositions - Taking the example inputs and compiling with all dynamic or all static shapes without duplicating tests. This adds it to the CI, but there are still a lot of XFAIL's. This also adds a helper `from torch_mlir.dynamo import make_simple_dynamo_backend` which simplifies some of the steps for making a Torch-MLIR-based TorchDynamo backend. We include "simple" in the name because we are going to be exploring various things next from the long-term roadmap. The next steps are: - Burn down all the XFAIL's. - Start working on the pieces from the [long-term roadmap](https://github.com/llvm/torch-mlir/blob/main/docs/long_term_roadmap.md). - Add functionalization/decompositions into the TorchDynamo flow and remove reliance on the current Torch-MLIR "frontend". - Write a pure-Python direct FX->MLIR importer. - Hook up the new PyTorch symbolic shape stuff. - Explore PrimTorch decompositions for simplifying backends.
2022-11-18 20:21:19 +08:00
"NllLossModuleBackward1DMeanWeight_basic",
"NllLossModuleBackward1DMean_basic",
"NllLossModuleBackward1DSumWeight_basic",
"NllLossModuleBackward1DSum_basic",
"NllLossModuleBackward1DWeight_basic",
"NllLossModuleBackward1D_basic",
[torchdynamo] Use decompositions to support a few ops
2022-11-29 22:01:42 +08:00
# TypeError: uniform() missing 2 required keyword-only arguments: 'dtype' and 'device'
# RuntimeError: Failed running call_function aten.uniform(...
# https://github.com/pytorch/torchdynamo/issues/1954
"UniformNoCorrelationModule_basic",
[torchdynamo] Initial TorchDynamo support This adds a basic e2e Config for TorchDynamo using Linalg-on-Tensors/RefBackend. But TorchDynamo is pretty orthogonal to various other pieces, so it should compose nicely with variations like: - Switching out all the backends (Linalg-on-Tensors, TOSA, MHLO) - PyTorch functionalization and decompositions - Taking the example inputs and compiling with all dynamic or all static shapes without duplicating tests. This adds it to the CI, but there are still a lot of XFAIL's. This also adds a helper `from torch_mlir.dynamo import make_simple_dynamo_backend` which simplifies some of the steps for making a Torch-MLIR-based TorchDynamo backend. We include "simple" in the name because we are going to be exploring various things next from the long-term roadmap. The next steps are: - Burn down all the XFAIL's. - Start working on the pieces from the [long-term roadmap](https://github.com/llvm/torch-mlir/blob/main/docs/long_term_roadmap.md). - Add functionalization/decompositions into the TorchDynamo flow and remove reliance on the current Torch-MLIR "frontend". - Write a pure-Python direct FX->MLIR importer. - Hook up the new PyTorch symbolic shape stuff. - Explore PrimTorch decompositions for simplifying backends.
2022-11-18 20:21:19 +08:00
#### Torch-MLIR internal compiler errors
# These are probably due to slightly different ops being recorded by
# torchdynamo vs. torchscript.
[torchdynamo] Use decompositions to support a few ops
2022-11-29 22:01:42 +08:00
# No upstream decompositions.
[torchdynamo] Annotate the XFAIL's with more info
2022-11-25 20:33:34 +08:00
# %6:4 = torch.operator "aten._embedding_bag_forward_only"(%1, %3, %5, %false, %int0, %false, %none, %false, %int-1) : (!torch.tensor<*,f32>, !torch.tensor<*,si64>, !torch.tensor<*,si64>, !torch.bool, !torch.int, !torch.bool, !torch.none, !torch.bool, !torch.int) -> (!torch.tensor, !torch.tensor, !torch.tensor, !torch.tensor)
[torchdynamo] Use decompositions to support a few ops
2022-11-29 22:01:42 +08:00
# See also: https://github.com/pytorch/torchdynamo/issues/327
[torchdynamo] Initial TorchDynamo support This adds a basic e2e Config for TorchDynamo using Linalg-on-Tensors/RefBackend. But TorchDynamo is pretty orthogonal to various other pieces, so it should compose nicely with variations like: - Switching out all the backends (Linalg-on-Tensors, TOSA, MHLO) - PyTorch functionalization and decompositions - Taking the example inputs and compiling with all dynamic or all static shapes without duplicating tests. This adds it to the CI, but there are still a lot of XFAIL's. This also adds a helper `from torch_mlir.dynamo import make_simple_dynamo_backend` which simplifies some of the steps for making a Torch-MLIR-based TorchDynamo backend. We include "simple" in the name because we are going to be exploring various things next from the long-term roadmap. The next steps are: - Burn down all the XFAIL's. - Start working on the pieces from the [long-term roadmap](https://github.com/llvm/torch-mlir/blob/main/docs/long_term_roadmap.md). - Add functionalization/decompositions into the TorchDynamo flow and remove reliance on the current Torch-MLIR "frontend". - Write a pure-Python direct FX->MLIR importer. - Hook up the new PyTorch symbolic shape stuff. - Explore PrimTorch decompositions for simplifying backends.
2022-11-18 20:21:19 +08:00
"AtenEmbeddingBagSumExample_basic",
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
xfail ElementwisePreluModule_basic in dynamo (#1763)
2023-01-01 05:54:25 +08:00
# error: unsupported by backend contract: tensor with unknown rank
# note: see current operation: %1 = "torch.tensor_static_info_cast"(%arg0) : (!torch.vtensor<[5,4,3,2,1],f32>) -> !torch.vtensor<*,f32>
"ElementwisePreluModule_basic",
[Torch] Support prelu decomposition (#3069)
2024-03-29 08:05:00 +08:00
# error: torch._dynamo.exc.BackendCompilerFailed: backend='compiler_fn' raised: AssertionError: Unregistered operation: torch.aten._prelu_kernel
"ElementwisePreluStaticModule_basic",
build: manually update PyTorch version Set PyTorch and TorchVision version to nightly release 2023-02-06. Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2023-02-07 13:38:44 +08:00
#ERROR: value (Tensor with shape=[2, 3, 6, 10], dtype=torch.float32, min=-1.336e-32, max=+0.9152, mean=+0.4837) is not close to golden value (Tensor with shape=[2, 3, 6, 10], dtype=torch.float32, min=+0.02233, max=+0.9152, mean=+0.4777)
"UpSampleNearest2dDynamicFactor_basic",
[MLIR][TORCH] Add support for integer type input for max.dim op Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2023-02-06 19:52:04 +08:00
"ReduceMaxAlongDimUnsignedInt_basic",
Add aten.min.dim to linalg lowering (#2600)
2023-12-05 23:16:35 +08:00
"ReduceMinAlongDimUnsignedInt_basic",
build: manually update PyTorch version Set PyTorch and TorchVision version to nightly release 2023-02-20. Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2023-02-20 15:40:09 +08:00
#ERROR: value (-56) is not equal to golden value (200)
"AtenIntTensorByteDtypeModule_basic",
Fix handling of non-int tensors in `getScalarValue` (#1914) The current implementation of `getScalarValue` does not check that the input to a `ValueTensorLiteralOp` is an i64 before extracting the value, and it does not check that the result type of the `PrimNumToTensorScalarOp` is also an i64. This leads to crashes or invalid IR generated when the `input` is something other than an i64 tensor or `!torch.int`. This commit addresses those issues. In addition, the function `getScalarValue` is renamed to `getScalarIntValue` to make it clear that it *only* extracts scalar integers.
2023-03-07 02:12:58 +08:00
# ERROR: assert isinstance(e, FakeTensor)
"ElementwiseAddScalar_NumToTensorFloat_Module_basic",
[Torch Dialect] add RSub, ScalarImplicit canonicalize (#1899) * add rsub, scalarimplit canonicalizer * reformat * address comments * fix bug * fix test * Update elementwise.py * resolve merge conflict * change to 3 * change to 3 * real fix * fix name * add torchdynamo fail test --------- Co-authored-by: zhekun.zhang <zhekun.zhang@bytedance.com>
2023-03-07 09:38:27 +08:00
# ERROR: assert isinstance(e, FakeTensor)
"RsubInt0d_NumToTensor_Module_basic",
[MLIR][TORCH] Add decomposition for prims::squeeze op This commit adds the decomposition for the prims.squeeze op. Signed-Off By: Vivek Khandelwal<vivek@nod-labs.com>
2022-11-16 13:57:58 +08:00
# ERROR: RuntimeError: Found a custom (non-ATen) operator that either mutates or its inputs: prims::squeeze.. Getting these operators to work with functionalization requires some extra work. For mutable ops you need to register a corresponding out-of-place variant of the op, and you also need to register a Functionalization kernel that performs some boilerplate, telling functionalization to map from the mutable op to the out-of-place op. See a more complete example of how to do this at https://gist.github.com/bdhirsh/7dadbf6296f8f7d1abcf4c482f438aaa.
"PrimsSqueezeModule_basic",
"PrimsSqueezeEmptyDimensionsModule_basic",
Lowering to linalg of prims split_dim op (#2576) Adds support for lowering to prims split_op. Similar design to collapse op lowering in https://github.com/llvm/torch-mlir/pull/2572, with some small differences, because the split_dim op (in pytorch) is view-changing whereas the collapse is not. The difference means that 1) it must be registered in the function Torch::isViewLikeOp 2) it must be be added to the "expected fail" set for the torch dynamo backend.
2023-11-21 23:56:09 +08:00
"SplitDimStaticModule_basic",
"SplitDimDynamicModule_basic",
[TorchDynamo] Add aten.squeeze op to the decomposition list Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2023-04-05 19:32:52 +08:00
[MLIR][TORCH] Add support for prims::view_of op This op does nothing and just returns the input operand as the result of the op. Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2023-04-10 11:50:26 +08:00
# ERROR: RuntimeError: Found a custom (non-ATen) operator that either mutates or its inputs: prims::view_of.. Getting these operators to work with functionalization requires some extra work. For mutable ops you need to register a corresponding out-of-place variant of the op, and you also need to register a Functionalization kernel that performs some boilerplate, telling functionalization to map from the mutable op to the out-of-place op. See a more complete example of how to do this at https://gist.github.com/bdhirsh/7dadbf6296f8f7d1abcf4c482f438aaa.
"PrimsViewOfModule_basic",
"PrimsViewOfZeroRankModule_basic",
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
# See https://github.com/llvm/torch-mlir/pull/2040 and corresponding upstream issue
# https://github.com/pytorch/pytorch/issues/99752.
# torch._dynamo.exc.Unsupported: call_function BuiltinVariable(bool) [TensorVariable()] {}
'TensorToBoolZeroRank_basic',
'TensorToBool_basic',
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# START tests failing due to: torch._dynamo.exc.Unsupported: call_function BuiltinVariable(float) [TensorVariable()] {}
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
'AtenSubFloatModule_basic',
[torch] Supporting `torch.aten.mul.float` lowering to `arith` (#2833) Simple missing scalar operation for multiply floats was missing.
2024-02-06 08:23:04 +08:00
'AtenMulFloatModule_basic',
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
'BoolFloatFalseModule_basic',
'BoolFloatTrueModule_basic',
'CeilFloatModule_basic',
'DivFloatModule_basic',
'GeFloatIntModule_basic',
'GeFloatModule_basic',
'GtFloatIntModule_basic',
'NeFloatIntModule_basic',
'SubFloatModule_basic',
[torch] Supporting `torch.aten.mul.float` lowering to `arith` (#2833) Simple missing scalar operation for multiply floats was missing.
2024-02-06 08:23:04 +08:00
'MulFloatModule_basic',
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
'TensorToFloatZeroRank_basic',
'TensorToFloat_basic',
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# END tests failing due to: torch._dynamo.exc.Unsupported: call_function BuiltinVariable(float) [TensorVariable()] {}
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# START tests failing due to: torch._dynamo.exc.Unsupported: call_function BuiltinVariable(int) [TensorVariable()] {}
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
'AddIntModule_basic',
'AtenIntTensorCharDtypeModule_basic',
'BoolIntFalseModule_basic',
'BoolIntTrueModule_basic',
'DivIntModule_basic',
'EqIntModule_basic',
'GeIntModule_basic',
'GtIntModule_basic',
'MulIntModule_basic',
'NeIntModule_basic',
'SqrtIntModule_basic',
'SubIntModule_basic',
'TensorToIntZeroRank_basic',
'TensorToInt_basic',
'UnsafeViewCollapseDynamicWithAtenSizeIntModule_basic',
'ViewCollapseDynamicWithAtenSizeIntModule_basic',
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# END tests failing due to: torch._dynamo.exc.Unsupported: call_function BuiltinVariable(int) [TensorVariable()] {}
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
[torch] Support lowering `torch.item` to `tensor.extract` (#2835) Extracting scalar values from tensors can be implemented via a lowering to tensor.extract.
2024-02-01 07:09:12 +08:00
# ERROR: torch._dynamo.exc.Unsupported: Tensor.item
'AtenItemIntOpModule_basic',
'AtenItemFpOpModule_basic',
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# ERROR: torch._dynamo.exc.Unsupported: call_method ListVariable() sort [] {'reverse': ConstantVariable(bool)}
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
'SortIntListReverse_basic',
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# ERROR: torch._dynamo.exc.Unsupported: call_method ListVariable() sort [] {}
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
'SortIntList_basic',
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# START tests failing due to: torch._dynamo.exc.Unsupported: data dependent operator: aten._local_scalar_dense.default
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
'AtenFloatScalarModule_basic',
'AtenIntBoolOpModule_basic',
'QuantizedMLP_basic',
[ONNX] Preliminary Work Towards Supporting QuantizedMLP_basic onnx e2e test (#3089) See the related issues here: [SHARK-Turbine#556](https://github.com/nod-ai/SHARK-Turbine/issues/556) 1. Adds uint8 casting to onnx.Cast op 2. Fixes an issue with onnx.DequantizeLinear when the scale comes with shape [1]. 3. Adds support for unsigned types in an AtenItemOp folder 4. Adds a simpler quantized model for easier debugging 5. Adds a fusion pass to convert [quant -> dequant -> transpose -> mm] patterns to [transpose -> quant -> mm]. 6. Moved some xfails that are still not passing, but for different reasons than onnx.cast failures.
2024-04-02 07:21:05 +08:00
'QuantizedSingleLayer_basic',
Adds Some Quantization Support for AtenMatmulOp (#3147) 1. onnx.MatMulInteger now converts to aten.matmul instead of aten.mm 2. aten.matmul, for ranks >=2, now allows quantized inputs and will lower to linalg::quantized_matmul or linalg::quantized_batch_matmul. 3. added AtenMatmulOp to the FuseQuantizeOps rewrite patters QuantizeOperands, QuantizeTransposedOperands, and QuantizeAccumulator 4. added several tests, including some to test AtenMmOp with varying quantization signed-ness. 5. a quantized matmul mat-vec test is added to verify the failure to lower to linalg; cleaned of out-of-date code related to common torch-mlir lowering xfails. 6. in debugging a real model with quantized matmuls, I found a bug on the scalarize-shapes pass which resulted from the aten.full op folder returning an incompatible result type. This is fixed by the small change here to [lib/Dialect/Torch/IR/TorchOps.cpp](https://github.com/llvm/torch-mlir/compare/main...zjgarvey:torch-mlir:MatMulIntegerFix?expand=1#diff-dc8ed165c207918e606490eee3984b1ad51d7034e6aac36fc046bf47f6f03f4f).
2024-04-16 07:06:47 +08:00
'QuantizedBatchedInputSingleLayer_basic',
Adds Some uint8 Quantization Fixes (#3122) 1. Changes the linalg lowering for dequantization ops to always sign cast to float to prevent misrepresenting uint32 overflow on subtraction with zero point. 2. Adds a basic quantized model test which only quantizes and dequantizes and now passes with these changes in linalg and onnx configs. 3. Changes the aten.mm lowering to allow mismatched quantized types. 4. If a quantized matmul arg is uint8, we shift by 128 to faithfully represent the quantization as a signed i8 quantization. This worked fine in the AtenMmOp lowering, but I'd be happy to move it to a rewrite in FuseQuantizedOps.cpp instead if that seems more appropriate. With the changes 3 and 4, the QuantizedMLP_basic and QuantizedSingleLayer_basic e2e tests now passes with the onnx config.
2024-04-11 03:36:58 +08:00
'QuantizedNoLayer_basic',
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
'ScalarImplicitFloatModule_basic',
'ScalarImplicitIntModule_basic',
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# END tests failing due to: torch._dynamo.exc.Unsupported: data dependent operator: aten._local_scalar_dense.default
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# START tests failing due to: torch._dynamo.exc.Unsupported: dynamic shape operator: aten.bincount.default
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
'BincountMinlengthModule_basic',
'BincountModule_basic',
'BincountStaticSizeModule_basic',
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# END tests failing due to: torch._dynamo.exc.Unsupported: dynamic shape operator: aten.bincount.default
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# ERROR: torch._dynamo.exc.Unsupported: torch.* op returned non-Tensor bool call_function aten.Bool
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
'BoolFloatConstantModule_basic',
'BoolIntConstantModule_basic',
add uncovered cases in view lowering (#2524) removes unecessary checks from empty strided
2023-11-02 10:56:44 +08:00
# ERROR: torch._dynamo.exc.Unsupported: torch.* op returned non-Tensor int call_function aten.size
"ViewSizeFromOtherTensor_basic",
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# ERROR: torch._dynamo.exc.Unsupported: torch.* op returned non-Tensor bool call_function aten.__contains__
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
'ContainsIntList_False',
'ContainsIntList_True',
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# ERROR: torch._dynamo.exc.Unsupported: torch.* op returned non-Tensor bool call_function aten.all
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
'AllBoolFalseModule_basic',
'AllBoolTrueModule_basic',
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# ERROR: torch._dynamo.exc.Unsupported: torch.* op returned non-Tensor bool call_function aten.any
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
'AnyBoolFalseModule_basic',
'AnyBoolTrueModule_basic',
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# ERROR: torch._dynamo.exc.Unsupported: torch.* op returned non-Tensor float call_function aten.sqrt
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
'SqrtIntConstantModule_basic',
[Torch-to-Linalg] Add dynamic dimension support for BroadcastTo op (#2174) -- This commit adds support for dynamic dimension in BroadcastTo op. Signed-off-by: Abhishek Varma <abhishek@nod-labs.com>
2023-07-08 01:01:51 +08:00
# ERROR: torch._dynamo.exc.Unsupported: torch.* op returned non-Tensor int call_function aten.size
'BroadcastDynamicDimModule_basic',
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# START tests failing due to: torch._dynamo.exc.Unsupported: torch.* op returned non-Tensor int call_function aten.Int
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
'AtenIntBoolOpConstFalseModule_basic',
'AtenIntBoolOpConstTrueModule_basic',
'IntFloatModule_basic',
'PowIntFloatModule_basic',
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# END tests failing due to: torch._dynamo.exc.Unsupported: torch.* op returned non-Tensor int call_function aten.Int
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# ERROR: torch._dynamo.exc.Unsupported: torch.* op returned non-Tensor int call_function aten.len
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
'LenStrModule_basic',
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# ERROR: torch._dynamo.exc.Unsupported: torch.* op returned non-Tensor int call_function aten.numel
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
'NumelModule_basic',
'NumelZeroRankModule_basic',
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# ERROR: torch._dynamo.exc.Unsupported: torch.* op returned non-Tensor int call_function prim.max
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
'PrimMaxIntModule_basic',
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# ERROR: torch._dynamo.exc.Unsupported: torch.* op returned non-Tensor int call_function prim.min
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
'PrimMinIntModule_basic',
[LINALG] Add dynamic support for `PrimMinIntOp`
2023-05-26 06:40:12 +08:00
'PrimMinIntDynamicModule_basic',
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# START tests failing due to: empty graph in dynamo
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
'IsFloatingPointFloat_True',
'IsFloatingPointInt_False',
'TorchPrimLoopForLikeModule_basic',
'TorchPrimLoopWhileLikeModule_basic',
[Importer] import constant tuple (#2132) * [Importer] import constant tuple * update * update * update
2023-05-31 14:14:14 +08:00
"ScalarConstantTupleModule_basic",
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# END tests failing due to: empty graph in dynamo
# ERROR due to: backend never runs because of empty frame
'ConstantBoolParameterModule_basic',
# START tests failing due to: 'torch.aten.mul.Tensor' op operand #1 must be Any Torch tensor type, but got '!torch.float'
"UpSampleNearest2dDynamicSize_basic",
"UpSampleNearest2dStaticFactor_basic",
"UpSampleNearest2dStaticSize_basic",
"UpSampleNearest2d_basic",
# END tests failing due to: 'torch.aten.mul.Tensor' op operand #1 must be Any Torch tensor type, but got '!torch.float'
# START tests failing due to: 'torch.aten.add.Tensor' op operand #1 must be Any Torch tensor type, but got '!torch.float'
"ElementwiseAddScalarFloatModule_basic",
# END tests failing due to: 'torch.aten.add.Tensor' op operand #1 must be Any Torch tensor type, but got '!torch.float'
# ERROR: 'torch.aten.add.Tensor' op operand #1 must be Any Torch tensor type, but got '!torch.int'
"ElementwiseAddScalar_TensorLiteralInt32_Module_basic",
"HBC_basic",
# ERROR: 'torch.aten.div.Tensor' op operand #1 must be Any Torch tensor type, but got '!torch.float'
"ElementwiseDivScalarModule_basic",
fix(TorchToTosa.cpp): adjust torch->tosa div conversion (#2200) check the return type of the division to figure out whether to use the floating point implementation of a division or to use the integer. the issue rose from the fact that the inputs are all integer but the result was casted to floating point. The conversion then chose to use the integer implementation of division which is not legal in tosa when all the inputs get casted to floating point. fix(TorchToLinalg): AtenDivScalarOp upcast self operand as well if applicable, the self operand must also be casted to float as it can be an integer.
2023-06-12 17:18:38 +08:00
# ERROR: 'torch.aten.div.Tensor' op operand #1 must be Any Torch tensor type, but got '!torch.int'
"ElementwiseAtenDivIntScalarModule_basic",
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# ERROR: 'torch.aten.sub.Tensor' op operand #1 must be Any Torch tensor type, but got '!torch.float'
"ElementwiseSubScalarFloatModule_basic",
"ElementwiseSubScalarIntModule_basic",
# ERROR: Exception: Unsupported: missing default value for argument 0 in schema for aten.div.Tensor_mode
Added 2 Ops: Floor divide scalar and Floor divide scalar mode (#3156) - Added linalg lowering for `AtenFloorDivideScalarOp` - Needed `AtenDivScalarModeOp` for the decomp. - Added linalg lowering for `AtenDivScalarModeOp` - Moved linalg payload logic to `createDivModePayload()` since the logic was nearly identical for both `AtenDivScalarModeOp` and `AtenDivTensorModeOp`. Just a template function - Added `AtenDivScalarModeOp` lowering for stablehlo Pytorch's [`torch.floor_divide()`](https://pytorch.org/docs/stable/generated/torch.floor_divide.html) in a previous version (for a reason unknown to me) preformed a truncation instead of "floor". The already implemented op `AtenFloorDivideTensorOp` was done before this change. However, this wasn't caught because our testcases only tested positive floor division. I changed this to floor as well as adding a few test cases.
2024-04-16 04:45:10 +08:00
"ElementwiseAtenFloorDivideScalarNegativeModule_basic",
"ElementwiseAtenFloorDivideScalarModule_basic",
"ElementwiseDivTensorRoundingModeFloorModule_basic",
"ElementwiseDivTensorRoundingModeTruncModule_basic",
"ElementwiseDivTensorRoundingModeFloorStaticModule_basic",
"ElementwiseDivTensorRoundingModeTruncStaticModule_basic",
"ElementwiseDivTensorRoundingModeFloorIntStaticModule_basic",
"ElementwiseDivTensorRoundingModeTruncIntStaticModule_basic",
"ElementwiseDivScalarRoundingModeFloorModule_basic",
"ElementwiseDivScalarRoundingModeTruncModule_basic",
"ElementwiseDivScalarRoundingModeFloorStaticModule_basic",
"ElementwiseDivScalarRoundingModeTruncStaticModule_basic",
"ElementwiseDivScalarRoundingModeFloorIntStaticModule_basic",
"ElementwiseDivScalarRoundingModeTruncIntStaticModule_basic",
[RFC] general support for Adaptive Pooling Ops (#2661) Adaptive pooling ops can only be decomposed into their non-adaptive counterparts in trivial cases. For example, the current decomposition for AtenAdaptiveAvgPool1dOp in DecomposeComplexOps.cpp supports outSize = inSize (i.e., do literally nothing), and outSize = 1 (i.e., do a batched average). The reason adaptive pooling ops are difficult to lower to linalg is that they are not constantly strided. They are computed by taking an input tensor of shape (N, C, Hin), and an output size Hout, and computing the output tensor at position (n,c, h) in the following way: 1. compute st(h) = (h*Hin)//Hout 2. compute en(h) = 1 + ((h+1)*Hin -1)//Hout 3. apply a computation (max or avg) to the slice: INPUT[n, c, st(h):en(h)] The provided sample implementation (for ConvertAtenAdaptiveAvgPool1dOp) uses tensor.extract to access the input tensor inside the payload of a linalg generic op. This is likely an unattractive use of linalg generic ops, which is why I am asking for some more targeted feedback on the validity of this approach before attempting to support the many other adaptive pooling ops. Specifically: - Is the performance of this implementation bad enough to warrant targeting different dialects entirely? e.g. TMtensor/linalg ext/ etc. - If the provided implementation is of acceptable performance to the community, then is it permissable to remove the Adaptive pooling decompositions from DecomposeComplexOps.cpp? Based on the current structure of the -torch-decompose-complex-ops pass, it does not seem possible to only decompose the adaptive ops in special cases (it seems to get stuck in an infinite loop on a match failure). I would be happy to instead incorporate the case logic into the conversion directly, and remove the decompositions once they are rendered completely obsolete. As long as this approach is acceptable, I can clean up the implementation with some helper functions, and quickly add support for each of the remaining Adaptive pooling ops.
2024-01-10 03:14:10 +08:00
"AdaptiveAvgPool1dStaticLargerOutput_basic",
"AdaptiveAvgPool1dGeneralDynamic_basic",
Converts all Adaptive Pooling Ops to Linalg (#2808) The previous conversions for AtenAdaptiveAvgPool1dOp and AtenAdaptiveMaxPool2dOp are refactored into a general templated conversion that works for all of the AtenAdaptive...PoolNdOp's. New support is added for the following ops: 1. AtenAdaptiveMaxPool1d 2. AtenAdaptiveMaxPool3d 3. AtenAdaptiveAvgPool3d Support is also provided for passing inputs without batch dimensions. For example, applying adaptive_avg_pool2d to an input tensor of rank 3. After [pytorch #118162](https://github.com/pytorch/pytorch/pull/118162) gets down to torch-mlir, I'll add a test for AdaptiveMaxPool1d with return_indices (which will pass with that upstream fix). --------- Co-authored-by: James Newling <james.newling@gmail.com>
2024-03-23 02:05:20 +08:00
"AdaptiveAvgPool1dGeneralDynamicNoBatches_basic",
"AdaptiveAvgPool2dDynamic_basic",
"AdaptiveAvgPool2dDynamicNoBatch_basic",
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# ERROR: Exception: Unsupported op: get_attr
"NumToTensorFloatModule_basic",
"NumToTensorIntModule_basic",
"TensorFloatModule_basic",
"TensorIntModule_basic",
# ERROR: Exception: Unsupported: missing default value for argument 0 in schema for aten.randn.generator
"RandnGeneratorF64Module_basic",
"RandnGeneratorModule_basic",
# START tests failing due to: complex floating point ops
# END tests failing due to: complex floating point ops
[Torch Op] Add unbind.int support with ListUnpack (#2058) * add unbind int * reformat * use unpack canonicalize * address comments * Empty commit, trigger test * add ltc blacklist * clean up * address comments * check permute list * erase in recompose --------- Co-authored-by: zhekun.zhang <zhekun.zhang@bytedance.com>
2023-05-19 10:07:58 +08:00
# ERROR: Exception: Unsupported: return type List[Tensor] in schema for aten.unbind.int
"UnbindIntListUnpack_Module_basic",
"UnbindIntGetItem_Module_basic",
[TM_TENSOR] Add `aten.scatter.[src|value]` op This commit adds support of `aten.scatter.src` and `aten.scatter.value` ops. Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
2022-10-16 05:46:06 +08:00
# ERROR: torch._dynamo.exc.Unsupported: call_function BuiltinVariable(float) [TensorVariable()] {}
"ScatterValueFloatModule_basic",
# ERROR: torch._dynamo.exc.Unsupported: call_function BuiltinVariable(int) [TensorVariable()] {}
"ScatterValueIntModule_basic",
[Importer] import constant tuple (#2132) * [Importer] import constant tuple * update * update * update
2023-05-31 14:14:14 +08:00
[MLIR][TORCH] Add support for aten._unsafe_index_put.hacked_twin op Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2023-07-14 15:26:54 +08:00
# AssertionError: Unregistered operation: torch.aten._unsafe_index_put
"UnsafeIndexPutHackedTwin1DFloatNonAccumulateModule_basic",
[TOSA] Fix conversion for depthwise convolutions (#2398) * [TOSA] Fix conversion for depthwise convolutions * Add e2e tests for depthwise and grouped convolutions Co-authored-by: Lucas Camphausen <lucas.camphausen@iml.fraunhofer.de>
2023-08-18 23:15:54 +08:00
# Lowering Torch Backend IR -> Linalg-on-Tensors Backend IR failed
# 'linalg.depthwise_conv_2d_nchw_chw' op inferred input/output operand #1 has shape's dimension #0 to be 4, but found 8
"Conv2dWithPaddingDilationStrideStaticModule_depthwise_multiplier",
[torch] Fix tm_tensor.attention for end-to-end (#2907) Some operations include a backend matcher for specialized operations. We map these back to generics so they appropriately match to the high performance versions. This is done for the attention operation.
2024-02-14 13:18:01 +08:00
# AssertionError: Unregistered operation: torch.aten._scaled_dot_product_flash_attention_for_cpu
build: manually update PyTorch version Set PyTorch and TorchVision version to nightly release 2023-08-30. Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2023-08-25 14:07:30 +08:00
"ScaledDotProductAttentionDifferentModule_basic",
[MLIR][TORCH] Add StableHLO lowering for embedding_bag.padding_idx op Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2023-09-05 21:28:37 +08:00
# AssertionError: Unregistered operation: torch.aten._embedding_bag_forward_only
"AtenEmbeddingBagStaticModule_basic",
[MLIR][TORCH] Add support for conversion to int8 dtype Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2023-09-29 20:19:18 +08:00
# Lowering not present for this case
"ElementwiseToDtypeI64ToUI8Module_basic",
[MLIR][TORCH] Add support for int8 dtype for sub, add, and bitwise_and op Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2023-10-03 19:59:56 +08:00
# torch._dynamo.exc.TorchRuntimeError: Failed running call_function <built-in method add of type object at 0x7f4f8b05a720>(*(FakeTensor(..., size=(3, 4), dtype=torch.int8), 3, 2), **{}): Tensor with dtype torch.int64 is not the expected dtype of torch.int8!
"ElementwiseAddScalarInt8Module_basic",
build: manually update PyTorch version (#2521)
2023-10-19 22:03:00 +08:00
# ERROR: dtype (torch.int64) is not equal to golden dtype (torch.float32)
"ThresholdBackward2dMixedModule_basic",
[Torch Dialect] support AtenArangeStartOutOp in ReduceOpVariants like… (#2563) … AtenBernoulli_FloatOp It fixing case like: `%2110 = torch.aten.arange.start_out %int1, %int1517, %int1, %2109 : !torch.int, !torch.int, !torch.int, !torch.tensor -> !torch.tensor`. `aten.arange.start_out` doesn't have value semantics also, means`%2110` is an alias for %2109. So I decompose it to `aten.arange.start` + `torch.contents.overwrite`. The complex decomposition logic is target to handle cases like view and dtype cast which I add in e2e tests.
2023-11-17 00:51:55 +08:00
# ERROR: shape (torch.Size([12])) is not equal to golden shape (torch.Size([3, 4]))
"ArangeStartOutViewModule_basic",
[Torch Dialect]Add Support for AtenGroupNormOp and AtenNativeGroupNormOp (#2591) Co-authored-by: LiuYuanqiang <liuyuanqiang.yqliu@bytedance.com>
2023-12-13 11:05:12 +08:00
[torch][quant] Support quantize and dequantize for torch (#2731) Handle both `torch.dequantize` and `torch.quantize_per_tensor` including the op based quantization parameter tracking. This includes adding `qint32` to torch types as it was missing during the initial type inclusion. For testing we only have `torch.int8` and `torch.float` types on function boundaries as the `qint8` types require passing the scale and zero point quantization information which is not supported yet.
2024-01-13 11:11:14 +08:00
# Dynamo does not support tracing quantized tensors
[torch] `torch.dequantize` for per channel tensors to` linalg` (#2769) Support a lowering for dequantization for per channel tensors from `torch` dialect to a linalg decomposition. Tested via a numerical `torch` test.
2024-01-26 08:40:21 +08:00
"ElementwiseDequantizePerChannelModule_basic",
[torch][quant] Support quantize and dequantize for torch (#2731) Handle both `torch.dequantize` and `torch.quantize_per_tensor` including the op based quantization parameter tracking. This includes adding `qint32` to torch types as it was missing during the initial type inclusion. For testing we only have `torch.int8` and `torch.float` types on function boundaries as the `qint8` types require passing the scale and zero point quantization information which is not supported yet.
2024-01-13 11:11:14 +08:00
"ElementwiseDequantizePerTensorModule_basic",
"ElementwiseQuantizePerTensorModule_basic",
[torch] Fix clamp ranges on quantize_per_tensor on unsigned (#3018) SExtValue was used for `int` and `uint` clamp values. This caused the result to always be outputed as `zero`.
2024-03-21 04:37:47 +08:00
"ElementwiseQuantizePerTensorUIntModule_basic",
[torch][quant] Quantized `torch.mm` for linalg with end-to-end test (#2750) This includes custom op matching for decomposed operations and fusing dequantization into dense operations. As a validation we compare to the dequant+mm torch implementation.
2024-01-25 06:02:50 +08:00
"AtenMmQuint8_basic",
Adds Some Quantization Support for AtenMatmulOp (#3147) 1. onnx.MatMulInteger now converts to aten.matmul instead of aten.mm 2. aten.matmul, for ranks >=2, now allows quantized inputs and will lower to linalg::quantized_matmul or linalg::quantized_batch_matmul. 3. added AtenMatmulOp to the FuseQuantizeOps rewrite patters QuantizeOperands, QuantizeTransposedOperands, and QuantizeAccumulator 4. added several tests, including some to test AtenMmOp with varying quantization signed-ness. 5. a quantized matmul mat-vec test is added to verify the failure to lower to linalg; cleaned of out-of-date code related to common torch-mlir lowering xfails. 6. in debugging a real model with quantized matmuls, I found a bug on the scalarize-shapes pass which resulted from the aten.full op folder returning an incompatible result type. This is fixed by the small change here to [lib/Dialect/Torch/IR/TorchOps.cpp](https://github.com/llvm/torch-mlir/compare/main...zjgarvey:torch-mlir:MatMulIntegerFix?expand=1#diff-dc8ed165c207918e606490eee3984b1ad51d7034e6aac36fc046bf47f6f03f4f).
2024-04-16 07:06:47 +08:00
"AtenMmQint8_basic",
"AtenMmQMixedSigni8_basic",
"AtenMatmulQMixedSigni8Transpose_basic",
"AtenMatmulQMixedSigni8_basic",
"AtenMatmulQint8MV_basic",
[TorchToLinalg] Adds Support for Remaining Quantized Matmul Cases (#3167) The new cases added for quantized matmuls are: 1. vec-vec 2. vec-mat 3. mat-vec each of which are now lowered to expand(s), quantized_matmul, and collapse.
2024-04-17 00:28:28 +08:00
"AtenMatmulQint8VV_basic",
"AtenMatmulQint8VM_basic",
Adds Some Quantization Support for AtenMatmulOp (#3147) 1. onnx.MatMulInteger now converts to aten.matmul instead of aten.mm 2. aten.matmul, for ranks >=2, now allows quantized inputs and will lower to linalg::quantized_matmul or linalg::quantized_batch_matmul. 3. added AtenMatmulOp to the FuseQuantizeOps rewrite patters QuantizeOperands, QuantizeTransposedOperands, and QuantizeAccumulator 4. added several tests, including some to test AtenMmOp with varying quantization signed-ness. 5. a quantized matmul mat-vec test is added to verify the failure to lower to linalg; cleaned of out-of-date code related to common torch-mlir lowering xfails. 6. in debugging a real model with quantized matmuls, I found a bug on the scalarize-shapes pass which resulted from the aten.full op folder returning an incompatible result type. This is fixed by the small change here to [lib/Dialect/Torch/IR/TorchOps.cpp](https://github.com/llvm/torch-mlir/compare/main...zjgarvey:torch-mlir:MatMulIntegerFix?expand=1#diff-dc8ed165c207918e606490eee3984b1ad51d7034e6aac36fc046bf47f6f03f4f).
2024-04-16 07:06:47 +08:00
"AtenMatmulQint8_basic",
[torch] Support `torch.convolution` quantized lowering to `linalg` (#2811) Linalg has quantized specific operations. We can lower to these operations when there is a known zeropoint and scale operations. This allows the `convolution` to occur with lower bitwidth's, improving the overall performance.
2024-01-31 05:46:47 +08:00
"Conv2dQInt8Module_basic",
implement aten.conv1d, aten.conv3d, and aten.conv_tbc (#2757) convolution with [time,batch,channel] ordering, as opposed to the default [batch, channel, time]. Currently implementing by transposing the input and output, but may need to get its own implementation in the future because this is supposed to be an op that gives a speedup. This is used by fairseq (https://github.com/facebookresearch/fairseq/issues/172). (in case you were wondering like me, this is different from transposed convolution. Transposed convolution has fractional strides). --------- Co-authored-by: Xida Ren <xida.ren.dev@gmail.com> Co-authored-by: Frederik Harwath <frederik.harwath@amd.com>
2024-01-24 13:30:03 +08:00
# Dynamo not supporting conv_tbc
"ConvTbcModule_basic",
[MLIR][TORCH] Extend support for OnnxToLinalg lowering for Dropout and Div op (#2938) Fixes https://github.com/nod-ai/SHARK-Turbine/issues/451, https://github.com/nod-ai/SHARK-Turbine/issues/452
2024-02-27 13:32:05 +08:00
"FloatImplicitModule_basic",
"IntImplicitModule_basic",
[onnx][torch] Gridsampler E2E test and corrections of gridsampler (#2987) The addition of an e2e test is actually provided in the Shark-Testsuite. This adds 2 test cases for the gridsampler e2e test. Also as intended there were some items found which needed correction, so the Gridsampler op has also a change.
2024-03-07 02:56:58 +08:00
# Others
"GridSamplerBasic1_basic",
"GridSamplerBasic2_basic",
[Torch Dialect] support aten.fake_quantize_per_tensor_affine (#3014)
2024-03-15 08:53:29 +08:00
"FakeQuantizePerTensorAffineModule_basic",
"FakeQuantizePerTensorAffineDynamicShapeModule_basic",
"FakeQuantizePerTensorAffineRoundToEvenModule_basic",
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
}
TORCHDYNAMO_CRASHING_SET = {
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
# No upstream decompositions.
# %6:4 = torch.operator "aten._embedding_bag_forward_only"(%1, %3, %5, %false, %int0, %false, %none, %false, %int-1) : (!torch.tensor<*,f32>, !torch.tensor<*,si64>, !torch.tensor<*,si64>, !torch.bool, !torch.int, !torch.bool, !torch.none, !torch.bool, !torch.int) -> (!torch.tensor, !torch.tensor, !torch.tensor, !torch.tensor)
# See also: https://github.com/pytorch/torchdynamo/issues/327
"Aten_EmbeddingBagExample_basic",
"FullModuleInt3D_basic",
"ThresholdBackward1dIntModule_basic",
"ThresholdBackward2dIntModule_basic",
"ThresholdBackward3dIntModule_basic",
# See https://github.com/llvm/torch-mlir/issues/2050
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
"ElementwiseCloneChannelsLastMemoryFormatModule_basic",
[Dynamo] fix TORCHDYNAMO_CRASHING_SET (#2082)
2023-05-02 10:35:26 +08:00
"ElementwiseCloneContiguousModule_basic",
"ElementwiseCloneModule_basic",
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
"ExpandAsFloatModule_basic",
"ExpandAsIntModule_basic",
"ExpandModule_basic",
"MoveDimIntModule_basic",
"MoveDimIntNegativeIndexModule_basic",
[Dynamo] fix TORCHDYNAMO_CRASHING_SET (#2082)
2023-05-02 10:35:26 +08:00
"NarrowVerticalTest2_basic",
"NarrowVerticalTest_basic",
[Dynamo] turn on `no_python=True` for dynamo tests (#2040)
2023-04-29 07:05:17 +08:00
"NumpyTRank2Module_basic",
"NumpyTRankNDynamicModule_basic",
"NumpyTRankNStaticModule_basic",
"PermuteModule_basic",
"PermuteNegativeIndexModule_basic",
"SelectIntNegativeDimAndIndexStaticModule_basic",
Pure-Python FX importer. (#2098) Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 13:46:33 +08:00
"TestMultipleTensorAndPrimitiveTypesReturn_basic",
[Dynamo] fix TORCHDYNAMO_CRASHING_SET (#2082)
2023-05-02 10:35:26 +08:00
"TModuleRank2_basic",
"ToCopyModule_basic",
"TransposeIntModule_basic",
"TransposeIntNegDimsModule_basic",
[TOSA] Add aten._index_put_impl support (#2031) Add e2e support by add "tosa-to-scf"
2023-07-18 00:51:24 +08:00
"IndexPutImpl2DNoneIndexStaticModule_basic",
Add aten.pool_max3d support to torch-to-linalg (#2735) Added verification logic to the abstract_interpreter_lib_gen.py Also made some unit tests Initially, I thought we can use `linalg::pooling_ndhwc_max` to help implement this problem. However, on a 5-dimensional matrix it does the pooling on dimensions (2, 3, 4) which is not what we want. We want pooling on dimensions (3, 4, 5). To achieve this, we would need to lower our code using the `linalg` dialect. Turns out the pooling code in `linalg` looks like this. ``` func @max_pooling_ncdhw(%I: memref<?x?x?x?x?xf32>, %K: memref<3xindex>, %O: memref<?x?x?x?x?xf32>, %strides: memref<3xindex>, %dilations: memref<3xindex>) { %c0 = arith.constant 0 : index %c1 = arith.constant 1 : index %N = memref.dim %I, %c0 : memref<?x?x?x?x?xf32> %C = memref.dim %I, %c1 : memref<?x?x?x?x?xf32> %D = memref.dim %I, 2 : memref<?x?x?x?x?xf32> %H = memref.dim %I, 3 : memref<?x?x?x?x?xf32> %W = memref.dim %I, 4 : memref<?x?x?x?x?xf32> %kernel_d = memref.load %K[%c0] : memref<3xindex> %kernel_h = memref.load %K[%c1] : memref<3xindex> %kernel_w = memref.load %K[2] : memref<3xindex> %stride_d = memref.load %strides[%c0] : memref<3xindex> %stride_h = memref.load %strides[%c1] : memref<3xindex> %stride_w = memref.load %strides[2] : memref<3xindex> %dilation_d = memref.load %dilations[%c0] : memref<3xindex> %dilation_h = memref.load %dilations[%c1] : memref<3xindex> %dilation_w = memref.load %dilations[2] : memref<3xindex> linalg.generic { indexing_maps = [ affine_map<(n, c, d, h, w, kd, kh, kw) -> (n, c, d * %stride_d + kd * %dilation_d, h * %stride_h + kh * %dilation_h, w * %stride_w + kw * %dilation_w)>, // Map for input tensor affine_map<(n, c, d, h, w, kd, kh, kw) -> (kd, kh, kw)>, // Map for kernel tensor affine_map<(n, c, d, h, w, kd, kh, kw) -> (n, c, d, h, w)> // Map for output tensor ], iterator_types = ["parallel", "parallel", "parallel", "parallel", "parallel", "reduction", "reduction", "reduction"], doc = "3D Max Pooling NCDHW with Strides, Dilations, and Kernel Size" } ins(%I, %K : memref<?x?x?x?x?xf32>, memref<3xindex>) outs(%O : memref<?x?x?x?x?xf32>) { ^bb0(%input_elem: f32, %kernel_elem: index, %output_elem: f32): %max_val = arith.maxf %input_elem, %output_elem : f32 linalg.yield %max_val : f32 } return } ``` This was implemented based on it's source code with the adjustments mentioned above: https://github.com/llvm/llvm-project/blob/4ca1b5e094280ef1af40412e3cfcb62dc3cf15bc/mlir/include/mlir/Dialect/Linalg/IR/LinalgNamedStructuredOps.yaml#L5647 Issues related to this can be found here https://github.com/nod-ai/SHARK-Turbine/issues/324
2024-01-19 23:39:46 +08:00
"MaxPool3dCeilModeTrueModule_basic",
"MaxPool3dEmptyStrideStaticModule_basic",
"MaxPool3dLargeDatadModule_basic",
"MaxPool3dModuleRandomSimple_basic",
"MaxPool3dModule_basic",
"MaxPool3dStaticCeilModeTrueModule_basic",
"MaxPool3dStaticModule_basic",
[TorchDynamo] Enable Elemtwise ops for Scalar arg (#2744) This commit provides dummy solution to support elmentwise operations (mul, add) with scalar argument. ( op(Tensor, Scalar) ) It replaces `torch.aten.add.Tensor` with `torch.aten.add.Scalar`. ``` Unexpected outcome summary: (torchdynamo) ****** Unexpectedly Passed tests - 22 tests XPASS - "AddCDivModule_basic" XPASS - "BatchNorm1DModule_basic" XPASS - "BatchNorm1DStaticShapeModule_basic" XPASS - "BatchNorm1DWith2DInputModule_basic" XPASS - "BatchNorm2DModule_basic" XPASS - "BatchNorm3DModule_basic" XPASS - "ElementwiseAddScalarInt64Module_basic" XPASS - "ElementwiseAddScalarIntModule_basic" XPASS - "ElementwiseMulScalarModule_basic" XPASS - "ElementwiseMulScalarModule_float" XPASS - "ElementwiseMulScalarModule_int" XPASS - "GroupNormModule_basic" XPASS - "GroupNormNoWeightAndBiasModule_basic" XPASS - "MobilenetV3Module_basic" XPASS - "NativeBatchNorm1DModule_basic" XPASS - "NativeBatchNorm2DModule_basic" XPASS - "NativeBatchNorm3DModule_basic" XPASS - "NativeBatchNormNoneWeightModule_basic" XPASS - "NativeGroupNormBackwardModule_basic" XPASS - "NativeGroupNormModule_basic" XPASS - "ResNet18Module_basic" XPASS - "ResNet18StaticModule_basic" ``` And segfault for test "ElementwiseAddScalar_TensorLiteralInt32_Module_basic". Somehow this change doesn't allow to use Tensors, that are not forward arguments, but local variables of model. e.g. `self.x = torch.tensor(..)` See also: #2745 Signed-off-by: Dmitrii Makarenko <dmitrii.makarenko@intel.com>
2024-03-12 03:22:05 +08:00
# Looks like incorrect fx graph conversion
"ElementwiseAddScalar_TensorLiteralInt32_Module_basic",
[torchdynamo] Initial TorchDynamo support This adds a basic e2e Config for TorchDynamo using Linalg-on-Tensors/RefBackend. But TorchDynamo is pretty orthogonal to various other pieces, so it should compose nicely with variations like: - Switching out all the backends (Linalg-on-Tensors, TOSA, MHLO) - PyTorch functionalization and decompositions - Taking the example inputs and compiling with all dynamic or all static shapes without duplicating tests. This adds it to the CI, but there are still a lot of XFAIL's. This also adds a helper `from torch_mlir.dynamo import make_simple_dynamo_backend` which simplifies some of the steps for making a Torch-MLIR-based TorchDynamo backend. We include "simple" in the name because we are going to be exploring various things next from the long-term roadmap. The next steps are: - Burn down all the XFAIL's. - Start working on the pieces from the [long-term roadmap](https://github.com/llvm/torch-mlir/blob/main/docs/long_term_roadmap.md). - Add functionalization/decompositions into the TorchDynamo flow and remove reliance on the current Torch-MLIR "frontend". - Write a pure-Python direct FX->MLIR importer. - Hook up the new PyTorch symbolic shape stuff. - Explore PrimTorch decompositions for simplifying backends.
2022-11-18 20:21:19 +08:00
}
[FxImporter] Add FxImporter config in e2e-test (#3151)
2024-04-13 07:07:56 +08:00
FX_IMPORT_XFAIL_SET = {
"AddIntModule_basic",
"AllBoolFalseModule_basic",
"AllBoolTrueModule_basic",
"AnyBoolFalseModule_basic",
"AnyBoolTrueModule_basic",
"ArangeStartOutViewModule_basic",
"AtenEmbeddingBagStaticModule_basic",
"AtenEmbeddingBagSumExample_basic",
"AtenFloatScalarModule_basic",
"AtenIntBoolOpConstFalseModule_basic",
"AtenIntBoolOpConstTrueModule_basic",
"AtenIntBoolOpModule_basic",
"AtenIntTensorByteDtypeModule_basic",
"AtenIntTensorCharDtypeModule_basic",
"AtenItemFpOpModule_basic",
"AtenItemIntOpModule_basic",
[CI] Enable the tests for fx_importer in the CI (#3168) Replace the torchdynamo e2e with the fx_importer e2e
2024-04-16 12:20:23 +08:00
"AtenMmQint8_basic",
"AtenMatmulQint8_basic",
"AtenMatmulQint8MV_basic",
"AtenMmQMixedSigni8_basic",
"AtenMatmulQMixedSigni8_basic",
"AtenMatmulQMixedSigni8Transpose_basic",
[FxImporter] Add FxImporter config in e2e-test (#3151)
2024-04-13 07:07:56 +08:00
"AtenMmQuint8_basic",
"AtenSubFloatModule_basic",
"BincountMinlengthModule_basic",
"BincountModule_basic",
"BincountStaticSizeModule_basic",
"BoolFloatConstantModule_basic",
"BoolFloatFalseModule_basic",
"BoolFloatTrueModule_basic",
"BoolIntConstantModule_basic",
"BoolIntFalseModule_basic",
"BoolIntTrueModule_basic",
"BroadcastDynamicDimModule_basic",
"CeilFloatModule_basic",
"ConstantBoolParameterModule_basic",
"ContainsIntList_False",
"ContainsIntList_True",
"Conv2dQInt8Module_basic",
"Conv2dWithPaddingDilationStrideStaticModule_depthwise_multiplier",
"ConvTbcModule_basic",
"ConvolutionBackwardModule2DPadded_basic",
"ConvolutionBackwardModule2DStrided_basic",
"ConvolutionBackwardModule2D_basic",
"DivFloatModule_basic",
"DivIntModule_basic",
"ElementwiseAddScalar_NumToTensorFloat_Module_basic",
"ElementwiseDequantizePerChannelModule_basic",
"ElementwiseDequantizePerTensorModule_basic",
"ElementwiseQuantizePerTensorModule_basic",
"ElementwiseQuantizePerTensorUIntModule_basic",
"ElementwiseToDtypeI64ToUI8Module_basic",
"EqIntModule_basic",
"FakeQuantizePerTensorAffineDynamicShapeModule_basic",
"FakeQuantizePerTensorAffineModule_basic",
"FakeQuantizePerTensorAffineRoundToEvenModule_basic",
"FloatImplicitModule_basic",
"GeFloatIntModule_basic",
"GeFloatModule_basic",
"GeIntModule_basic",
"GtFloatIntModule_basic",
"GtIntModule_basic",
"IntFloatModule_basic",
"IntImplicitModule_basic",
"IsFloatingPointFloat_True",
"IsFloatingPointInt_False",
"LenStrModule_basic",
"MulFloatModule_basic",
"MulIntModule_basic",
"NeFloatIntModule_basic",
"NeIntModule_basic",
"NllLossModuleBackward1DMeanWeight_basic",
"NllLossModuleBackward1DMean_basic",
"NllLossModuleBackward1DSumWeight_basic",
"NllLossModuleBackward1DSum_basic",
"NllLossModuleBackward1DWeight_basic",
"NllLossModuleBackward1D_basic",
"NumToTensorFloatModule_basic",
"NumToTensorIntModule_basic",
"NumelModule_basic",
"NumelZeroRankModule_basic",
"PowIntFloatModule_basic",
"PrimMaxIntModule_basic",
"PrimMinIntDynamicModule_basic",
"PrimMinIntModule_basic",
"PrimsSqueezeEmptyDimensionsModule_basic",
"PrimsSqueezeModule_basic",
"PrimsViewOfModule_basic",
"PrimsViewOfZeroRankModule_basic",
"QuantizedMLP_basic",
"QuantizedNoLayer_basic",
"QuantizedSingleLayer_basic",
[CI] Enable the tests for fx_importer in the CI (#3168) Replace the torchdynamo e2e with the fx_importer e2e
2024-04-16 12:20:23 +08:00
"QuantizedBatchedInputSingleLayer_basic",
[FxImporter] Add FxImporter config in e2e-test (#3151)
2024-04-13 07:07:56 +08:00
"ReduceMaxAlongDimUnsignedInt_basic",
"ReduceMinAlongDimUnsignedInt_basic",
"RsubInt0d_NumToTensor_Module_basic",
"ScalarConstantTupleModule_basic",
"ScalarImplicitFloatModule_basic",
"ScalarImplicitIntModule_basic",
"SortIntListReverse_basic",
"SortIntList_basic",
"SplitDimDynamicModule_basic",
"SplitDimStaticModule_basic",
"SqrtIntConstantModule_basic",
"SqrtIntModule_basic",
"SubFloatModule_basic",
"SubIntModule_basic",
"TModuleRank0_basic",
"TensorToBoolZeroRank_basic",
"TensorToBool_basic",
"TensorToFloatZeroRank_basic",
"TensorToFloat_basic",
"TensorToIntZeroRank_basic",
"TensorToInt_basic",
"ThresholdBackward2dMixedModule_basic",
"TorchPrimLoopForLikeModule_basic",
"TorchPrimLoopWhileLikeModule_basic",
"UnbindIntGetItem_Module_basic",
"UnbindIntListUnpack_Module_basic",
"UnsafeIndexPutHackedTwin1DFloatNonAccumulateModule_basic",
"UpSampleNearest2dDynamicFactor_basic",
"ViewCollapseDynamicWithAtenSizeIntModule_basic",
"ViewSizeFromOtherTensor_basic",
}
FX_IMPORTER_CRASHING_SET = {
'TransposeIntModule_basic',
'PermuteModule_basic',
'PermuteNegativeIndexModule_basic',
'TransposeIntNegDimsModule_basic',
'Add_MixPModule_basic',
'EmbeddingModuleI64_basic',
'EmbeddingModuleI32_basic',
'EmbeddingModuleF16_basic',
'EmbeddingModuleI32Static_basic',
'EmbeddingModule1DIndices_basic',
'BroadcastToSameRankStaticModule_basic',
'BroadcastZeroRankInputStaticModule_basic',
'BroadcastListConstructWithMinusOneModule_basic',
'ExpandModule_basic',
'ReturnThreeTensorFloat32_basic',
'AddCDivModule_basic',
'TensorIntModule_basic',
'TensorFloatModule_basic',
'BoolTensorReturnFalseModule_basic',
'BoolTensorReturnTrueModule_basic',
'BoolTensorReturnMixedModule_basic',
'TModuleRank2_basic',
'ReturnTwoTensorF32I64_basic',
'IndexTensorMultiInputNonContiguousDynamic_basic',
'ExpandAsFloatModule_basic',
'ExpandAsIntModule_basic',
'CopyModule_basic',
'CopyWithDifferentSizesModule_basic',
'CopyWithDifferentDTypesModule_basic',
'CopyWithDifferentDTypesAndSizesModule_basic',
'ToCopyModule_basic',
'NumpyTRankNStaticModule_basic',
'NumpyTRankNDynamicModule_basic',
'NumpyTRank2Module_basic',
'Aten_EmbeddingBagExample_basic',
'CumsumModule_basic',
'MoveDimIntModule_basic',
'MoveDimIntNegativeIndexModule_basic',
'ScaledDotProductAttentionDifferentModule_basic',
'AtenComplex64Module_basic',
'Add_Module_basic',
'ResNet18Module_basic',
'ResNet18StaticModule_basic',
'MobilenetV3Module_basic',
'Mlp1LayerModule_basic',
'Mlp2LayerModule_basic',
'Mlp2LayerModuleNoBias_basic',
'BatchMlpLayerModule_basic',
'Conv2dNoPaddingModule_basic',
'Conv2dBiasNoPaddingModule_basic',
'Conv2dWithPaddingModule_basic',
'Conv2dWithPaddingDilationStrideModule_basic',
'Conv2dWithPaddingDilationStrideStaticModule_basic',
'Conv2dWithPaddingDilationStrideStaticModule_depthwise',
'Conv2dWithPaddingDilationStrideStaticModule_grouped',
'Conv2dWithPaddingDilationStrideStaticModule_grouped_multiplier',
'BatchNorm1DModule_basic',
'BatchNorm1DWith2DInputModule_basic',
'BatchNorm2DModule_basic',
'BatchNorm3DModule_basic',
'BatchNorm1DStaticShapeModule_basic',
'NativeBatchNorm1DModule_basic',
'NativeBatchNorm2DModule_basic',
'NativeBatchNorm3DModule_basic',
'NativeBatchNormNoneWeightModule_basic',
'NativeGroupNormBackwardModule_basic',
'LayerNormModule_basic',
'LayerNormLastDimModule_basic',
'LayerNormNormalizeOverAllDimsModule_basic',
'AtenInstanceNormModule_basic',
'ElementwiseUnsqueezeBroadcastModule_basic',
'ElementwiseFlattenBroadcastModule_basic',
'ElementwiseDivScalarModule_basic',
'ElementwiseAtenDivIntScalarModule_basic',
'ElementwiseDivRoundingModeTruncModule_basic',
'ElementwiseDivRoundingModeFloorModule_basic',
'ElementwiseDivRoundingModeTruncStaticModule_basic',
'ElementwiseDivRoundingModeFloorStaticModule_basic',
'ElementwiseDivRoundingModeTruncIntStaticModule_basic',
'ElementwiseDivRoundingModeFloorIntStaticModule_basic',
'ElementwiseSubScalarFloatModule_basic',
'ElementwiseAddScalar_TensorLiteralInt32_Module_basic',
'ElementwiseCloneModule_basic',
'ElementwiseCloneContiguousModule_basic',
'ElementwiseCloneChannelsLastMemoryFormatModule_basic',
'Fill_TensorFloat64WithFloat32_basic',
'Fill_TensorFloat64WithFloat32Static_basic',
'Fill_TensorFloat64WithFloat64_basic',
'Fill_TensorFloat64WithInt64_basic',
'Fill_TensorFloat64WithInt64Static_basic',
'Fill_TensorFloat32WithFloat32_basic',
'Fill_TensorFloat32WithFloat64_basic',
'Fill_TensorFloat32WithInt64_basic',
'TupleModule_basic',
'Matmul_dot',
'UnsafeViewCollapseDynamicWithAtenSizeIntModule_basic',
'SqueezeModule_broadcast',
'SelectIntNegativeDimAndIndexStaticModule_basic',
'NarrowVerticalTest_basic',
'NarrowVerticalTest2_basic',
'SliceCopy_Module_basic',
'SliceCopyNegative_Module_basic',
'SliceCopyStartGreaterThanDimSize_Module_basic',
'SliceCopyEndGreaterThanDimSize_Module_basic',
'SliceCopyNonZeroDim_Module_basic',
'SplitTensorGetItem_Module_basic',
'SplitTensorListUnpackModule_basic',
'SplitTensorLastSmallerModule_basic',
'SplitTensorNegativeDimModule_basic',
'SplitWithSizesListUnpackModule_basic',
'ChunkListUnpack_Module_basic',
'ChunkListUnpackUneven_Module_basic',
'ChunkListUnpackDynamic_Module_basic',
'ChunkListUnpackUnevenDynamic_Module_basic',
'SplitWithSizes_Module_basic',
'ArangeStartOutModule_basic',
'ArangeStartOutDtypeModule_basic',
'FullModuleInt3D_basic',
'ZeroFloat32Module_basic',
'ZeroInt32Module_basic',
'ZeroInt64Module_basic',
'ThresholdBackward1dIntModule_basic',
'ThresholdBackward2dIntModule_basic',
'ThresholdBackward3dIntModule_basic',
'HBC_basic',
'UniformModule_basic',
'UniformStaticShapeModule_basic',
'UniformNoCorrelationModule_basic',
'ExponentialModule_basic',
'BernoulliFloatModule_basic',
'BernoulliTensorModule_basic',
'RandnGeneratorModule_basic',
'RandnGeneratorF64Module_basic',
'IndexPutImpl1DFloatNonAccumulateModule_basic',
'IndexPutImpl2DFloatNonAccumulateModule_basic',
'IndexPutImpl2DImplicitModule_basic',
'IndexPutImpl2DNoneIndexStaticModule_basic',
'IndexPutImpl3DFloatNonAccumulateModule_basic',
'IndexPutImpl1DIntNonAccumulateModule_basic',
'IndexPutImpl1DFloatAccumulateModule_basic',
'IndexPutImpl2DFloatAccumulateModule_basic',
'IndexPutImpl3DFloatAccumulateModule_basic',
'IndexPutImpl1DIntAccumulateModule_basic',
'IndexPut1DFloatNonAccumulateModule_basic',
'IndexPut2DFloatNonAccumulateModule_basic',
'IndexPut3DFloatNonAccumulateModule_basic',
'IndexPut1DIntNonAccumulateModule_basic',
'IndexPut2DIntNonAccumulateModule_basic',
'IndexPut3DIntNonAccumulateModule_basic',
'IndexPut1DFloatAccumulateModule_basic',
'IndexPut2DFloatAccumulateModule_basic',
'IndexPut3DFloatAccumulateModule_basic',
'IndexPut1DIntAccumulateModule_basic',
'IndexPut2DIntAccumulateModule_basic',
'IndexPut3DIntAccumulateModule_basic',
'IndexPutHackedTwin1DFloatNonAccumulateModule_basic',
'IndexPutHackedTwin2DFloatNonAccumulateModule_basic',
'IndexPutHackedTwin3DFloatNonAccumulateModule_basic',
'IndexPutHackedTwin1DIntNonAccumulateModule_basic',
'IndexPutHackedTwin2DIntNonAccumulateModule_basic',
'IndexPutHackedTwin3DIntNonAccumulateModule_basic',
'IndexPutHackedTwin1DFloatAccumulateModule_basic',
'IndexPutHackedTwin2DFloatAccumulateModule_basic',
'IndexPutHackedTwin3DFloatAccumulateModule_basic',
'IndexPutHackedTwin1DIntAccumulateModule_basic',
'IndexPutHackedTwin2DIntAccumulateModule_basic',
'IndexPutHackedTwin3DIntAccumulateModule_basic',
'ScatterValueFloatModule_basic',
'ScatterValueIntModule_basic',
'IndexPutImpl2DIndexModule_basic',
'IndexPutImplIndexWithNoneModule_basic',
'AdaptiveAvgPool2dNonUnitOutputSizeStaticModule_basic',
'AdaptiveAvgPool2dNonUnitOutputSizeDynamicModule_basic',
'AdaptiveAvgPool2dOutputSizeDivisibleByInputDynamicModule_basic',
'AdaptiveAvgPool2dOutputSizeDivisibleByInputStaticModule_basic',
'MaxPool3dModule_basic',
'MaxPool3dModuleRandomSimple_basic',
'MaxPool3dLargeDatadModule_basic',
'MaxPool3dEmptyStrideStaticModule_basic',
'MaxPool3dStaticModule_basic',
'MaxPool3dStaticCeilModeTrueModule_basic',
'MaxPool3dCeilModeTrueModule_basic',
'AdaptiveAvgPool1dStaticEvenMultiple_basic',
'AdaptiveAvgPool1dNonUnitOutputSizeStaticModule_basic',
'AdaptiveAvgPool1dNonUnitOutputSizeDynamicModule_basic',
'TestMultipleTensorReturn_basic',
'TestMultipleTensorAndPrimitiveTypesReturn_basic',
'TestF16Return_basic',
}
mhlo: migrate conversion to stablehlo (#1840) This patch replaces all MHLO operations with their StableHLO counterparts and adds a validation pass to ensure that no MHLO operations remain before translating all Stablehlo operations to the MHLO dialect for further lowering to the Linalg dialect. This patch also updates all lit tests so that they refer to the `convert-torch-to-stablehlo` pass and so that they check for StableHLO operations.
2023-02-02 21:29:47 +08:00
STABLEHLO_PASS_SET = {
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"AdaptiveAvgPool1dNonUnitOutputSizeStaticModule_basic",
"AdaptiveAvgPool1dUnitOutputSizeStaticModule_basic",
"AdaptiveAvgPool2dNonUnitOutputSizeStaticModule_basic",
"AdaptiveAvgPool2dUnitOutputSizeStaticModule_basic",
[Torch] Add general AdaptiveAvgPool2dOp decompose support (#3111) Previously, it could only handle the situations where outputsize == (1, 1) or outputsize == (input_H, input_W). Now it supports all situations where input_H % output_H== 0 && input_W % output_W == 0
2024-04-11 17:02:59 +08:00
"AdaptiveAvgPool2dOutputSizeDivisibleByInputStaticModule_basic",
[Stablehlo] Add converter to stablehlo for aten.(Int,Float,Bool).Tensor op (#2340) [Stablehlo] Add converter to stablehlo for aten.(Int,Float,Bool).Tensor op and configure crashing e2e sets for stablehlo backend.
2023-07-29 21:55:49 +08:00
"AddIntModule_basic",
[MLIR][TORCH] Add e2e support for aten.alias -- This commit adds e2e support for aten.alias op. Signed-off-by: Abhishek Varma <abhishek@nod-labs.com>
2023-06-21 01:14:09 +08:00
"AliasModule_basic",
[Stablehlo] Enable Stablehlo backend with arith dialect (#2139)
2023-05-26 22:57:57 +08:00
"AllBoolFalseModule_basic",
"AllBoolTrueModule_basic",
"AnyBoolFalseModule_basic",
"AnyBoolTrueModule_basic",
Add torch-to-mhlo e2e support for AtenArangeStartStepOp (#1385) Co-authored-by: Vremold <xremold@gamil.com>
2022-09-20 22:31:24 +08:00
"ArangeDtypeFloatModule_basic",
"ArangeDtypeIntModule_basic",
"ArangeFalsePinMemoryModule_basic",
"ArangeFloatModule_basic",
"ArangeIntModule_basic",
"ArangeNegativeStartFloatModule_basic",
"ArangeNegativeStartIntModule_basic",
"ArangeStartFloatModule_basic",
"ArangeStartIntModule_basic",
"ArangeStartNegativeStepFloatModule_basic",
"ArangeStartNegativeStepIntModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"ArangeStartOutDtypeModule_basic",
"ArangeStartOutModule_basic",
Add torch-to-mhlo e2e support for AtenArangeStartStepOp (#1385) Co-authored-by: Vremold <xremold@gamil.com>
2022-09-20 22:31:24 +08:00
"ArangeStartStepFloatModule_basic",
"ArangeStartStepIntModule_basic",
"ArangeZeroElementOutputModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"ArgmaxModule_with_dim",
"AtenComplex64Module_basic",
"AtenFloatScalarModule_basic",
"AtenIntBoolOpConstFalseModule_basic",
"AtenIntBoolOpConstTrueModule_basic",
"AtenIntBoolOpModule_basic",
"AtenIntTensorByteDtypeModule_basic",
"AtenIntTensorCharDtypeModule_basic",
"AtenItemFpOpModule_basic",
"AtenItemIntOpModule_basic",
"AtenMmFloatTypes_basic",
"AtenMmIntTypes_basic",
[Stablehlo] lowering aten.round to stablehlo.round_nearest_even (#3011)
2024-03-12 08:58:20 +08:00
"AtenRoundFloatHalfToEvenModule_basic",
"AtenRoundFloatModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"AtenRoundIntModule_basic",
"AtenSubFloatModule_basic",
"AtenToDeviceModule_basic",
[Torch] Support Aten_CastFloatOp. (#3115) By canonicalize Aten_CastFloatOp into AtenToDtypeOp
2024-04-09 11:06:53 +08:00
"Aten_CastFloatModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"AvgPool1dStaticModule_basic",
"AvgPool2dStaticModule_basic",
"BaddbmmBroadcast1DInputModule_basic",
"BaddbmmBroadcast2DInputModule_basic",
"BaddbmmStaticModule_basic",
"BoolFloatConstantModule_basic",
"BoolFloatFalseModule_basic",
"BoolFloatTrueModule_basic",
"BoolIntConstantModule_basic",
"BoolIntFalseModule_basic",
"BoolIntTrueModule_basic",
"BoolTensorReturnFalseModule_basic",
"BoolTensorReturnMixedModule_basic",
"BoolTensorReturnTrueModule_basic",
"BroadcastListConstructWithMinusOneModule_basic",
fix mhlo e2e ci crashes (#1620) * fix mhlo e2e ci crashes * add passed tests * calc dynamic positive dim
2022-11-21 21:50:35 +08:00
"BroadcastToSameRankStaticModule_basic",
"BroadcastZeroRankInputStaticModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"CeilFloatModule_basic",
"ChunkListUnpackUneven_Module_basic",
"ChunkListUnpack_Module_basic",
"CloneModule_basic",
"ConstantBoolParameterModule_basic",
"ContainsIntList_False",
"ContainsIntList_True",
"ContiguousModule_basic",
"Conv2dWithPaddingDilationStrideStaticModule_basic",
"Conv2dWithPaddingDilationStrideStaticModule_depthwise",
"Conv2dWithPaddingDilationStrideStaticModule_depthwise_multiplier",
"Conv2dWithPaddingDilationStrideStaticModule_grouped",
"Conv2dWithPaddingDilationStrideStaticModule_grouped_multiplier",
"Convolution2DStaticModule_basic",
"ConvolutionBackwardModule2DStatic_basic",
"ConvolutionModule2DTransposeStridedStatic_basic",
"CosineSimilarityStaticBroadcastModule_basic",
"CosineSimilarityStaticModule_basic",
"CumsumInputDtypeInt32Module_basic",
[MHLO] Support aten.cumsum op in mhlo backend (#1825)
2023-01-30 13:38:27 +08:00
"CumsumStaticModule_basic",
"CumsumStaticNegativeDimModule_basic",
[Torch Dialect] fold aten.detach (#2021)
2023-04-18 23:59:14 +08:00
"DetachModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"DivFloatModule_basic",
"DivIntModule_basic",
"DropoutEvalFloatModule_basic",
"DropoutEvalIntModule_basic",
"ElementwiseAbsFloatModule_basic",
"ElementwiseAbsIntModule_basic",
"ElementwiseAddScalar_NumToTensorFloat_Module_basic",
"ElementwiseAddScalar_TensorLiteralInt32_Module_basic",
"ElementwiseAtenIsinfOpModule_basic",
"ElementwiseAtenIsneginfOpModule_basic",
"ElementwiseAtenIsposinfOpModule_basic",
Add e2e support for aten logical or/and/xor/not ops (#1761)
2023-01-04 10:11:25 +08:00
"ElementwiseAtenLogicalAndOpPromoteBroadcastStaticShapeModule_basic",
"ElementwiseAtenLogicalNotOpModule_basic",
"ElementwiseAtenLogicalNotOpPromoteModule_basic",
"ElementwiseAtenLogicalOrOpPromoteBroadcastStaticShapeModule_basic",
"ElementwiseAtenLogicalXorOpPromoteBroadcastStaticShapeModule_basic",
Add more mhlo basic converters (#1628) * Add more mhlo basic converters * remove unused pinnedMemory constraints * refine naming
2022-11-24 14:28:34 +08:00
"ElementwiseAtenWhereSelfModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"ElementwiseBinaryStaticShapeModule_basic",
[LINALG][TOSA][MHLO] Add e2e support for aten bitwise ops (#1753)
2023-01-12 06:40:03 +08:00
"ElementwiseBitwiseAndStaticShapeModule_basic",
"ElementwiseBitwiseNotInt32Module_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"ElementwiseBitwiseNotInt64Module_basic",
[LINALG][TOSA][MHLO] Add e2e support for aten bitwise ops (#1753)
2023-01-12 06:40:03 +08:00
"ElementwiseBitwiseOrStaticShapeModule_basic",
"ElementwiseBitwiseXorStaticShapeModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"ElementwiseCeilModule_basic",
Add AtenClampOp conversion pattern to MHLO (#1356) Add AtenClampOp conversion pattern to MHLO
2022-09-16 15:09:21 +08:00
"ElementwiseClampMaxModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"ElementwiseClampMinModule_basic",
"ElementwiseClampModule_basic",
"ElementwiseClampTensorInt8Module_basic",
"ElementwiseCloneChannelsLastMemoryFormatModule_basic",
"ElementwiseCloneContiguousModule_basic",
"ElementwiseCloneModule_basic",
"ElementwiseCosModule_basic",
Added 2 Ops: Floor divide scalar and Floor divide scalar mode (#3156) - Added linalg lowering for `AtenFloorDivideScalarOp` - Needed `AtenDivScalarModeOp` for the decomp. - Added linalg lowering for `AtenDivScalarModeOp` - Moved linalg payload logic to `createDivModePayload()` since the logic was nearly identical for both `AtenDivScalarModeOp` and `AtenDivTensorModeOp`. Just a template function - Added `AtenDivScalarModeOp` lowering for stablehlo Pytorch's [`torch.floor_divide()`](https://pytorch.org/docs/stable/generated/torch.floor_divide.html) in a previous version (for a reason unknown to me) preformed a truncation instead of "floor". The already implemented op `AtenFloorDivideTensorOp` was done before this change. However, this wasn't caught because our testcases only tested positive floor division. I changed this to floor as well as adding a few test cases.
2024-04-16 04:45:10 +08:00
"ElementwiseDivTensorRoundingModeFloorStaticModule_basic",
"ElementwiseDivTensorRoundingModeTruncStaticModule_basic",
"ElementwiseDivTensorRoundingModeFloorIntStaticModule_basic",
"ElementwiseDivTensorRoundingModeTruncIntStaticModule_basic",
"ElementwiseDivScalarRoundingModeFloorStaticModule_basic",
"ElementwiseDivScalarRoundingModeTruncStaticModule_basic",
"ElementwiseDivScalarRoundingModeFloorIntStaticModule_basic",
"ElementwiseDivScalarRoundingModeTruncIntStaticModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"ElementwiseErfModule_basic",
[MLIR][MHLO] Add AtenFrobeniusNormDimOp and add its conversion pattern to MHLO and linalg (#1306) * Add aten.frobenius_norm.dim op and init its conversion pattern to linalg and MHLO, * run symbolic-shape-optimization before hlo-legalize-to-linalg to fit more mhlo e2e tests.
2022-09-08 10:15:36 +08:00
"ElementwiseExpModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"ElementwiseFloorIntModule_basic",
"ElementwiseFloorModule_basic",
[MLIR][TORCH] Add support for tanh approximation for Gelu op (#2941) Fixes https://github.com/nod-ai/SHARK-Turbine/issues/461 Signed-Off By: Vivek Khandelwal <vivekkhandelwal1424@gmail.com>
2024-02-27 21:56:01 +08:00
"ElementwiseGeluApproximateTanhModule_basic",
Bump LLVM to llvm/llvm-project@0030fc4ac74a9ce645adb9d59e108da4d4d11818 (#3079) Co-authored-by: Peiming Liu <peiming@google.com>
2024-04-02 07:34:59 +08:00
"ElementwiseGeluModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"ElementwiseLeakyReluStaticModule_basic",
[MLIR][MHLO] Add AtenFrobeniusNormDimOp and add its conversion pattern to MHLO and linalg (#1306) * Add aten.frobenius_norm.dim op and init its conversion pattern to linalg and MHLO, * run symbolic-shape-optimization before hlo-legalize-to-linalg to fit more mhlo e2e tests.
2022-09-08 10:15:36 +08:00
"ElementwiseLogModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"ElementwiseNanToNumModule_Basic",
"ElementwiseNeFloatTensorStaticModule_basic",
"ElementwiseNeIntTensorStaticModule_basic",
[MLIR][MHLO] Add AtenFrobeniusNormDimOp and add its conversion pattern to MHLO and linalg (#1306) * Add aten.frobenius_norm.dim op and init its conversion pattern to linalg and MHLO, * run symbolic-shape-optimization before hlo-legalize-to-linalg to fit more mhlo e2e tests.
2022-09-08 10:15:36 +08:00
"ElementwiseNegModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"ElementwiseOrTensorStaticShapeModule_basic",
[Torch] Support Aten__And__ScalarOp (#3114)
2024-04-08 20:24:17 +08:00
"ElementwiseAndScalarStaticShapeModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"ElementwisePowTensorBroadcastStaticModule_basic",
"ElementwisePowTensorStaticModule_basic",
Bump LLVM to llvm/llvm-project@0030fc4ac74a9ce645adb9d59e108da4d4d11818 (#3079) Co-authored-by: Peiming Liu <peiming@google.com>
2024-04-02 07:34:59 +08:00
"ElementwisePreluStaticModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"ElementwiseReciprocalModule_basic",
"ElementwiseReluModule_basic",
[Torch][MHLO] Decompose aten.copy op. Lower aten.rsqrt & sigmoid to mhlo. (#1734)
2022-12-22 10:13:59 +08:00
"ElementwiseRsqrtModule_basic",
"ElementwiseSigmoidModule_basic",
[MHLO] move AtenTanhOp to ConvertAtenUnaryFPOnlyPatten and add sin/cos/ceil/floor pattern (#1847)
2023-02-07 03:14:26 +08:00
"ElementwiseSinModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"ElementwiseSqrtModule_basic",
Replace empty_like && empty_memory_format with full/full_like (#1398) * Replace empty_like && empty_memory_format with full/full_like * fix broadcast rank0 tensor
2022-09-23 10:24:36 +08:00
"ElementwiseToDtypeF32ToI64Module_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"ElementwiseToDtypeI64ToI8Module_basic",
"ElementwiseToDtypeIdentityModule_basic",
"ElementwiseUnaryModule_basic",
[Stablehlo] support dynamic shape when convert aten.fill.Scalar (#2349)
2023-07-27 18:35:25 +08:00
"EmptyLikeMemoryFormatModule_basic",
"EmptyLikeModule_defaultDtype",
"EmptyLikeModule_falsePinMemory",
"EmptyLikeModule_float",
"EmptyLikeModule_int",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"EmptyModule_contiguous",
"EmptyModule_defaultDtype",
"EmptyModule_falsePinMemory",
"EmptyModule_float",
"EmptyModule_int",
"EmptyStridedModule_basic",
"EqIntModule_basic",
Replace empty_like && empty_memory_format with full/full_like (#1398) * Replace empty_like && empty_memory_format with full/full_like * fix broadcast rank0 tensor
2022-09-23 10:24:36 +08:00
"ExpandAsIntModule_basic",
Bump LLVM to llvm/llvm-project@0030fc4ac74a9ce645adb9d59e108da4d4d11818 (#3079) Co-authored-by: Peiming Liu <peiming@google.com>
2024-04-02 07:34:59 +08:00
"FakeQuantizePerTensorAffineModule_basic",
"FakeQuantizePerTensorAffineRoundToEvenModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"Fill_TensorFloat64WithFloat32Static_basic",
[Stablehlo] support dynamic shape when convert aten.fill.Scalar (#2349)
2023-07-27 18:35:25 +08:00
"Fill_TensorFloat64WithFloat32_basic",
"Fill_TensorFloat64WithFloat64_basic",
Add AtenFillScalarOp Stablehlo support (#2108) Co-authored-by: zhekun.zhang <zhekun.zhang@bytedance.com>
2023-05-12 07:41:46 +08:00
"Fill_TensorFloat64WithInt64Static_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"Fill_TensorFloat64WithInt64_basic",
"FlattenRank0Module_basic",
[Stablehlo] add conversion for AtenFlipOp (#2163)
2023-06-15 10:27:34 +08:00
"FlipModuleStaticShape_basic",
"FlipNegativeIndexModule_basic",
Replace empty_like && empty_memory_format with full/full_like (#1398) * Replace empty_like && empty_memory_format with full/full_like * fix broadcast rank0 tensor
2022-09-23 10:24:36 +08:00
"FullLikeModuleDefaultDtype_basic",
"FullLikeModuleFalsePinMemory_basic",
"FullLikeModuleFloat2D_basic",
"FullLikeModuleFloat3DStatic_basic",
"FullLikeModuleFloat3D_basic",
"FullLikeModuleInt2DStatic_basic",
"FullLikeModuleInt2D_basic",
"FullLikeModuleInt3D_basic",
"FullModuleDefaultDtype_basic",
"FullModuleFalsePinMemory_basic",
"FullModuleFloat2D_basic",
"FullModuleFloat3D_basic",
"FullModuleInt2D_basic",
"FullModuleInt3D_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"GeFloatIntModule_basic",
"GeFloatModule_basic",
"GeIntModule_basic",
Added GeluBackward: MHLO support (#1725)
2022-12-21 20:09:43 +08:00
"GeluBackwardModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"GluStaticModule_basic",
"GtFloatIntModule_basic",
"GtIntModule_basic",
[Stablehlo] Add `AtenIndexTensor` StableHlo support (#2107) * Add AtenIndexTensor StableHlo support * clean up * Empty commit, trigger test * try to debug hanging test * fix segfulat * fix bad include --------- Co-authored-by: zhekun.zhang <zhekun.zhang@bytedance.com>
2023-05-25 02:13:57 +08:00
"IndexTensorMultiIndexStaticModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"IndexTensorStaticModule_basic",
"IntFloatModule_basic",
"IsFloatingPointFloat_True",
"IsFloatingPointInt_False",
Add E2E support for LeakyRelu and LeakyReluBackward ops (#1733) Co-authored-by: srirammaswamy <srirammaswamy@gmail.com>
2023-01-04 00:30:16 +08:00
"LeakyReluBackwardStaticModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"LenStrModule_basic",
"LiftFreshCopyModule_basic",
Bump LLVM to llvm/llvm-project@0030fc4ac74a9ce645adb9d59e108da4d4d11818 (#3079) Co-authored-by: Peiming Liu <peiming@google.com>
2024-04-02 07:34:59 +08:00
"LinspaceDtypeModule_basic",
"LinspaceEmptyModule_basic",
"LinspaceModule_basic",
"LinspaceOneSizeModule_basic",
"LinspaceTwoSizeModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"MaskedFillScalarFloatValueStaticModule_basic",
"MaskedFillScalarIntValueStaticModule_basic",
"Matmul4dStatic_basic",
"Matmul_2d",
"Matmul_dot",
"Matmul_matvec",
"Matmul_vecmat",
[Stablehlo] Enhance broadcast pattern in matmul Ops (#3161) To pass test "MatmulStaticBroadcast_basic" in stablehlo: ```python class MatmulStaticBroadcast(torch.nn.Module): def __init__(self): super().__init__() @export @annotate_args([ None, ([4, 1, 6, 7], torch.float32, True), ([8, 1, 5, 7, 6], torch.float32, True), ]) def forward(self, lhs, rhs): return torch.matmul(lhs, rhs) @register_test_case(module_factory=lambda: MatmulStaticBroadcast()) def MatmulStaticBroadcast_basic(module, tu: TestUtils): module.forward(tu.rand(4, 1, 6, 7), tu.rand(8, 1, 5, 7, 6)) ```
2024-04-16 10:10:36 +08:00
"MatmulStaticBroadcast_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"MaxPool2dStaticModule_basic",
"MeanDimAllReduceModule_basic",
fix #1626 return type mismatch (#1634)
2022-11-23 15:02:41 +08:00
"MeanDimEmptyDimModule_basic",
[MLIR][MHLO] Add AtenFrobeniusNormDimOp and add its conversion pattern to MHLO and linalg (#1306) * Add aten.frobenius_norm.dim op and init its conversion pattern to linalg and MHLO, * run symbolic-shape-optimization before hlo-legalize-to-linalg to fit more mhlo e2e tests.
2022-09-08 10:15:36 +08:00
"MeanDtypeModule_basic",
fix #1626 return type mismatch (#1634)
2022-11-23 15:02:41 +08:00
"MeanDynamicSizesModule_basic",
"MeanModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"Mlp2LayerModuleNoBias_basic",
"MmDagModule_basic",
"MmModule_basic",
"MmModule_chained",
[MLIR][MHLO] Add AtenFrobeniusNormDimOp and add its conversion pattern to MHLO and linalg (#1306) * Add aten.frobenius_norm.dim op and init its conversion pattern to linalg and MHLO, * run symbolic-shape-optimization before hlo-legalize-to-linalg to fit more mhlo e2e tests.
2022-09-08 10:15:36 +08:00
"MmTanhModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"MoveDimIntModule_basic",
"MoveDimIntNegativeIndexModule_basic",
"MulFloatModule_basic",
"MulIntModule_basic",
fix mhlo e2e ci crashes (#1620) * fix mhlo e2e ci crashes * add passed tests * calc dynamic positive dim
2022-11-21 21:50:35 +08:00
"Mv_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"NarrowHorizontalTest2_basic",
"NarrowHorizontalTest_basic",
"NarrowTensorHorizontalModule_basic",
"NarrowTensorVerticalModule_basic",
"NarrowVerticalTest2_basic",
"NarrowVerticalTest_basic",
"NativeDropoutEvalFloatModule_basic",
"NeFloatIntModule_basic",
"NeIntModule_basic",
[StableHlo] Support AtenEmptyMemoryFormatOp (#2092) * add empty conversion * clean up * add tests --------- Co-authored-by: zhekun.zhang <zhekun.zhang@bytedance.com>
2023-05-19 10:07:35 +08:00
"NewEmptyModuleDefaultDtype_basic",
"NewEmptyModuleFalsePinMemory_basic",
"NewEmptyModuleFloat2D_basic",
"NewEmptyModuleFloat3D_basic",
"NewEmptyModuleInt2D_basic",
"NewEmptyModuleInt3D_basic",
"NewEmptyModuleLayoutIntDtype_basic",
"NewEmptyModuleNonDefaultFloatDtype_basic",
"NewEmptyModuleNonDefaultIntDtype_basic",
"NewEmptyStridedModuleDefaultDtype_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"NewFullModuleDefaultDtype_basic",
"NewFullModuleFalsePinMemory_basic",
"NewFullModuleFloat3DStatic_basic",
"NewFullModuleFloat3D_basic",
"NewFullModuleInt2D_basic",
"NewFullModuleInt3D_basic",
[MHLO] Init end to end unit tests (#1223)
2022-08-23 16:47:21 +08:00
"NewOnesModuleDefaultDtype_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"NewOnesModuleFalsePinMemory_basic",
[MHLO] Init end to end unit tests (#1223)
2022-08-23 16:47:21 +08:00
"NewOnesModuleFloat2D_basic",
"NewOnesModuleFloat3D_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"NewOnesModuleInt2D_basic",
"NewOnesModuleInt3D_basic",
"NewZerosModuleDefaultDtype_basic",
"NewZerosModuleFalsePinMemory_basic",
"NewZerosModuleFloat2D_basic",
"NewZerosModuleFloat3D_basic",
"NewZerosModuleInt2D_basic",
"NewZerosModuleInt3D_basic",
[TOSA] Add support for AtenZerosOp 0/strided layout (#1983)
2023-03-30 22:08:20 +08:00
"NewZerosStaticModuleLayoutStrided_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"NumToTensorFloatModule_basic",
"NumToTensorIntModule_basic",
"NumelModule_basic",
"NumelZeroRankModule_basic",
"NumpyTRank0Module_basic",
"NumpyTRank1Module_basic",
"NumpyTRank2Module_basic",
"NumpyTRankNDynamicModule_basic",
"NumpyTRankNStaticModule_basic",
"OnesLikeModule_defaultDtype",
"OnesLikeModule_falsePinMemory",
"OnesLikeModule_float",
"OnesLikeModule_int",
"OnesModuleCPUDevice_basic",
"OnesModuleDefaultDtype_basic",
"OnesModuleFalsePinMemory_basic",
"OnesModuleFloat_basic",
"OnesModuleInt_basic",
"Permute0RankModule_basic",
"PermuteModule_basic",
"PermuteNegativeIndexModule_basic",
"PowIntFloatModule_basic",
[Torch] Fix PrimListUnpackOp::getCanonicalizationPatterns (#3140) Fix the case PrimListUnpackOp's result num is not equal to PrimList length. See the following example: ```python def forward(self, x): if len(x.shape) == 5: b0, t, c0, h0, w0 = x.shape b, c, h, w = torch.mul(b0, t), c0, h0, w0 else: b1, c1, h1, w1 = x.shape b, c, h, w = b1, c1, h1, w1 res = torch.reshape(x, [b, c, h, w]) return res ``` Without this fix, the following error message will occur： ``` /root/torch-mlir/externals/llvm-project/mlir/lib/IR/PatternMatch.cpp:118: virtual void mlir::RewriterBase::replaceOp(mlir::Operation *, mlir::ValueRange): Assertion `op->getNumResults() == newValues.size() && "incorrect # of replacement values"' failed. ```
2024-04-11 19:48:49 +08:00
"PrimListUnpackNumMismatchModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"PrimMaxIntModule_basic",
"PrimMinIntDynamicModule_basic",
"PrimMinIntModule_basic",
"PrimsConvertElementTypeModule_basic",
"PrimsSqueezeEmptyDimensionsModule_basic",
"PrimsViewOfModule_basic",
"PrimsViewOfZeroRankModule_basic",
"RandIntDtypeModule_basic",
"RandIntLowDtypeModule_basic",
"RandIntLowModule_basic",
"RandIntModule_basic",
"RandIntPinMemoryModule_basic",
[stablehlo] Fix test stablehlo e2e test suite (#3093) There is an issue with stablehlo's linalg compilation. Canonicalization appears to cleanup the issues until we can determine what in mlir/stablehlo is the source of the issue.
2024-04-02 12:40:00 +08:00
"ReduceAmaxMultiDim_basic",
"ReduceAmaxOutOfOrderDim_basic",
"ReduceAmaxSingleDim_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"ReduceFrobeniusNormModule_basic",
[stablehlo] Fix test stablehlo e2e test suite (#3093) There is an issue with stablehlo's linalg compilation. Canonicalization appears to cleanup the issues until we can determine what in mlir/stablehlo is the source of the issue.
2024-04-02 12:40:00 +08:00
"ReduceMaxAllDims_basic",
"ReduceMaxAlongDimNegative_basic",
"ReduceMaxAlongDimSignedInt_basic",
"ReduceMaxAlongDim_basic",
"ReduceMaxFloatModule_basic",
"ReduceMaxSignedIntModule_basic",
"ReduceMaxUnsignedIntModule_basic",
"ReduceMinFloatModule_basic",
"ReduceMinSignedIntModule_basic",
"ReduceMinUnsignedIntModule_basic",
"ReduceSumDimIntListDtypeFloatModule_basic",
"ReduceSumDimIntListDtypeIntModule_basic",
"ReduceSumDimIntListElementTypeBoolModule_basic",
"ReduceSumDimIntListEmptyDimModule_basic",
"ReduceSumDimIntListFloatModule_basic",
"ReduceSumDimIntListIntModule_basic",
"ReduceSumDtypeFloatModule_basic",
"ReduceSumDtypeIntModule_basic",
"ReduceSumElementTypeBoolModule_basic",
"ReduceSumFloatModule_basic",
"ReduceSumSignedIntModule_basic",
[MHLO] Init end to end unit tests (#1223)
2022-08-23 16:47:21 +08:00
"ReduceSumUnsignedIntModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"ReturnThreeTensorFloat32_basic",
"ReturnTwoTensorF32I64_basic",
"RollModule_basic",
"RsubInt0d_NumToTensor_Module_basic",
"ScalarConstantTupleModule_basic",
"ScalarImplicitFloatModule_basic",
"ScalarImplicitIntModule_basic",
"ScalarTensorDefaultDtypeModule_basic",
"ScalarTensorFloat32Module_basic",
"ScalarTensorInt32Module_basic",
"ScalarTensorInt64Module_basic",
"SliceModule_basic",
"SliceNegIdxModule_basic",
"SliceOutOfLowerBoundStartIndexModule_basic",
"SliceOutOfUpperBoundIndexModule_basic",
"SliceOutOfUpperBoundIndexStaticModule_basic",
"SliceScatterModule_basic",
"SliceScatterNegativeDimModule_basic",
"SliceScatterNegativeEndModule_basic",
"SliceScatterStaticModule_basic",
"SliceScatterStepVariationModule_basic",
"SliceScatterZeroDimModule_basic",
"SliceSizeTwoStepModule_basic",
"SliceStartEqEndModule_basic",
"SliceStaticModule_basic",
"SliceWholeTensorModule_basic",
"SortIntListReverse_basic",
"SortIntList_basic",
"SplitTensorGetItem_Module_basic",
"SplitTensorLastSmallerModule_basic",
"SplitTensorListUnpackModule_basic",
"SplitTensorNegativeDimModule_basic",
"SplitWithSizesListUnpackModule_basic",
"SqrtIntConstantModule_basic",
"SqrtIntModule_basic",
"SqueezeDimModule_identity",
"SqueezeDimModule_unitDim",
"SqueezeModule_allUnitDim",
"SubFloatModule_basic",
"SubIntModule_basic",
"TModuleRank0_basic",
"TModuleRank1_basic",
[MHLO] Init end to end unit tests (#1223)
2022-08-23 16:47:21 +08:00
"TModuleRank2_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"TensorIntModule_basic",
[MHLO] Init end to end unit tests (#1223)
2022-08-23 16:47:21 +08:00
"TensorLiteralModule_basic",
"TensorOpaqueLiteralModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"TensorToBoolZeroRank_basic",
"TensorToFloatZeroRank_basic",
"TensorToIntZeroRank_basic",
"TensorsConcatModule_basic",
"TensorsConcatNegativeDimModule_basic",
"TensorsConcatNegativeDimStaticModule_basic",
"TensorsConcatPromoteDTypeModule_basic",
"TensorsConcatStaticModule_basic",
"TestF16Return_basic",
"TestMultipleTensorAndPrimitiveTypesReturn_basic",
"TestMultipleTensorReturn_basic",
"ToCopyBoolDTypeStaticModule_basic",
fix mhlo e2e ci crashes (#1620) * fix mhlo e2e ci crashes * add passed tests * calc dynamic positive dim
2022-11-21 21:50:35 +08:00
"ToDtypeBoolLayoutNoneStaticModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"ToDtypeLayoutCPUModule_basic",
Replace empty_like && empty_memory_format with full/full_like (#1398) * Replace empty_like && empty_memory_format with full/full_like * fix broadcast rank0 tensor
2022-09-23 10:24:36 +08:00
"ToDtypeLayoutNoneModule_basic",
"ToDtypeLayoutStridedModule_basic",
Bump LLVM to llvm/llvm-project@0030fc4ac74a9ce645adb9d59e108da4d4d11818 (#3079) Co-authored-by: Peiming Liu <peiming@google.com>
2024-04-02 07:34:59 +08:00
"TorchPrimLoopForLikeTensorArgModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"TransposeIntModule_basic",
"TransposeIntNegDimsModule_basic",
"TupleModule_basic",
[torch-dialect] fix aten.type_as op's folder (#2283) [torch-dialect] fix torch.type_as op's folder by decomposing it to prim.dtype + aten.to_dtype
2023-07-20 09:51:58 +08:00
"TypeAsDifferentModule_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"TypeAsSameModule_basic",
Replace empty_like && empty_memory_format with full/full_like (#1398) * Replace empty_like && empty_memory_format with full/full_like * fix broadcast rank0 tensor
2022-09-23 10:24:36 +08:00
"TypeConversionF32ToF64Module_basic",
"TypeConversionF64ToF32Module_basic",
"TypeConversionI1ToF32Module_basic",
"TypeConversionI1ToF64Module_basic",
"TypeConversionI1ToI32Module_basic",
"TypeConversionI1ToI64Module_basic",
"TypeConversionI32ToI64Module_basic",
"TypeConversionI64ToI32Module_basic",
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
"UnsafeView1DFoldModule_basic",
"View1DFoldModule_basic",
"ZeroFloat32Module_basic",
"ZeroInt32Module_basic",
"ZeroInt64Module_basic",
"ZerosLikeModule_defaultDtype",
"ZerosLikeModule_falsePinMemory",
"ZerosLikeModule_float",
"ZerosLikeModule_int",
"ZerosModuleDefaultDtype_basic",
"ZerosModuleFalsePinMemory_basic",
"ZerosModuleFloat2D_basic",
"ZerosModuleFloat3D_basic",
"ZerosModuleInt2D_basic",
"ZerosModuleInt3D_basic",
[Stablehlo] add stablehlo-canonicalize-dynamism when lowering (#3097) so that many stablehlo e2e testcases could pass
2024-04-02 22:47:24 +08:00
"AtenEmbeddingBagStaticModule_basic",
"AtenEyeMModuleCPUDevice_basic",
"AtenEyeMModuleDefaultDtype_basic",
"AtenEyeMModuleFalsePinMemory_basic",
"AtenEyeMModuleFloat2D_basic",
"AtenEyeMModuleInt2D_basic",
"AtenEyeModuleCPUDevice_basic",
"AtenEyeModuleDefaultDtype_basic",
"AtenEyeModuleFalsePinMemory_basic",
"AtenEyeModuleFloat2D_basic",
"AtenEyeModuleInt2D_basic",
"AtenInstanceNormModule_basic",
"AtenLinalgCrossBroadcast_basic",
"AtenLinalgCrossCustomDim_basic",
"AtenLinalgCrossFloat_basic",
"AtenLinalgCrossInt_basic",
"AtenLinalgCrossNegativeDim_basic",
"BucketizeTensorStaticFloatModule_basic",
"BucketizeTensorStaticModule_basic",
"DropoutTrainStaticShapeModule_basic",
"ElementwiseWhereScalarOtherStaticModule_basic",
"ElementwiseWhereScalarSelfStaticModule_basic",
"EmbeddingModule1DIndices_basic",
"EmbeddingModuleF16_basic",
"EmbeddingModuleI32Static_basic",
"EmbeddingModuleI32_basic",
"EmbeddingModuleI64_basic",
"GatherStaticModule_basic",
"IndexSelectDynamicIndexSizeModule_basic",
"IndexSelectNegativeDimModule_basic",
"IndexSelectSingleIdxModule_basic",
"IndexSelectTwoIdxModule_basic",
"IndexSelectWholeDimensionModule_basic",
"IndexSelectWholeTensorModule_basic",
"IndexTensorStaticContiguousWithNoneModule_basic",
"IndexTensorStaticNonContiguousWithNoneModule_basic",
"LayerNormLastDimModule_basic",
"LayerNormModule_basic",
"LayerNormNormalizeOverAllDimsModule_basic",
"MaxPool2dWithIndicesStaticModule_basic",
"MeanDimAllReduceKeepdimModule_basic",
"NativeDropoutTrainStaticShapeModule_basic",
"NativeLayerNormModule4D_basic",
"NativeLayerNormModule_basic",
"NormalizeModule_basic",
"PrimsSqueezeModule_basic",
"RandModule_basic",
"ReduceSumDimIntListKeepDimNegativeDimStaticModule_basic",
"SelectIntNegativeDimAndIndexStaticModule_basic",
"SelectScattertStaticModule_basic",
"SqueezeDimModule_static",
"SqueezeModule_static",
"TriuBroadcastModule_basic",
"TriuModule_basic",
"UnbindIntGetItem_Module_basic",
"UnbindIntListUnpack_Module_basic",
"UniformStaticShapeModule_basic",
[Stablehlo] add stablehlo-aggressive-simplification in e2e test (#3109) * so that more stablehlo e2e testcases would pass.
2024-04-07 10:48:11 +08:00
"ArangeStartOutViewModule_basic",
"ConvolutionBackwardModule2DStrided_basic",
"EinsumStaticContractRhsModule_basic",
"EinsumStaticFourDimensionModule_basic",
"EinsumStaticModule_basic",
"EinsumStaticWithEllipsisSlicingAndBroadcastModule_basic",
"EinsumStaticWithEllipsisSlicingModule_basic",
"FlattenStaticModule_basic",
"GroupNormModule_basic",
"GroupNormNoWeightAndBiasModule_basic",
"NativeGroupNormModule_basic",
"RepeatModule_basic",
"ReshapeAliasCollapseModule_basic",
"ReshapeAliasExpandModule_basic",
"ReshapeAsModule_basic",
"ReshapeExpandModule_basic",
"TileBigDimsSizeModule_basic",
"TileSmallDimsSizeModule_basic",
"UnflattenIntNegativeOneDimStaticModule_basic",
"UnflattenIntNegativeOneSizeStaticModule_basic",
"UnflattenIntStaticModule_basic",
"UnflattenStaticModule_basic",
"UniformNoCorrelationModule_basic",
"UnsafeViewCollapseModule_basic",
"UnsafeViewDynamicExpandModule_basic",
"UnsafeViewExpandModule_basic",
"ViewCollapseInferredDimModule_basic",
"ViewCollapseModule_basic",
"ViewCollapseOnesMiddleModule_basic",
"ViewDynamicExpandCollapseModule_basic",
"ViewDynamicExpandModule_basic",
"ViewExpandCollapseModule_basic",
"ViewExpandCollapseWithOnesModule_basic",
"ViewExpandDynamicDimModule_basic",
"ViewExpandInferredDimModule_basic",
"ViewExpandModule_basic",
"ViewExpandOnesBeforeAndAfterModule_basic",
"ViewExpandOnesMiddleModule_basic",
"ViewExpandOnesModule_basic",
"ViewNegativeStaticModule_basic",
"ViewNoChange1dModule_basic",
"ViewNoChange2dModule_basic",
"ViewNoChange3dModule_basic",
"ViewNoChangeStaticModule_basic",
"ViewOffsetBackwardTestStaticModule_basic",
"ViewOffsetTestStaticModule_basic",
"ViewTwoFiveThreeStaticModule_basic",
"ViewTwoToThreeStaticModule_basic",
[Stablehlo] lowering aten.log1p to stablehlo.log_plus_one (#3110)
2024-04-07 17:01:58 +08:00
"ElementwiseLog1pModule_basic",
[Torch Dialect] canonicalize aten.sign to aten.sgn (#3112) * `aten.sign` is a sub-set of `aten.sgn` (`aten.sgn` support complex type).
2024-04-08 20:05:42 +08:00
"ElementwiseSgnModule_basic",
"ElementwiseSignIntModule_basic",
[MHLO] Init end to end unit tests (#1223)
2022-08-23 16:47:21 +08:00
}
[Stablehlo] add refbackend (#2712)
2024-02-16 01:08:48 +08:00
STABLEHLO_CRASHING_SET = {
"AtenEmbeddingBagSumExample_basic",
[Stablehlo] Add converter to stablehlo for aten.(Int,Float,Bool).Tensor op (#2340) [Stablehlo] Add converter to stablehlo for aten.(Int,Float,Bool).Tensor op and configure crashing e2e sets for stablehlo backend.
2023-07-29 21:55:49 +08:00
}
Add a basic TOSA E2E backend. We lower through linalg-on-tensors and use RefBackend to run it. This adds enough support for a "tanh" op. Adding more ops should be fairly mechanical now that things are wired up. Run with: ``` ./tools/torchscript_e2e_test.sh -c tosa ``` The backend structure is very similar to linalg-on-tensors based E2E backends and is a nice parallel (see `tosa_backend.py`). Actually, this forced a nice refactoring to the layering here. We removed `torchscript-module-to-linalg-on-tensors-backend-pipeline` and instead require separately running ``` torchscript-function-to-torch-backend-pipeline,torch-backend-to-linalg-on-tensors-backend-pipeline ``` This highlights the step that lowers to the "torch backend contract" of cleaned up `torch` dialect ops is a critical step in the lowering. Going forward, that is the key load-bearing contract of the torch-mlir project, not the linalg-on-tensors backend contract. Recommended review order: - `TorchToTosa.cpp` / `TorchToTosa/basic.mlir` - `python/torch_mlir_e2e_test/torchscript/configs/tosa_backend.py` and the new `utils.py` file there. - `python/torch_mlir_e2e_test/tosa_backends/linalg_on_tensors.py` and `abc.py` in that directory for the TOSA backend e2e interface. - other misc mechanical changes
2021-10-08 10:07:03 +08:00
# Write the TOSA set as a "passing" set as it is very early in development
# and very few tests work yet.
Bump llvm-project to f1b922188ead5ca492c8d8edd47921b013a22ae0. Includes a fix to use `add_mlir_public_c_api_library` for Torch-MLIR's CAPI library, which is now required (note: upstream sample has it the right way). Disabled a TOSA test per discussion: https://github.com/llvm/torch-mlir/issues/379
2021-10-26 02:43:21 +08:00
TOSA_PASS_SET = {
[Torch Dialect] canonicalize aten.sign to aten.sgn (#3112) * `aten.sign` is a sub-set of `aten.sgn` (`aten.sgn` support complex type).
2024-04-08 20:05:42 +08:00
"ElementwiseSgnModule_basic",
"ElementwiseSignIntModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"AdaptiveAvgPool2dNonUnitOutputSizeStaticModule_basic",
"AdaptiveAvgPool2dUnitOutputSizeStaticModule_basic",
[Torch] Add general AdaptiveAvgPool2dOp decompose support (#3111) Previously, it could only handle the situations where outputsize == (1, 1) or outputsize == (input_H, input_W). Now it supports all situations where input_H % output_H== 0 && input_W % output_W == 0
2024-04-11 17:02:59 +08:00
"AdaptiveAvgPool2dOutputSizeDivisibleByInputStaticModule_basic",
lowered addcmul and addcdiv to linalg
2021-11-25 06:01:48 +08:00
"AddCDivModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"AddCDiv_Module_basic",
"AddCMulModule_basic",
"AddCMul_Module_basic",
"Add_Module_basic",
"AliasModule_basic",
"ArangeDtypeFloatModule_basic",
"ArangeIntModule_basic",
"ArangeNegativeStartIntModule_basic",
"ArangeStartIntModule_basic",
"ArangeStartNegativeStepIntModule_basic",
"ArangeStartOutModule_basic",
"ArangeStartOutViewModule_basic",
"ArangeStartStepIntModule_basic",
"ArangeZeroElementOutputModule_basic",
Add support for torch arange float module (#2749) Added Support for float dtype in in torch.arange in TOSA Dialect This resolves the following issue :- https://github.com/llvm/torch-mlir/issues/2762 The following test cases are passing after this change 1. ArangeDtypeIntModule_basic 2. ArangeFloatModule_basic 3. ArangeNegativeStartFloatModule_basic 4. ArangeStartFloatModule_basic 5. ArangeStartNegativeStepFloatModule_basic 6. ArangeStartOutDtypeModule_basic 7. ArangeStartStepFloatModule_basic --------- Co-authored-by: James Newling <james.newling@gmail.com>
2024-02-28 05:40:55 +08:00
"ArangeDtypeIntModule_basic",
"ArangeFalsePinMemoryModule_basic",
"ArangeFloatModule_basic",
"ArangeNegativeStartFloatModule_basic",
"ArangeStartFloatModule_basic",
"ArangeStartNegativeStepFloatModule_basic",
"ArangeStartOutDtypeModule_basic",
"ArangeStartStepFloatModule_basic",
Dynamic size support for flatten (#3005) Added support for dynamic shapes in `flattenusingints` op in tosa dialect. Due to this some Argmax tests pass This PR fixes this issue https://github.com/llvm/torch-mlir/issues/3004 The following tests pass after this PR ``` 1. "ArgmaxIntModule_basic" 2. "ArgmaxIntModule_multiple_maxs" 3. "ArgmaxModule_basic" ```
2024-03-20 06:19:29 +08:00
"ArgmaxIntModule_basic",
"ArgmaxIntModule_multiple_maxs",
"ArgmaxModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ArgmaxModule_keepDim",
"AtenComplex64Module_basic",
"AtenEyeMModuleCPUDevice_basic",
"AtenEyeMModuleDefaultDtype_basic",
"AtenEyeMModuleFalsePinMemory_basic",
"AtenEyeMModuleFloat2D_basic",
"AtenEyeModuleCPUDevice_basic",
"AtenEyeModuleDefaultDtype_basic",
"AtenEyeModuleFalsePinMemory_basic",
"AtenEyeModuleFloat2D_basic",
"AtenRoundIntModule_basic",
OnnxToTorch support for onnx.InstanceNormalization op (#2710) https://github.com/nod-ai/SHARK-Turbine/issues/327
2024-02-19 22:23:48 +08:00
"AtenInstanceNormModule_basic",
Add lowering for aten.to.device (#1107)
2022-08-11 07:24:02 +08:00
"AtenToDeviceModule_basic",
[Torch] Support Aten_CastFloatOp. (#3115) By canonicalize Aten_CastFloatOp into AtenToDtypeOp
2024-04-09 11:06:53 +08:00
"Aten_CastFloatModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"BaddbmmBroadcast1DInputModule_basic",
"BaddbmmBroadcast2DInputModule_basic",
"BaddbmmDynamicModule_basic",
"BaddbmmStaticModule_basic",
"BaddbmmWithAlphaBetaModule_basic",
"BaddbmmWithAlphaModule_basic",
"BaddbmmWithBetaModule_basic",
"BatchNorm1DModule_basic",
"BatchNorm1DStaticShapeModule_basic",
"BatchNorm1DWith2DInputModule_basic",
"BatchNorm2DModule_basic",
"BatchNorm3DModule_basic",
[MLIR][TORCH] Add different dtype support for aten.bmm op Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2023-09-11 20:58:59 +08:00
"BmmFloatModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"BoolTensorHandleSignless_basic",
"BoolTensorReturnFalseModule_basic",
"BoolTensorReturnMixedModule_basic",
"BoolTensorReturnTrueModule_basic",
"BroadcastListConstructWithMinusOneModule_basic",
"BroadcastToSameRankStaticModule_basic",
"BroadcastZeroRankInputStaticModule_basic",
"BucketizeTensorStaticFloatModule_basic",
"BucketizeTensorStaticModule_basic",
[Torch Dialect] add fold pattern for aten.clone (#2804)
2024-01-31 09:43:21 +08:00
"CloneModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ChunkListUnpackUneven_Module_basic",
"ChunkListUnpack_Module_basic",
"ConstantBoolParameterModule_basic",
"ConstantPad2dStaticModule_basic",
"ConstantPadNdModule_basic",
"ConstantPadNdPartialStaticModule_basic",
"ConstantPadNdStaticModule_basic",
"ContiguousModule_basic",
"Conv2dBiasNoPaddingModule_basic",
"Conv2dNoPaddingModule_basic",
"Conv2dWithPaddingDilationStrideModule_basic",
"Conv2dWithPaddingDilationStrideStaticModule_basic",
"Conv2dWithPaddingDilationStrideStaticModule_depthwise",
"Conv2dWithPaddingDilationStrideStaticModule_depthwise_multiplier",
"Conv2dWithPaddingModule_basic",
"Convolution2DStaticModule_basic",
torch-to-tosa lowering support for AtenLinalgVectorNormOp (#2734) This PR add torch-to-tosa lowering support for AtenLinalgVectorNormOp e2e test: python -m e2e_testing.main --config=tosa LIT tests: cmake --build build --target tools/torch-mlir/all --------- Co-authored-by: Ze Zhang <ze.zhang@getcruise.com>
2024-01-19 04:32:23 +08:00
"CosineSimilarityStaticModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"DetachModule_basic",
"DropoutEvalFloatModule_basic",
"DropoutEvalIntModule_basic",
"DropoutModule_basic",
[Torch Dialect] Support Einsum Op (#2230) As title, support torch.aten.einsum op Right now only support Static Shape, because of the known issue, the fixed solution is here: https://github.com/llvm/torch-mlir/pull/2154 Co-authored-by: Jiawei Wu [wujiawei.aml@bytedance.com](mailto:wujiawei.aml@bytedance.com)
2023-12-10 12:30:37 +08:00
"EinsumStaticContractRhsModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"EinsumStaticFourDimensionModule_basic",
"EinsumStaticModule_basic",
[Torch] support decompose aten.einsum with ellipsis slicing (#3056)
2024-03-28 03:42:10 +08:00
"EinsumStaticWithEllipsisSlicingModule_basic",
"EinsumStaticWithEllipsisSlicingAndBroadcastModule_basic",
Add lowering support for math::AbsIOp (#2875) There is no lowering support for math::AbsIOp, so if the operand is an integer type, it will fail to lower to math::AbsFOp since the op operand #0 must be floating-point-like.
2024-02-09 06:53:40 +08:00
"ElementwiseAbsFloatModule_basic",
"ElementwiseAbsIntModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ElementwiseAddModule_basic",
"ElementwiseAddScalarFloatModule_basic",
"ElementwiseAddScalarInt64Module_basic",
"ElementwiseAddScalarInt8Module_basic",
"ElementwiseAddScalarIntModule_basic",
"ElementwiseAddScalar_TensorLiteralInt32_Module_basic",
"ElementwiseAtenDivIntScalarModule_basic",
lower torch.aten.isinf to linalg (#2638) Co-authored-by: Rob Suderman <rob.suderman@gmail.com>
2023-12-29 09:20:32 +08:00
"ElementwiseAtenIsinfOpModule_basic",
[Torch Dialect] support aten.isneginf, aten.isposinf, aten.nan_to_num (#2743)
2024-01-16 14:29:34 +08:00
"ElementwiseAtenIsneginfOpModule_basic",
"ElementwiseAtenIsposinfOpModule_basic",
Handle torch.none type in tosa.clamp op (#2739) This PR updates the torch-to-tosa conversion with following changes: - Support torch.none as min/max input argument for tosa.clamp op - Support negative value as start index for tosa.slice op - Add tosa.logical_or lowering support e2e test: python -m e2e_testing.main --config=tosa LIT tests: cmake --build build --target tools/torch-mlir/all --------- Co-authored-by: Ze Zhang <ze.zhang@getcruise.com>
2024-01-12 02:36:48 +08:00
"ElementwiseAtenLogicalOrOpBrodcastModule_basic",
"ElementwiseAtenLogicalOrOpDiffArgs1Module_basic",
"ElementwiseAtenLogicalOrOpDiffArgs2Module_basic",
"ElementwiseAtenLogicalOrOpDiffArgs3Module_basic",
"ElementwiseAtenLogicalOrOpModule_basic",
"ElementwiseAtenLogicalOrOpNegativeModule_basic",
"ElementwiseAtenLogicalOrOpPromoteBroadcastStaticShapeModule_basic",
"ElementwiseAtenLogicalOrOpRandomFloatModule_basic",
"ElementwiseAtenLogicalOrOpRandomModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ElementwiseAtenWhereSelfModule_basic",
"ElementwiseBinaryModule_basic",
"ElementwiseBinaryStaticShapeModule_basic",
[LINALG][TOSA][MHLO] Add e2e support for aten bitwise ops (#1753)
2023-01-12 06:40:03 +08:00
"ElementwiseBitwiseAndModule_basic",
"ElementwiseBitwiseAndStaticShapeModule_basic",
"ElementwiseBitwiseNotInt32Module_basic",
"ElementwiseBitwiseNotInt64Module_basic",
"ElementwiseBitwiseOrModule_basic",
"ElementwiseBitwiseOrStaticShapeModule_basic",
"ElementwiseBitwiseXorModule_basic",
"ElementwiseBitwiseXorStaticShapeModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ElementwiseCeilModule_basic",
Handle torch.none type in tosa.clamp op (#2739) This PR updates the torch-to-tosa conversion with following changes: - Support torch.none as min/max input argument for tosa.clamp op - Support negative value as start index for tosa.slice op - Add tosa.logical_or lowering support e2e test: python -m e2e_testing.main --config=tosa LIT tests: cmake --build build --target tools/torch-mlir/all --------- Co-authored-by: Ze Zhang <ze.zhang@getcruise.com>
2024-01-12 02:36:48 +08:00
"ElementwiseClampMaxModule_basic",
"ElementwiseClampMinModule_basic",
"ElementwiseClampModule_basic",
Bump LLVM to llvm/llvm-project@e5ed7b6e2fd368b722b6359556cd0125881e7638 (#2964)
2024-02-29 06:13:26 +08:00
"ElementwiseClampTensorInt8Module_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ElementwiseCloneChannelsLastMemoryFormatModule_basic",
"ElementwiseCloneContiguousModule_basic",
"ElementwiseCloneModule_basic",
"ElementwiseDivScalarModule_basic",
[MLIR][TORCH] Extend support for OnnxToLinalg lowering for Dropout and Div op (#2938) Fixes https://github.com/nod-ai/SHARK-Turbine/issues/451, https://github.com/nod-ai/SHARK-Turbine/issues/452
2024-02-27 13:32:05 +08:00
"ElementwiseDivTensorIntegerModule_basic",
"ElementwiseDivTensorUnsignedIntegerModule_basic",
Added 2 Ops: Floor divide scalar and Floor divide scalar mode (#3156) - Added linalg lowering for `AtenFloorDivideScalarOp` - Needed `AtenDivScalarModeOp` for the decomp. - Added linalg lowering for `AtenDivScalarModeOp` - Moved linalg payload logic to `createDivModePayload()` since the logic was nearly identical for both `AtenDivScalarModeOp` and `AtenDivTensorModeOp`. Just a template function - Added `AtenDivScalarModeOp` lowering for stablehlo Pytorch's [`torch.floor_divide()`](https://pytorch.org/docs/stable/generated/torch.floor_divide.html) in a previous version (for a reason unknown to me) preformed a truncation instead of "floor". The already implemented op `AtenFloorDivideTensorOp` was done before this change. However, this wasn't caught because our testcases only tested positive floor division. I changed this to floor as well as adding a few test cases.
2024-04-16 04:45:10 +08:00
"ElementwiseDivScalarIntegerModule_basic",
"ElementwiseDivScalarUnsignedIntegerModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ElementwiseEluModule_basic",
"ElementwiseEluNonDefaultModule_basic",
"ElementwiseEqBoolScalarModule_basic",
"ElementwiseEqDiffWidthScalarModule_basic",
"ElementwiseEqFloatScalarModule_basic",
"ElementwiseEqFloatTensorModule_basic",
"ElementwiseEqIntScalarModule_basic",
"ElementwiseEqIntTensorModule_basic",
"ElementwiseExpModule_basic",
"ElementwiseFlattenBroadcastModule_basic",
"ElementwiseFloorIntModule_basic",
"ElementwiseFloorModule_basic",
Support aten.sign (#2205)
2023-06-11 02:45:35 +08:00
"ElementwiseGeFloatIntScalarModule_basic",
"ElementwiseGeFloatScalarModule_basic",
"ElementwiseGeIntScalarModule_basic",
"ElementwiseGeMixedIntScalarModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ElementwiseGeluModule_basic",
* [tosa] Support for AtenRsubScalarOp for scalar constants (#531) * [tosa] Support for AtenCeilOp and AtenReciprocalOp * [tosa] Support for comparator ops, Aten[Gt|Lt|Eq][Tensor|Scalar]Op with scalar constant * [tosa] Support for Scalar variants of Aten[Mul|Div|Add|Sub] Ops with scalar constants Signed-off-by: Anup Gangwar <anup.gangwar@arm.com> Co-authored-by: Anup Gangwar <anup.gangwar@arm.com>
2022-01-21 02:58:30 +08:00
"ElementwiseGtFloatScalarModule_basic",
"ElementwiseGtFloatTensorModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ElementwiseGtIntScalarModule_basic",
* [tosa] Support for AtenRsubScalarOp for scalar constants (#531) * [tosa] Support for AtenCeilOp and AtenReciprocalOp * [tosa] Support for comparator ops, Aten[Gt|Lt|Eq][Tensor|Scalar]Op with scalar constant * [tosa] Support for Scalar variants of Aten[Mul|Div|Add|Sub] Ops with scalar constants Signed-off-by: Anup Gangwar <anup.gangwar@arm.com> Co-authored-by: Anup Gangwar <anup.gangwar@arm.com>
2022-01-21 02:58:30 +08:00
"ElementwiseGtIntTensorModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ElementwiseGtMixed2ScalarModule_basic",
"ElementwiseIsinfModule_basic",
[Torch Dialect] support aten.isneginf, aten.isposinf, aten.nan_to_num (#2743)
2024-01-16 14:29:34 +08:00
"ElementwiseAtenIsneginfOpModule_basic",
"ElementwiseAtenIsposinfOpModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ElementwiseIsnanModule_basic",
"ElementwiseLeFloatTensorModule_basic",
"ElementwiseLeIntTensorModule_basic",
"ElementwiseLeakyReluModule_basic",
"ElementwiseLeakyReluModule_basic",
"ElementwiseLeakyReluStaticModule_basic",
Implement lowering of torch.aten.lerp.Scalar (#2773) Closes nod-ai/SHARK-Turbine#356
2024-02-01 01:39:38 +08:00
"ElementwiseLerpScalarIntModule_basic",
"ElementwiseLerpScalarFloatModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ElementwiseLog2Module_basic",
"ElementwiseLogModule_basic",
* [tosa] Support for AtenRsubScalarOp for scalar constants (#531) * [tosa] Support for AtenCeilOp and AtenReciprocalOp * [tosa] Support for comparator ops, Aten[Gt|Lt|Eq][Tensor|Scalar]Op with scalar constant * [tosa] Support for Scalar variants of Aten[Mul|Div|Add|Sub] Ops with scalar constants Signed-off-by: Anup Gangwar <anup.gangwar@arm.com> Co-authored-by: Anup Gangwar <anup.gangwar@arm.com>
2022-01-21 02:58:30 +08:00
"ElementwiseLtDiffWidthScalarModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ElementwiseLtFloatScalarModule_basic",
* [tosa] Support for AtenRsubScalarOp for scalar constants (#531) * [tosa] Support for AtenCeilOp and AtenReciprocalOp * [tosa] Support for comparator ops, Aten[Gt|Lt|Eq][Tensor|Scalar]Op with scalar constant * [tosa] Support for Scalar variants of Aten[Mul|Div|Add|Sub] Ops with scalar constants Signed-off-by: Anup Gangwar <anup.gangwar@arm.com> Co-authored-by: Anup Gangwar <anup.gangwar@arm.com>
2022-01-21 02:58:30 +08:00
"ElementwiseLtFloatTensorModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ElementwiseLtIntScalarModule_basic",
* [tosa] Support for AtenRsubScalarOp for scalar constants (#531) * [tosa] Support for AtenCeilOp and AtenReciprocalOp * [tosa] Support for comparator ops, Aten[Gt|Lt|Eq][Tensor|Scalar]Op with scalar constant * [tosa] Support for Scalar variants of Aten[Mul|Div|Add|Sub] Ops with scalar constants Signed-off-by: Anup Gangwar <anup.gangwar@arm.com> Co-authored-by: Anup Gangwar <anup.gangwar@arm.com>
2022-01-21 02:58:30 +08:00
"ElementwiseLtIntTensorModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ElementwiseMaxOtherIntModule_basic",
"ElementwiseMaxOtherModule_basic",
"ElementwiseMaximumIntModule_basic",
"ElementwiseMaximumModule_basic",
"ElementwiseMinOtherIntModule_basic",
"ElementwiseMinOtherModule_basic",
"ElementwiseMinimumIntModule_basic",
"ElementwiseMinimumModule_basic",
"ElementwiseMulScalarModule_basic",
"ElementwiseMulScalarModule_float",
"ElementwiseMulScalarModule_float",
"ElementwiseMulScalarModule_int",
"ElementwiseMulTensorIntModule_basic",
[Torch Dialect] add support for AtenIsnanOp (#2170) * add support for mhlo * Add Test for torch.ne * fix torch.ne shape/add static test case * add support for static torch.ne --------- Co-authored-by: root <root@n31-177-039.byted.org>
2023-06-07 10:06:27 +08:00
"ElementwiseNeFloatScalarModule_basic",
"ElementwiseNeFloatTensorModule_basic",
"ElementwiseNeFloatTensorStaticModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ElementwiseNeIntScalarModule_basic",
[Torch Dialect] add support for AtenIsnanOp (#2170) * add support for mhlo * Add Test for torch.ne * fix torch.ne shape/add static test case * add support for static torch.ne --------- Co-authored-by: root <root@n31-177-039.byted.org>
2023-06-07 10:06:27 +08:00
"ElementwiseNeIntTensorModule_basic",
"ElementwiseNeIntTensorStaticModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ElementwiseNegModule_basic",
"ElementwiseOrTensorModule_basic",
"ElementwiseOrTensorStaticShapeModule_basic",
"ElementwisePowModule_basic",
[Torch] Support prelu decomposition (#3069)
2024-03-29 08:05:00 +08:00
"ElementwisePreluModule_basic",
"ElementwisePreluStaticModule_basic",
* [tosa] Support for AtenRsubScalarOp for scalar constants (#531) * [tosa] Support for AtenCeilOp and AtenReciprocalOp * [tosa] Support for comparator ops, Aten[Gt|Lt|Eq][Tensor|Scalar]Op with scalar constant * [tosa] Support for Scalar variants of Aten[Mul|Div|Add|Sub] Ops with scalar constants Signed-off-by: Anup Gangwar <anup.gangwar@arm.com> Co-authored-by: Anup Gangwar <anup.gangwar@arm.com>
2022-01-21 02:58:30 +08:00
"ElementwiseReciprocalModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ElementwiseRelu6Module_basic",
"ElementwiseReluModule_basic",
"ElementwiseRemainderScalarModule_Float_basic",
"ElementwiseRemainderScalarModule_Int_Float_basic",
"ElementwiseRemainderScalarModule_Int_basic",
"ElementwiseRemainderScalarModule_Int_basic",
"ElementwiseRsqrtModule_basic",
[torch] Add support for aten.selu (#2640) Add `aten.selu` operation to `torch` dialect.
2023-12-14 12:28:08 +08:00
"ElementwiseSeluModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ElementwiseSigmoidModule_basic",
"ElementwiseSignModule_basic",
"ElementwiseSqrtIntModule_basic",
"ElementwiseSqrtModule_basic",
"ElementwiseSubScalarFloatModule_basic",
[tosa] Support for some ops and fix for Issue #532 (#575) * [tosa] Support for AtenNe[Tensor|Scalar]Op, AtenLog2Op, AtenBitwiseAndTensorOp, AtenSquareOp and AtenThresholdOp * Fix for Issue #532 - Mixed input types for few ops and updated few tests to use i32 instead of i64 Signed-off-by: Anup Gangwar <anup.gangwar@arm.com> Co-authored-by: Anup Gangwar <anup.gangwar@arm.com>
2022-02-12 04:30:02 +08:00
"ElementwiseSubScalarIntModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ElementwiseSubTensorInt8Module_basic",
"ElementwiseToDtypeIdentityModule_basic",
"ElementwiseUnaryModule_basic",
[MLIR][TORCH] Fix aten.unsqueeze op (#1578) The range of the unsqueeze dim is: [-input.dim() - 1, input.dim() + 1), the bug forgets to add 1.
2022-11-15 01:09:15 +08:00
"ElementwiseUnsqueezeBroadcastModule_basic",
[TOSA] Add torch.prim.NumToTensor.Scalar float support (#1802)
2023-04-19 04:36:57 +08:00
"ElementwiseWhereScalarModule_basic",
[Torch Dialect] support aten.isneginf, aten.isposinf, aten.nan_to_num (#2743)
2024-01-16 14:29:34 +08:00
"ElementwiseNanToNumModule_Basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"EmbeddingModule1DIndices_basic",
"EmbeddingModuleI32Static_basic",
"FlattenRank0Module_basic",
"FlattenStaticModule_basic",
Dynamic size support for flatten (#3005) Added support for dynamic shapes in `flattenusingints` op in tosa dialect. Due to this some Argmax tests pass This PR fixes this issue https://github.com/llvm/torch-mlir/issues/3004 The following tests pass after this PR ``` 1. "ArgmaxIntModule_basic" 2. "ArgmaxIntModule_multiple_maxs" 3. "ArgmaxModule_basic" ```
2024-03-20 06:19:29 +08:00
"FlattenDynamicModuleCollapseAll_basic",
[TOSA] Add torch.prim.NumToTensor.Scalar float support (#1802)
2023-04-19 04:36:57 +08:00
"FullLikeModuleFloat3DStatic_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"FullLikeModuleInt2DStatic_basic",
[TOSA] Add torch.prim.NumToTensor.Scalar float support (#1802)
2023-04-19 04:36:57 +08:00
"FullModuleDefaultDtype_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"FullModuleFloat2D_basic",
[TOSA] Add torch.prim.NumToTensor.Scalar float support (#1802)
2023-04-19 04:36:57 +08:00
"FullModuleFloat3D_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"FullModuleInt3D_basic",
"GatherStaticModule_basic",
"GeluBackwardModule_basic",
"GluStaticModule_basic",
"HardTanhIntModule_basic",
"HardTanhModule_basic",
"HardsigmoidModule_basic",
"HardsigmoidRandomModule_basic",
"HardswishModule_basic",
"HardswishRandomModule_basic",
"HardtanhBackward_basic",
"IndexPutImpl2DNoneIndexStaticModule_basic",
"IndexTensorMultiIndexStaticModule_basic",
"IndexTensorStaticModule_basic",
"IscloseStaticModuleTrue_basic",
"IscloseStaticModule_basic",
"LayerNormNormalizeOverAllDimsModule_basic",
"LeakyReluBackwardModule_basic",
"LeakyReluBackwardStaticModule_basic",
"LiftFreshCopyModule_basic",
torch-to-tosa lowering support for AtenLinalgVectorNormOp (#2734) This PR add torch-to-tosa lowering support for AtenLinalgVectorNormOp e2e test: python -m e2e_testing.main --config=tosa LIT tests: cmake --build build --target tools/torch-mlir/all --------- Co-authored-by: Ze Zhang <ze.zhang@getcruise.com>
2024-01-19 04:32:23 +08:00
"LinalgVectorNormKeepDimModule_basic",
"LinalgVectorNormModule_basic",
e2e support aten.linalg_norm to aten.linalg_vector_norm (#2953) Add e2d support for `aten.linalg_norm` by decompose it to `aten.linalg_vector_norm`. Lowering to `aten.linalg_matrix_norm` is still unsupported. To Test: `python -m e2e_testing.main -v` --------- Co-authored-by: Ze Zhang <ze.zhang@getcruise.com>
2024-03-06 08:31:01 +08:00
"LinalgNormKeepDimModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"MaskedFillScalarDefaultModule_basic",
"MaskedFillScalarIntValueModule_basic",
"MaskedFillScalarIntValueStaticModule_basic",
"MaskedFillTensorIntValueStaticModule_basic",
"Matmul4dStatic_basic",
"Matmul_3d",
"Matmul_dot",
[tosa] Fix TOSA batch matmul lowering to correct transpose ordering (#2959) The corrective transpose at the end is computed incorrectly. Is it actually computin the inverse transpose. Inverting the permutations fixes the issue.
2024-02-29 01:46:58 +08:00
"MatmulStaticBroadcast_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"MaxPool2dEmptyStrideStaticModule_basic",
"MaxPool2dStaticCeilModeTrueModule_basic",
"MaxPool2dStaticModule_basic",
"MeanModule_basic",
"MmDagModule_basic",
"MoveDimIntModule_basic",
"MoveDimIntModule_basic",
"MoveDimIntNegativeIndexModule_basic",
"MseLossNoReductionModule_basic",
"NativeLayerNormModule4D_basic",
[MLIR][TORCH] add E2E support for aten.new_full (#2425) * implement aten.new_full * remove extraneous tests
2023-09-12 22:29:08 +08:00
"NewFullModuleDefaultDtype_basic",
"NewFullModuleFalsePinMemory_basic",
"NewFullModuleFloat2D_basic",
"NewFullModuleFloat3DStatic_basic",
"NewFullModuleFloat3D_basic",
"NewFullModuleInt2DStatic_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"NewOnesModuleDefaultDtype_basic",
"NewOnesModuleFalsePinMemory_basic",
"NewOnesModuleFloat2D_basic",
"NewOnesModuleFloat3D_basic",
"NewOnesModuleInt2D_basic",
"NewOnesModuleInt3D_basic",
"NewZerosModuleDefaultDtype_basic",
"NewZerosModuleFalsePinMemory_basic",
"NewZerosModuleFloat2D_basic",
"NewZerosModuleFloat3D_basic",
"NewZerosModuleInt2D_basic",
"NewZerosModuleInt3D_basic",
"NewZerosStaticModuleLayoutStrided_basic",
torch-to-tosa lowering support for AtenLinalgVectorNormOp (#2734) This PR add torch-to-tosa lowering support for AtenLinalgVectorNormOp e2e test: python -m e2e_testing.main --config=tosa LIT tests: cmake --build build --target tools/torch-mlir/all --------- Co-authored-by: Ze Zhang <ze.zhang@getcruise.com>
2024-01-19 04:32:23 +08:00
"NormalizeModule_basic",
"NormScalarOptDimKeepDimModule_basic",
"NormScalarOptDimModule_basic",
[TOSA] Add torch.prim.NumToTensor.Scalar float support (#1802)
2023-04-19 04:36:57 +08:00
"NumToTensorFloatModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"NumToTensorIntModule_basic",
"NumpyTRank0Module_basic",
"NumpyTRank1Module_basic",
"NumpyTRank2Module_basic",
"NumpyTRankNDynamicModule_basic",
"NumpyTRankNStaticModule_basic",
"OnesModuleCPUDevice_basic",
"OnesModuleDefaultDtype_basic",
"OnesModuleFalsePinMemory_basic",
"OnesModuleFloat_basic",
"OnesModuleInt_basic",
"PadModule_basic",
"PadWithNoneValModule_basic",
"Permute0RankModule_basic",
"PermuteModule_basic",
"PermuteNegativeIndexModule_basic",
[Torch] Fix PrimListUnpackOp::getCanonicalizationPatterns (#3140) Fix the case PrimListUnpackOp's result num is not equal to PrimList length. See the following example: ```python def forward(self, x): if len(x.shape) == 5: b0, t, c0, h0, w0 = x.shape b, c, h, w = torch.mul(b0, t), c0, h0, w0 else: b1, c1, h1, w1 = x.shape b, c, h, w = b1, c1, h1, w1 res = torch.reshape(x, [b, c, h, w]) return res ``` Without this fix, the following error message will occur： ``` /root/torch-mlir/externals/llvm-project/mlir/lib/IR/PatternMatch.cpp:118: virtual void mlir::RewriterBase::replaceOp(mlir::Operation *, mlir::ValueRange): Assertion `op->getNumResults() == newValues.size() && "incorrect # of replacement values"' failed. ```
2024-04-11 19:48:49 +08:00
"PrimListUnpackNumMismatchModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"PrimsSqueezeEmptyDimensionsModule_basic",
"PrimsSqueezeModule_basic",
"PrimsViewOfModule_basic",
"PrimsViewOfZeroRankModule_basic",
build: update llvm tag to 4546397e (#1502) This commit makes the following changes needed to update bump LLVM: - Replace `linalg.init_tensor` with `tensor.empty` (see: https://reviews.llvm.org/D135129) - Replace `NoSideEffect` with `Pure` (see https://reviews.llvm.org/D135505) - Replace `body` region accessor for `ReduceOp` and `ReduceWindowOp` with `getBody` - Fix incorrect use of `tosa::ReduceSumOp` in `AtenNativeLayerNormOp` conversion pattern. The result type of `tosa::ReduceSumOp` must have the same rank as the input type. (see: https://www.mlplatform.org/tosa/tosa_spec.html#_reduce_sum) Co-authored-by: Ashay Rane <ashay@users.noreply.github.com> Co-authored-by: Ashay Rane <ashay@users.noreply.github.com>
2022-10-18 12:22:53 +08:00
"ReduceSumDimIntListFloatModule_basic",
"ReduceSumDimIntListIntModule_basic",
"ReduceSumDimIntListKeepDimFloatModule_basic",
"ReduceSumDimIntListKeepDimIntModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ReduceSumDimIntListKeepDimNegativeDimStaticModule_basic",
build: update llvm tag to 4546397e (#1502) This commit makes the following changes needed to update bump LLVM: - Replace `linalg.init_tensor` with `tensor.empty` (see: https://reviews.llvm.org/D135129) - Replace `NoSideEffect` with `Pure` (see https://reviews.llvm.org/D135505) - Replace `body` region accessor for `ReduceOp` and `ReduceWindowOp` with `getBody` - Fix incorrect use of `tosa::ReduceSumOp` in `AtenNativeLayerNormOp` conversion pattern. The result type of `tosa::ReduceSumOp` must have the same rank as the input type. (see: https://www.mlplatform.org/tosa/tosa_spec.html#_reduce_sum) Co-authored-by: Ashay Rane <ashay@users.noreply.github.com> Co-authored-by: Ashay Rane <ashay@users.noreply.github.com>
2022-10-18 12:22:53 +08:00
"ReduceSumFloatModule_basic",
"ReduceSumSignedIntModule_basic",
"ReduceSumUnsignedIntModule_basic",
Constant pad nd to tosa (#1933) * implemented lowering torch.aten.constant_pad_nd to tosa * add constant_pad_nd e2e tests to TOSA_PASS_SET * add PadModule_basic & PadWithNoneValModule_basic to TOSA_PASS_SET --------- Co-authored-by: Lisa Liu <lingl@xilinx.com>
2023-03-15 23:42:15 +08:00
"RepeatModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ResNet18StaticModule_basic",
Bump LLVM to llvm/llvm-project@0030fc4ac74a9ce645adb9d59e108da4d4d11818 (#3079) Co-authored-by: Peiming Liu <peiming@google.com>
2024-04-02 07:34:59 +08:00
"ReshapeAliasCollapseModule_basic",
"ReshapeAliasExpandModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ReshapeAsModule_basic",
"ReshapeCollapseModule_basic",
Bump LLVM to llvm/llvm-project@0030fc4ac74a9ce645adb9d59e108da4d4d11818 (#3079) Co-authored-by: Peiming Liu <peiming@google.com>
2024-04-02 07:34:59 +08:00
"ReshapeExpandModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ReturnThreeTensorFloat32_basic",
"ReturnTwoTensorF32I64_basic",
"RsubFloatModule_basic",
"RsubFloatModule_noalpha_basic",
"RsubInt0d_NumToTensor_Module_basic",
[Torch Dialect] Add support for AtenScalarTensorOp (#2085) * add scalar_tensor op * add dynamo pass test; needs PR2062 * try to fix * Empty commit, trigger test * Empty commit, trigger test * address comments * use dtype function * fix decompose rule * remove unused include * Empty commit, trigger test * fix test * disable ltc * fix dtype --------- Co-authored-by: zhekun.zhang <zhekun.zhang@bytedance.com>
2023-06-01 11:38:50 +08:00
"ScalarTensorDefaultDtypeModule_basic",
"ScalarTensorFloat32Module_basic",
"ScalarTensorInt32Module_basic",
"ScalarTensorInt64Module_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"SelectIntNegativeDimAndIndexStaticModule_basic",
"SiluModule_basic",
"SliceOutOfUpperBoundIndexStaticModule_basic",
"SliceStaticModule_basic",
[Torch Dialect] Add split.tensor support + recompose rules (#2102) * add split.tensor support + recompose rules * add e2e test * address comments * address comments * erase op in recomposeOp --------- Co-authored-by: zhekun.zhang <zhekun.zhang@bytedance.com>
2023-05-24 03:43:33 +08:00
"SplitTensorGetItem_Module_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"SplitTensorLastSmallerModule_basic",
[Torch Dialect] Support recompose aten.split.Tensor + prim.ListUnpack (#2192)
2023-06-07 01:38:04 +08:00
"SplitTensorListUnpackModule_basic",
Fixes for split tensor and slice (#2314) * RecomposeComplexOps: Remove dead slice op * lib/Dialect/Torch/IR/TorchOps.cpp: Fold slice ops even when they are on non-value tensors * lib/Conversion/TorchToTosa/TorchToTosa.cpp: Fix slice start/end out of range/none * lib/Dialect/Torch/IR/TorchOps.cpp: AtenSliceTensorOp::fold: Fold slices that go from 0:int_max * More tests for aten.split.Tensor
2023-07-20 15:53:54 +08:00
"SplitTensorNegativeDimModule_basic",
[Torch Dialect] support aten.split_with_sizes (#2431) * [Torch Dialect] support aten.split_with_sizes * update
2023-09-04 09:59:26 +08:00
"SplitWithSizesListUnpackModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"SquareModule_basic",
"SqueezeDimModule_identity",
"SqueezeDimModule_static",
"SqueezeDimModule_unitDim",
"SqueezeModule_allUnitDim",
"SqueezeModule_broadcast",
"SqueezeModule_noUnitDim",
"SqueezeModule_static",
"TModuleRank0_basic",
"TModuleRank1_basic",
"TModuleRank2_basic",
"TanhBackward_basic",
"TensorLiteralModule_basic",
"TensorOpaqueLiteralModule_basic",
"TensorsConcatNegativeDimStaticModule_basic",
"TensorsConcatStaticModule_basic",
"TestF16Return_basic",
"TestMultipleTensorReturn_basic",
"Threshold1dFloatModule_basic",
"Threshold1dIntI32Module_basic",
"Threshold2dFloatModule_basic",
"Threshold3dFloatModule_basic",
"TileBigDimsSizeModule_basic",
"TileSmallDimsSizeModule_basic",
"ToCopyBoolDTypeStaticModule_basic",
"ToDtypeBoolLayoutNoneStaticModule_basic",
"TransposeIntModule_basic",
"TransposeIntNegDimsModule_basic",
Fix canonicalization of `torch.prim.TupleUnpack`.
2023-07-18 22:32:26 +08:00
"TupleModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"TypeAsSameModule_basic",
"TypePromotionAlphaWiderModule_basic",
"TypePromotionDifferentCategoryModule_basic",
"TypePromotionSameCategoryDifferentWidthModule_basic",
"TypePromotionSameCategoryZeroRankWider_basic",
"TypePromotionZeroRankHigherCategoryModule_basic",
"UnbindIntGetItem_Module_basic",
"UnbindIntListUnpack_Module_basic",
"UnflattenIntNegativeOneDimStaticModule_basic",
"UnflattenIntNegativeOneSizeStaticModule_basic",
"UnflattenIntStaticModule_basic",
"UnflattenStaticModule_basic",
"UnsafeView1DFoldModule_basic",
Bump LLVM to llvm/llvm-project@0030fc4ac74a9ce645adb9d59e108da4d4d11818 (#3079) Co-authored-by: Peiming Liu <peiming@google.com>
2024-04-02 07:34:59 +08:00
"UnsafeViewCollapseModule_basic",
"UnsafeViewDynamicExpandModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"UnsafeViewExpandModule_basic",
"View1DFoldModule_basic",
Bump LLVM to llvm/llvm-project@0030fc4ac74a9ce645adb9d59e108da4d4d11818 (#3079) Co-authored-by: Peiming Liu <peiming@google.com>
2024-04-02 07:34:59 +08:00
"ViewCollapseModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ViewCollapseInferredDimModule_basic",
"ViewCollapseOnesMiddleModule_basic",
"ViewDoubleMergeStaticModule_basic",
Bump LLVM to llvm/llvm-project@0030fc4ac74a9ce645adb9d59e108da4d4d11818 (#3079) Co-authored-by: Peiming Liu <peiming@google.com>
2024-04-02 07:34:59 +08:00
"ViewDynamicExpandCollapseModule_basic",
"ViewDynamicExpandModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ViewExpandCollapseModule_basic",
"ViewExpandCollapseWithOnesModule_basic",
Bump LLVM to llvm/llvm-project@0030fc4ac74a9ce645adb9d59e108da4d4d11818 (#3079) Co-authored-by: Peiming Liu <peiming@google.com>
2024-04-02 07:34:59 +08:00
"ViewExpandDynamicDimModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ViewExpandInferredDimModule_basic",
"ViewExpandModule_basic",
"ViewExpandOnesBeforeAndAfterModule_basic",
"ViewExpandOnesMiddleModule_basic",
"ViewExpandOnesMiddleOppModule_basic",
"ViewExpandOnesModule_basic",
"ViewFiveTestStaticModule_basic",
"ViewNegativeStaticModule_basic",
Bump LLVM to llvm/llvm-project@0030fc4ac74a9ce645adb9d59e108da4d4d11818 (#3079) Co-authored-by: Peiming Liu <peiming@google.com>
2024-04-02 07:34:59 +08:00
"ViewNoChange1dModule_basic",
"ViewNoChange2dModule_basic",
"ViewNoChange3dModule_basic",
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"ViewNoChangeStaticModule_basic",
"ViewOffsetBackwardTestStaticModule_basic",
"ViewOffsetTestStaticModule_basic",
"ViewTwoFiveThreeStaticModule_basic",
"ViewTwoToThreeStaticModule_basic",
"ZerosModuleDefaultDtype_basic",
"ZerosModuleFalsePinMemory_basic",
"ZerosModuleFloat2D_basic",
"ZerosModuleFloat3D_basic",
"ZerosModuleInt2D_basic",
"ZerosModuleInt3D_basic",
"_LogSoftmaxModuleStable_basic",
[Torch Dialect] support decomposition of aten.linspace (#3006)
2024-03-14 08:28:33 +08:00
"LinspaceModule_basic",
"LinspaceOneSizeModule_basic",
"LinspaceTwoSizeModule_basic",
Fix SCF Forloop fails to convert to linalg when a tensor argument is supplied to the loop block (#3040) Co-authored-by: Rob Suderman <rob.suderman@gmail.com> Co-authored-by: Xida Ren <xida.ren.dev@gmail.com>
2024-03-21 02:04:02 +08:00
"TorchPrimLoopForLikeTensorArgModule_basic"
Bump llvm-project to f1b922188ead5ca492c8d8edd47921b013a22ae0. Includes a fix to use `add_mlir_public_c_api_library` for Torch-MLIR's CAPI library, which is now required (note: upstream sample has it the right way). Disabled a TOSA test per discussion: https://github.com/llvm/torch-mlir/issues/379
2021-10-26 02:43:21 +08:00
}
Added e2e LTC tests (#916) * Added e2e LTC Torch MLIR tests * Fix seed for reproducability * Check if computation is None before getting debug string * Updated unit tests, and added numeric tests * Print name of the model layer that fails numeric validation * Run LTC e2e test with CI/CD * Set seed in main function, instead of beginning of execution * Add comment to specify number of digits of precision * Fixed typo * Remove tests for LTC example models * Added LTC option to torchscript e2e * Implement compile and run for LTC e2e test * xfail all tests that use ops that aren't currently supported
2022-06-10 03:56:01 +08:00
Add make_fx_tosa variant to end2end tests (#2240) * Add make_fx_tosa variant to end2end tests * e2e_testing/xfail_sets.py: Add make_fx_tosa xfail for stable
2023-07-13 21:07:54 +08:00
MAKE_FX_TOSA_PASS_SET = (TOSA_PASS_SET | {
### Tests additionally passing in make_fx_tosa
Sort the TOSA passing test list (#2630) For easier tracking of issues, sort the TOSA passing list. It is still significantly smaller then the XFAIL list would be. Resolves #2620, at least until the xfail list gets smaller than the passing list. Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-12-13 06:22:25 +08:00
"AdaptiveAvgPool1dNonUnitOutputSizeStaticModule_basic",
"AdaptiveAvgPool1dUnitOutputSizeStaticModule_basic",
[RFC] general support for Adaptive Pooling Ops (#2661) Adaptive pooling ops can only be decomposed into their non-adaptive counterparts in trivial cases. For example, the current decomposition for AtenAdaptiveAvgPool1dOp in DecomposeComplexOps.cpp supports outSize = inSize (i.e., do literally nothing), and outSize = 1 (i.e., do a batched average). The reason adaptive pooling ops are difficult to lower to linalg is that they are not constantly strided. They are computed by taking an input tensor of shape (N, C, Hin), and an output size Hout, and computing the output tensor at position (n,c, h) in the following way: 1. compute st(h) = (h*Hin)//Hout 2. compute en(h) = 1 + ((h+1)*Hin -1)//Hout 3. apply a computation (max or avg) to the slice: INPUT[n, c, st(h):en(h)] The provided sample implementation (for ConvertAtenAdaptiveAvgPool1dOp) uses tensor.extract to access the input tensor inside the payload of a linalg generic op. This is likely an unattractive use of linalg generic ops, which is why I am asking for some more targeted feedback on the validity of this approach before attempting to support the many other adaptive pooling ops. Specifically: - Is the performance of this implementation bad enough to warrant targeting different dialects entirely? e.g. TMtensor/linalg ext/ etc. - If the provided implementation is of acceptable performance to the community, then is it permissable to remove the Adaptive pooling decompositions from DecomposeComplexOps.cpp? Based on the current structure of the -torch-decompose-complex-ops pass, it does not seem possible to only decompose the adaptive ops in special cases (it seems to get stuck in an infinite loop on a match failure). I would be happy to instead incorporate the case logic into the conversion directly, and remove the decompositions once they are rendered completely obsolete. As long as this approach is acceptable, I can clean up the implementation with some helper functions, and quickly add support for each of the remaining Adaptive pooling ops.
2024-01-10 03:14:10 +08:00
"AdaptiveAvgPool1dStaticEvenMultiple_basic",
torch-to-tosa lowering support for AtenLinalgVectorNormOp (#2734) This PR add torch-to-tosa lowering support for AtenLinalgVectorNormOp e2e test: python -m e2e_testing.main --config=tosa LIT tests: cmake --build build --target tools/torch-mlir/all --------- Co-authored-by: Ze Zhang <ze.zhang@getcruise.com>
2024-01-19 04:32:23 +08:00
"CosineSimilarityModule_basic",
Add make_fx_tosa variant to end2end tests (#2240) * Add make_fx_tosa variant to end2end tests * e2e_testing/xfail_sets.py: Add make_fx_tosa xfail for stable
2023-07-13 21:07:54 +08:00
"NativeGroupNormBackwardModule_basic",
torch-to-tosa lowering support for AtenLinalgVectorNormOp (#2734) This PR add torch-to-tosa lowering support for AtenLinalgVectorNormOp e2e test: python -m e2e_testing.main --config=tosa LIT tests: cmake --build build --target tools/torch-mlir/all --------- Co-authored-by: Ze Zhang <ze.zhang@getcruise.com>
2024-01-19 04:32:23 +08:00
"ReduceFrobeniusNormKeepDimModule_basic",
"ReduceFrobeniusNormModule_basic",
Fixes for split tensor and slice (#2314) * RecomposeComplexOps: Remove dead slice op * lib/Dialect/Torch/IR/TorchOps.cpp: Fold slice ops even when they are on non-value tensors * lib/Conversion/TorchToTosa/TorchToTosa.cpp: Fix slice start/end out of range/none * lib/Dialect/Torch/IR/TorchOps.cpp: AtenSliceTensorOp::fold: Fold slices that go from 0:int_max * More tests for aten.split.Tensor
2023-07-20 15:53:54 +08:00
"SliceWholeTensorModule_basic",
Add make_fx_tosa variant to end2end tests (#2240) * Add make_fx_tosa variant to end2end tests * e2e_testing/xfail_sets.py: Add make_fx_tosa xfail for stable
2023-07-13 21:07:54 +08:00
"TensorFloatModule_basic",
"TensorIntModule_basic",
lower torch.aten.isinf to linalg (#2638) Co-authored-by: Rob Suderman <rob.suderman@gmail.com>
2023-12-29 09:20:32 +08:00
"AdaptiveAvgPool1dNonUnitOutputSizeStaticModule_basic",
"AdaptiveAvgPool1dUnitOutputSizeStaticModule_basic",
Fix SCF Forloop fails to convert to linalg when a tensor argument is supplied to the loop block (#3040) Co-authored-by: Rob Suderman <rob.suderman@gmail.com> Co-authored-by: Xida Ren <xida.ren.dev@gmail.com>
2024-03-21 02:04:02 +08:00
"TorchPrimLoopForLikeTensorArgModule_basic",
Bump LLVM to llvm/llvm-project@0030fc4ac74a9ce645adb9d59e108da4d4d11818 (#3079) Co-authored-by: Peiming Liu <peiming@google.com>
2024-04-02 07:34:59 +08:00
"ViewSizeDimFollowedByCollapsedOnesModule_basic",
"ViewSizeDimFollowedByExpandedOnesModule_basic",
"ViewSizeDimLedAndFollowedByCollapsedOnesModule_basic",
"ViewSizeDimLedByCollapsedOnesModule_basic",
"ViewSizeFromOtherTensor_basic",
Add make_fx_tosa variant to end2end tests (#2240) * Add make_fx_tosa variant to end2end tests * e2e_testing/xfail_sets.py: Add make_fx_tosa xfail for stable
2023-07-13 21:07:54 +08:00
}) - {
### Test failing in make_fx_tosa but not in tosa
# Dynamic shape, has extra unsupported broadcast ops
"Matmul_3d",
[tosa] Fix TOSA batch matmul lowering to correct transpose ordering (#2959) The corrective transpose at the end is computed incorrectly. Is it actually computin the inverse transpose. Inverting the permutations fixes the issue.
2024-02-29 01:46:58 +08:00
"MatmulStaticBroadcast_basic",
Add make_fx_tosa variant to end2end tests (#2240) * Add make_fx_tosa variant to end2end tests * e2e_testing/xfail_sets.py: Add make_fx_tosa xfail for stable
2023-07-13 21:07:54 +08:00
# failed to legalize operation 'torch.aten.max_pool2d_with_indices
"MaxPool2dEmptyStrideStaticModule_basic",
"MaxPool2dStaticCeilModeTrueModule_basic",
"MaxPool2dStaticModule_basic",
"ResNet18StaticModule_basic",
# Unimplemented operator 'aten._index_put_impl_.hacked_twin'
"IndexPutImpl1DFloatNonAccumulateModule_basic",
"IndexPutImpl1DIntNonAccumulateModule_basic",
build: update llvm tag to 41895843 Summary of changes: - Update tags llvm: 41895843b5915bb78e9d02aa711fa10f7174db43 mhlo: 4726d31f7025da66de0dea709bd56c462edb83c2 Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2023-07-26 15:30:13 +08:00
# RuntimeError: The size of tensor a (7) must match the size of tensor b (3) at non-singleton dimension 1
"Add_Module_basic",
add e2e support for torch.eye operations (aten.eye, aten.eye.m) (#2478)
2023-11-02 02:23:28 +08:00
# failed to legalize operation 'torch.aten.to.dtype' that was explicitly marked illegal
"AtenEyeModuleInt2D_basic",
"AtenEyeMModuleInt2D_basic",
Add make_fx_tosa variant to end2end tests (#2240) * Add make_fx_tosa variant to end2end tests * e2e_testing/xfail_sets.py: Add make_fx_tosa xfail for stable
2023-07-13 21:07:54 +08:00
Advance llvm-project and stablehlo. (#2619) llvm-project: bbd2b08b95fe76bea138c1b03c1cd42ed3ee04df stablehlo: ab709fe48de88c67717abfbd7ef17425eb95ddaf These commits were chosen in order to account for an MLIR API break from https://github.com/llvm/llvm-project/commit/3dbac2c007c114a720300d2a4d79abe9ca1351e7 which required a patch to stablehlo. We integrate a bit beyond that commit to deal with some revert/reapply cycles in the intervening range which were discovered in another downstream. Further, it requires adaptation to the stablehlo API breaks introduced from https://github.com/openxla/stablehlo/pull/1872 which are along for the ride. Since some stablehlo builders were changed to directly take int64_t array refs, also traced that up some call stacks to eliminate some signed/unsigned mismatches that result. Also adds a few TOSA tests to the passing set that seem to work now.
2023-12-08 15:13:42 +08:00
"Conv2dBiasNoPaddingModule_basic",
"Conv2dNoPaddingModule_basic",
"Conv2dWithPaddingDilationStrideModule_basic",
"Conv2dWithPaddingModule_basic",
OnnxToTorch support for onnx.InstanceNormalization op (#2710) https://github.com/nod-ai/SHARK-Turbine/issues/327
2024-02-19 22:23:48 +08:00
"AtenInstanceNormModule_basic",
[Torch] Support prelu decomposition (#3069)
2024-03-29 08:05:00 +08:00
# failed to legalize operation 'torch.operator'
"ElementwisePreluModule_basic",
"ElementwisePreluStaticModule_basic",
Bump LLVM to llvm/llvm-project@0030fc4ac74a9ce645adb9d59e108da4d4d11818 (#3079) Co-authored-by: Peiming Liu <peiming@google.com>
2024-04-02 07:34:59 +08:00
# Shape Related failures
[Torch] Fix PrimListUnpackOp::getCanonicalizationPatterns (#3140) Fix the case PrimListUnpackOp's result num is not equal to PrimList length. See the following example: ```python def forward(self, x): if len(x.shape) == 5: b0, t, c0, h0, w0 = x.shape b, c, h, w = torch.mul(b0, t), c0, h0, w0 else: b1, c1, h1, w1 = x.shape b, c, h, w = b1, c1, h1, w1 res = torch.reshape(x, [b, c, h, w]) return res ``` Without this fix, the following error message will occur： ``` /root/torch-mlir/externals/llvm-project/mlir/lib/IR/PatternMatch.cpp:118: virtual void mlir::RewriterBase::replaceOp(mlir::Operation *, mlir::ValueRange): Assertion `op->getNumResults() == newValues.size() && "incorrect # of replacement values"' failed. ```
2024-04-11 19:48:49 +08:00
"PrimListUnpackNumMismatchModule_basic",
Bump LLVM to llvm/llvm-project@0030fc4ac74a9ce645adb9d59e108da4d4d11818 (#3079) Co-authored-by: Peiming Liu <peiming@google.com>
2024-04-02 07:34:59 +08:00
"ReshapeExpandModule_basic",
"UnsafeViewCollapseModule_basic",
"UnsafeViewDynamicExpandModule_basic",
"ViewCollapseModule_basic",
"ViewDynamicExpandCollapseModule_basic",
"ViewDynamicExpandModule_basic",
"ViewExpandDynamicDimModule_basic",
"ViewNoChange1dModule_basic",
"ViewNoChange2dModule_basic",
"ViewNoChange3dModule_basic",
Advance llvm-project and stablehlo. (#2619) llvm-project: bbd2b08b95fe76bea138c1b03c1cd42ed3ee04df stablehlo: ab709fe48de88c67717abfbd7ef17425eb95ddaf These commits were chosen in order to account for an MLIR API break from https://github.com/llvm/llvm-project/commit/3dbac2c007c114a720300d2a4d79abe9ca1351e7 which required a patch to stablehlo. We integrate a bit beyond that commit to deal with some revert/reapply cycles in the intervening range which were discovered in another downstream. Further, it requires adaptation to the stablehlo API breaks introduced from https://github.com/openxla/stablehlo/pull/1872 which are along for the ride. Since some stablehlo builders were changed to directly take int64_t array refs, also traced that up some call stacks to eliminate some signed/unsigned mismatches that result. Also adds a few TOSA tests to the passing set that seem to work now.
2023-12-08 15:13:42 +08:00
}
Add make_fx_tosa variant to end2end tests (#2240) * Add make_fx_tosa variant to end2end tests * e2e_testing/xfail_sets.py: Add make_fx_tosa xfail for stable
2023-07-13 21:07:54 +08:00
[LTC] Tensor[]? support operands type support using partial codegen (#2410) * Tensor[]? support operands type support using partial codegen * aten.index.Tensor support via partial codegen * Add torch.index_put tracing support * Added optional tensor list type support for LTC/TorchMLIR lowering * Added comments Co-authored-by: Gleb Kazantaev <gleb.kazantaev@cerebras.net>
2023-08-30 18:29:39 +08:00
LTC_CRASHING_SET = {
# TODO: update test to move all inputs to the lazy device. Otherwise test fails with:
# Check failed: lazy_tensor Input tensor is not a lazy tensor: CPUBoolType.
"HBC_basic",
}
Added e2e LTC tests (#916) * Added e2e LTC Torch MLIR tests * Fix seed for reproducability * Check if computation is None before getting debug string * Updated unit tests, and added numeric tests * Print name of the model layer that fails numeric validation * Run LTC e2e test with CI/CD * Set seed in main function, instead of beginning of execution * Add comment to specify number of digits of precision * Fixed typo * Remove tests for LTC example models * Added LTC option to torchscript e2e * Implement compile and run for LTC e2e test * xfail all tests that use ops that aren't currently supported
2022-06-10 03:56:01 +08:00
LTC_XFAIL_SET = {
Fix SCF Forloop fails to convert to linalg when a tensor argument is supplied to the loop block (#3040) Co-authored-by: Rob Suderman <rob.suderman@gmail.com> Co-authored-by: Xida Ren <xida.ren.dev@gmail.com>
2024-03-21 02:04:02 +08:00
"TorchPrimLoopForLikeTensorArgModule_basic"
Support for prims collapse op (lowering to linalg) (#2572) Steps taken: 1) add generator code to torch_ods_gen.py, run update_torch_ods.sh 2) add (custom) shape and type inference generator code to abstract_interp_lib_gen.py, run update_abstract_interp_lib.sh 3) Implement lowering to tensor.collapse_dims. Requires the `start` and `end` values to be constant, else lowering fails 4) Update xfail_sets.py (append to LTC_XFAIL_SET) after running /tools/e2e_test.sh --filter Collapse --verbose -c XX for all support backends (XX). Motivation: - Supporting the collapse operation will be useful for lowering of pixel_shuffle (see Issue #2559)
2023-11-16 00:34:38 +08:00
"CollapseAllDimensionsModule_basic",
"CollapseRank1DynamicModule_basic",
"CollapseStaticModule_basic",
"CollapsePartialDynamicModule_basic",
"CollapseFullDynamicModule_basic",
Lowering to linalg of prims split_dim op (#2576) Adds support for lowering to prims split_op. Similar design to collapse op lowering in https://github.com/llvm/torch-mlir/pull/2572, with some small differences, because the split_dim op (in pytorch) is view-changing whereas the collapse is not. The difference means that 1) it must be registered in the function Torch::isViewLikeOp 2) it must be be added to the "expected fail" set for the torch dynamo backend.
2023-11-21 23:56:09 +08:00
"SplitDimStaticModule_basic",
"SplitDimDynamicModule_basic",
Decomposition of aten.pixel_shuffle with static input shape (#2550) For static tests (that is when the shape is know) for example: ``` @annotate_args([None, ([3, 18, 2, 2], torch.float32, True)]) ``` The e2e passes. But only if the replacement op's return type is set as undefined (optional shape and type must be explicitly made unset), otherwise there's a error about the function return type. For dynamic cases, for example if the above is replaced with ``` @annotate_args([None, ([-1, -1, -1, -1], torch.float32, True)]) ``` There is a failure to lower to linalg from torch ("view op explicitly labelled as illegal"). This seems to be because the support for lowering from torch to linalg with dynamic shapes is limited.
2023-11-08 21:52:44 +08:00
"PixelShuffleModuleStaticRank3Int64_basic",
"PixelShuffleModuleStaticRank4Float32_basic",
Improve decomposition of pixel_shuffle (support dynamic shapes) (#2590) The aten.reshape ops in the decomposition are replaced with prims.collapse and prims.split_dim ops, which means that the cases where the lowering of reshape from torch to linalg which are not supported, are avoided. Essentially, by using the collapse and split_dim ops instead of the reshape ops, we are not "losing" the information that the reshapes do not arbitrarily mix dimensions. Which makes lowering easy. 3 additional tests added: - fully dynamic, - dynamic only the spatial dimensions, - dynamic only in the non-spatial dimensions.
2023-11-23 04:31:06 +08:00
"PixelShuffleModuleFullDynamic_basic",
"PixelShuffleModuleSpatiallyDynamic_basic",
"PixelShuffleModuleSpatiallyStatic_basic",
implement aten.conv1d, aten.conv3d, and aten.conv_tbc (#2757) convolution with [time,batch,channel] ordering, as opposed to the default [batch, channel, time]. Currently implementing by transposing the input and output, but may need to get its own implementation in the future because this is supposed to be an op that gives a speedup. This is used by fairseq (https://github.com/facebookresearch/fairseq/issues/172). (in case you were wondering like me, this is different from transposed convolution. Transposed convolution has fractional strides). --------- Co-authored-by: Xida Ren <xida.ren.dev@gmail.com> Co-authored-by: Frederik Harwath <frederik.harwath@amd.com>
2024-01-24 13:30:03 +08:00
"ConvTbcModule_basic",
Blacklist _convolution op (#1048) * Blacklist _convolution op in LTC * Removed duplicate Torch_AtenSelectScatterOp instance from autogen .td * Removed duplicate Torch_AtenSliceScatterOp instance from autogen .td
2022-07-14 01:28:05 +08:00
"_Convolution2DAllFalseModule_basic",
"_Convolution2DBenchmarkModule_basic",
"_Convolution2DCudnnModule_basic",
"_Convolution2DDeterministicModule_basic",
"_Convolution2DTF32Module_basic",
[MLIR][TORCH] Fix CI failure due to failing tests Signed-Off By: Vivek Khandelwal<vivek@nod-labs.com>
2022-08-22 13:44:44 +08:00
"_ConvolutionDeprecated2DAllFalseModule_basic",
"_ConvolutionDeprecated2DBenchmarkModule_basic",
Fix as_strided/slice symint (#1401) * Fix as_strided symint * Re-enable LTC tests * Re-enable LTC * Add hardtanh shape inference function * Fix slice symint
2022-09-27 00:16:49 +08:00
"_ConvolutionDeprecated2DCudnnModule_basic",
[MLIR][TORCH] Fix CI failure due to failing tests Signed-Off By: Vivek Khandelwal<vivek@nod-labs.com>
2022-08-22 13:44:44 +08:00
"_ConvolutionDeprecated2DDeterministicModule_basic",
Add aten.pool_max3d support to torch-to-linalg (#2735) Added verification logic to the abstract_interpreter_lib_gen.py Also made some unit tests Initially, I thought we can use `linalg::pooling_ndhwc_max` to help implement this problem. However, on a 5-dimensional matrix it does the pooling on dimensions (2, 3, 4) which is not what we want. We want pooling on dimensions (3, 4, 5). To achieve this, we would need to lower our code using the `linalg` dialect. Turns out the pooling code in `linalg` looks like this. ``` func @max_pooling_ncdhw(%I: memref<?x?x?x?x?xf32>, %K: memref<3xindex>, %O: memref<?x?x?x?x?xf32>, %strides: memref<3xindex>, %dilations: memref<3xindex>) { %c0 = arith.constant 0 : index %c1 = arith.constant 1 : index %N = memref.dim %I, %c0 : memref<?x?x?x?x?xf32> %C = memref.dim %I, %c1 : memref<?x?x?x?x?xf32> %D = memref.dim %I, 2 : memref<?x?x?x?x?xf32> %H = memref.dim %I, 3 : memref<?x?x?x?x?xf32> %W = memref.dim %I, 4 : memref<?x?x?x?x?xf32> %kernel_d = memref.load %K[%c0] : memref<3xindex> %kernel_h = memref.load %K[%c1] : memref<3xindex> %kernel_w = memref.load %K[2] : memref<3xindex> %stride_d = memref.load %strides[%c0] : memref<3xindex> %stride_h = memref.load %strides[%c1] : memref<3xindex> %stride_w = memref.load %strides[2] : memref<3xindex> %dilation_d = memref.load %dilations[%c0] : memref<3xindex> %dilation_h = memref.load %dilations[%c1] : memref<3xindex> %dilation_w = memref.load %dilations[2] : memref<3xindex> linalg.generic { indexing_maps = [ affine_map<(n, c, d, h, w, kd, kh, kw) -> (n, c, d * %stride_d + kd * %dilation_d, h * %stride_h + kh * %dilation_h, w * %stride_w + kw * %dilation_w)>, // Map for input tensor affine_map<(n, c, d, h, w, kd, kh, kw) -> (kd, kh, kw)>, // Map for kernel tensor affine_map<(n, c, d, h, w, kd, kh, kw) -> (n, c, d, h, w)> // Map for output tensor ], iterator_types = ["parallel", "parallel", "parallel", "parallel", "parallel", "reduction", "reduction", "reduction"], doc = "3D Max Pooling NCDHW with Strides, Dilations, and Kernel Size" } ins(%I, %K : memref<?x?x?x?x?xf32>, memref<3xindex>) outs(%O : memref<?x?x?x?x?xf32>) { ^bb0(%input_elem: f32, %kernel_elem: index, %output_elem: f32): %max_val = arith.maxf %input_elem, %output_elem : f32 linalg.yield %max_val : f32 } return } ``` This was implemented based on it's source code with the adjustments mentioned above: https://github.com/llvm/llvm-project/blob/4ca1b5e094280ef1af40412e3cfcb62dc3cf15bc/mlir/include/mlir/Dialect/Linalg/IR/LinalgNamedStructuredOps.yaml#L5647 Issues related to this can be found here https://github.com/nod-ai/SHARK-Turbine/issues/324
2024-01-19 23:39:46 +08:00
"MaxPool3dEmptyStrideStaticModule_basic",
Added e2e LTC tests (#916) * Added e2e LTC Torch MLIR tests * Fix seed for reproducability * Check if computation is None before getting debug string * Updated unit tests, and added numeric tests * Print name of the model layer that fails numeric validation * Run LTC e2e test with CI/CD * Set seed in main function, instead of beginning of execution * Add comment to specify number of digits of precision * Fixed typo * Remove tests for LTC example models * Added LTC option to torchscript e2e * Implement compile and run for LTC e2e test * xfail all tests that use ops that aren't currently supported
2022-06-10 03:56:01 +08:00
"AddIntModule_basic",
[Torch Dialect] support AtenArangeStartOutOp in ReduceOpVariants like… (#2563) … AtenBernoulli_FloatOp It fixing case like: `%2110 = torch.aten.arange.start_out %int1, %int1517, %int1, %2109 : !torch.int, !torch.int, !torch.int, !torch.tensor -> !torch.tensor`. `aten.arange.start_out` doesn't have value semantics also, means`%2110` is an alias for %2109. So I decompose it to `aten.arange.start` + `torch.contents.overwrite`. The complex decomposition logic is target to handle cases like view and dtype cast which I add in e2e tests.
2023-11-17 00:51:55 +08:00
"ArangeStartOutViewModule_basic",
Fix empty tensor when select -1 (#1787)
2023-01-18 02:14:14 +08:00
"AtenIntBoolOpModule_basic",
Added e2e LTC tests (#916) * Added e2e LTC Torch MLIR tests * Fix seed for reproducability * Check if computation is None before getting debug string * Updated unit tests, and added numeric tests * Print name of the model layer that fails numeric validation * Run LTC e2e test with CI/CD * Set seed in main function, instead of beginning of execution * Add comment to specify number of digits of precision * Fixed typo * Remove tests for LTC example models * Added LTC option to torchscript e2e * Implement compile and run for LTC e2e test * xfail all tests that use ops that aren't currently supported
2022-06-10 03:56:01 +08:00
"BernoulliTensorModule_basic",
"BincountMinlengthModule_basic",
"BincountModule_basic",
"BincountStaticSizeModule_basic",
"BoolFloatFalseModule_basic",
"BoolFloatTrueModule_basic",
"BoolIntFalseModule_basic",
"BoolIntTrueModule_basic",
"CeilFloatModule_basic",
"DivFloatModule_basic",
"EqIntModule_basic",
Implement lowering of torch.aten.exponential (#2680) https://github.com/llvm/torch-mlir/issues/2646 Decompose aten.exponential() into: -exp(1-x)/lambda
2023-12-28 12:33:18 +08:00
"ExponentialModule_basic",
Added e2e LTC tests (#916) * Added e2e LTC Torch MLIR tests * Fix seed for reproducability * Check if computation is None before getting debug string * Updated unit tests, and added numeric tests * Print name of the model layer that fails numeric validation * Run LTC e2e test with CI/CD * Set seed in main function, instead of beginning of execution * Add comment to specify number of digits of precision * Fixed typo * Remove tests for LTC example models * Added LTC option to torchscript e2e * Implement compile and run for LTC e2e test * xfail all tests that use ops that aren't currently supported
2022-06-10 03:56:01 +08:00
"GeFloatIntModule_basic",
"GeFloatModule_basic",
Resolve remaining LTC CI failures (#1110) * Replace CHECK_EQ with TORCH_CHECK_EQ * Check value of TORCH_MLIR_USE_INSTALLED_PYTORCH during LTC build * Update LTC XFAIL with NewZerosModule ops * Explicitly blacklist _like ops * Automatically blacklist new_/_like ops * Prune away unused Python dependencies from LTC * Add flag to disable LTC * Autogen dummy _REFERENCE_LAZY_BACKEND library when LTC is disabled * Implement compute_shape_var * Removed Var tests from XFAIL Set * XFAIL tests using _local_scalar_dense or index.Tensor * Add StdDim tests to XFAIL set * Autogen aten::cat
2022-07-30 17:54:40 +08:00
"GeIntModule_basic",
Added e2e LTC tests (#916) * Added e2e LTC Torch MLIR tests * Fix seed for reproducability * Check if computation is None before getting debug string * Updated unit tests, and added numeric tests * Print name of the model layer that fails numeric validation * Run LTC e2e test with CI/CD * Set seed in main function, instead of beginning of execution * Add comment to specify number of digits of precision * Fixed typo * Remove tests for LTC example models * Added LTC option to torchscript e2e * Implement compile and run for LTC e2e test * xfail all tests that use ops that aren't currently supported
2022-06-10 03:56:01 +08:00
"GtFloatIntModule_basic",
"GtIntModule_basic",
"IndexPutImpl1DFloatAccumulateModule_basic",
"IndexPutImpl1DFloatNonAccumulateModule_basic",
"IndexPutImpl1DIntAccumulateModule_basic",
"IndexPutImpl1DIntNonAccumulateModule_basic",
"IndexPutImpl2DFloatAccumulateModule_basic",
"IndexPutImpl2DFloatNonAccumulateModule_basic",
[MLIR][TORCH] Extend implementation of aten._index_put_impl op. This commits adds the support for cases for index_put_op: 1.) where index is a 2-d tensor. 2.) where indices is a list of tensors and none, with exactly 2 non none tensors along the consecutive dimensions. This commit also adds a utility to compute the broadcast shape given the two input tensors. Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2022-12-08 13:46:54 +08:00
"IndexPutImpl2DIndexModule_basic",
[TOSA] Add aten._index_put_impl support (#2031) Add e2e support by add "tosa-to-scf"
2023-07-18 00:51:24 +08:00
"IndexPutImpl2DNoneIndexStaticModule_basic",
Added e2e LTC tests (#916) * Added e2e LTC Torch MLIR tests * Fix seed for reproducability * Check if computation is None before getting debug string * Updated unit tests, and added numeric tests * Print name of the model layer that fails numeric validation * Run LTC e2e test with CI/CD * Set seed in main function, instead of beginning of execution * Add comment to specify number of digits of precision * Fixed typo * Remove tests for LTC example models * Added LTC option to torchscript e2e * Implement compile and run for LTC e2e test * xfail all tests that use ops that aren't currently supported
2022-06-10 03:56:01 +08:00
"IndexPutImpl3DFloatAccumulateModule_basic",
"IndexPutImpl3DFloatNonAccumulateModule_basic",
[MLIR][TORCH] Extend implementation of aten._index_put_impl op. This commits adds the support for cases for index_put_op: 1.) where index is a 2-d tensor. 2.) where indices is a list of tensors and none, with exactly 2 non none tensors along the consecutive dimensions. This commit also adds a utility to compute the broadcast shape given the two input tensors. Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2022-12-08 13:46:54 +08:00
"IndexPutImplIndexWithNoneModule_basic",
Added e2e LTC tests (#916) * Added e2e LTC Torch MLIR tests * Fix seed for reproducability * Check if computation is None before getting debug string * Updated unit tests, and added numeric tests * Print name of the model layer that fails numeric validation * Run LTC e2e test with CI/CD * Set seed in main function, instead of beginning of execution * Add comment to specify number of digits of precision * Fixed typo * Remove tests for LTC example models * Added LTC option to torchscript e2e * Implement compile and run for LTC e2e test * xfail all tests that use ops that aren't currently supported
2022-06-10 03:56:01 +08:00
"Matmul_dot",
"MulIntModule_basic",
[MLIR][TORCH] Add E2E support for `aten.[div.int|bitwise_or.Tensor]` ops This commit adds lowering of `aten.div.int` and `aten.bitwise_or.Tensor` ops. Both these ops are required in order to support bloom_560m model. Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
2022-10-06 21:11:52 +08:00
"DivIntModule_basic",
Added e2e LTC tests (#916) * Added e2e LTC Torch MLIR tests * Fix seed for reproducability * Check if computation is None before getting debug string * Updated unit tests, and added numeric tests * Print name of the model layer that fails numeric validation * Run LTC e2e test with CI/CD * Set seed in main function, instead of beginning of execution * Add comment to specify number of digits of precision * Fixed typo * Remove tests for LTC example models * Added LTC option to torchscript e2e * Implement compile and run for LTC e2e test * xfail all tests that use ops that aren't currently supported
2022-06-10 03:56:01 +08:00
"NeFloatIntModule_basic",
"NeIntModule_basic",
"QuantizedMLP_basic",
[ONNX] Preliminary Work Towards Supporting QuantizedMLP_basic onnx e2e test (#3089) See the related issues here: [SHARK-Turbine#556](https://github.com/nod-ai/SHARK-Turbine/issues/556) 1. Adds uint8 casting to onnx.Cast op 2. Fixes an issue with onnx.DequantizeLinear when the scale comes with shape [1]. 3. Adds support for unsigned types in an AtenItemOp folder 4. Adds a simpler quantized model for easier debugging 5. Adds a fusion pass to convert [quant -> dequant -> transpose -> mm] patterns to [transpose -> quant -> mm]. 6. Moved some xfails that are still not passing, but for different reasons than onnx.cast failures.
2024-04-02 07:21:05 +08:00
"QuantizedSingleLayer_basic",
Adds Some Quantization Support for AtenMatmulOp (#3147) 1. onnx.MatMulInteger now converts to aten.matmul instead of aten.mm 2. aten.matmul, for ranks >=2, now allows quantized inputs and will lower to linalg::quantized_matmul or linalg::quantized_batch_matmul. 3. added AtenMatmulOp to the FuseQuantizeOps rewrite patters QuantizeOperands, QuantizeTransposedOperands, and QuantizeAccumulator 4. added several tests, including some to test AtenMmOp with varying quantization signed-ness. 5. a quantized matmul mat-vec test is added to verify the failure to lower to linalg; cleaned of out-of-date code related to common torch-mlir lowering xfails. 6. in debugging a real model with quantized matmuls, I found a bug on the scalarize-shapes pass which resulted from the aten.full op folder returning an incompatible result type. This is fixed by the small change here to [lib/Dialect/Torch/IR/TorchOps.cpp](https://github.com/llvm/torch-mlir/compare/main...zjgarvey:torch-mlir:MatMulIntegerFix?expand=1#diff-dc8ed165c207918e606490eee3984b1ad51d7034e6aac36fc046bf47f6f03f4f).
2024-04-16 07:06:47 +08:00
"QuantizedBatchedInputSingleLayer_basic",
Added e2e LTC tests (#916) * Added e2e LTC Torch MLIR tests * Fix seed for reproducability * Check if computation is None before getting debug string * Updated unit tests, and added numeric tests * Print name of the model layer that fails numeric validation * Run LTC e2e test with CI/CD * Set seed in main function, instead of beginning of execution * Add comment to specify number of digits of precision * Fixed typo * Remove tests for LTC example models * Added LTC option to torchscript e2e * Implement compile and run for LTC e2e test * xfail all tests that use ops that aren't currently supported
2022-06-10 03:56:01 +08:00
"ScalarImplicitFloatModule_basic",
"ScalarImplicitIntModule_basic",
"SliceEndSleStartModule_basic",
"SliceOutOfUpperBoundIndexModule_basic",
Fixes for split tensor and slice (#2314) * RecomposeComplexOps: Remove dead slice op * lib/Dialect/Torch/IR/TorchOps.cpp: Fold slice ops even when they are on non-value tensors * lib/Conversion/TorchToTosa/TorchToTosa.cpp: Fix slice start/end out of range/none * lib/Dialect/Torch/IR/TorchOps.cpp: AtenSliceTensorOp::fold: Fold slices that go from 0:int_max * More tests for aten.split.Tensor
2023-07-20 15:53:54 +08:00
"SliceOutOfUpperBoundIndexStaticModule_basic",
Added e2e LTC tests (#916) * Added e2e LTC Torch MLIR tests * Fix seed for reproducability * Check if computation is None before getting debug string * Updated unit tests, and added numeric tests * Print name of the model layer that fails numeric validation * Run LTC e2e test with CI/CD * Set seed in main function, instead of beginning of execution * Add comment to specify number of digits of precision * Fixed typo * Remove tests for LTC example models * Added LTC option to torchscript e2e * Implement compile and run for LTC e2e test * xfail all tests that use ops that aren't currently supported
2022-06-10 03:56:01 +08:00
"SliceStartEqEndModule_basic",
"SqrtIntModule_basic",
"SubFloatModule_basic",
[torch] Supporting `torch.aten.mul.float` lowering to `arith` (#2833) Simple missing scalar operation for multiply floats was missing.
2024-02-06 08:23:04 +08:00
"MulFloatModule_basic",
Added e2e LTC tests (#916) * Added e2e LTC Torch MLIR tests * Fix seed for reproducability * Check if computation is None before getting debug string * Updated unit tests, and added numeric tests * Print name of the model layer that fails numeric validation * Run LTC e2e test with CI/CD * Set seed in main function, instead of beginning of execution * Add comment to specify number of digits of precision * Fixed typo * Remove tests for LTC example models * Added LTC option to torchscript e2e * Implement compile and run for LTC e2e test * xfail all tests that use ops that aren't currently supported
2022-06-10 03:56:01 +08:00
"SubIntModule_basic",
Support aten.stack op and decompose it into unsqueeze & cat (#1747)
2023-03-11 09:25:25 +08:00
"TensorsStackPromoteDTypeModule_basic",
Added e2e LTC tests (#916) * Added e2e LTC Torch MLIR tests * Fix seed for reproducability * Check if computation is None before getting debug string * Updated unit tests, and added numeric tests * Print name of the model layer that fails numeric validation * Run LTC e2e test with CI/CD * Set seed in main function, instead of beginning of execution * Add comment to specify number of digits of precision * Fixed typo * Remove tests for LTC example models * Added LTC option to torchscript e2e * Implement compile and run for LTC e2e test * xfail all tests that use ops that aren't currently supported
2022-06-10 03:56:01 +08:00
"TensorToBoolZeroRank_basic",
"TensorToBool_basic",
"TensorToFloatZeroRank_basic",
"TensorToFloat_basic",
"TensorToIntZeroRank_basic",
"TensorToInt_basic",
"UniformModule_basic",
"UnsafeViewCollapseDynamicWithAtenSizeIntModule_basic",
"ViewCollapseDynamicWithAtenSizeIntModule_basic",
Add embedding Bag e2e case in xfail set (#1130)
2022-08-02 06:23:45 +08:00
"AtenEmbeddingBagSumExample_basic",
Add decomposition and E2E support for Aten_EmbeddingBag (#1137) * Add decomposition and E2E support for Aten_EmbeddingBag
2022-08-09 06:56:49 +08:00
"Aten_EmbeddingBagExample_basic",
Implement lowering of torch.aten.logit (#2697) Closes nod-ai/SHARK-Turbine#290
2024-01-11 22:55:42 +08:00
"ElementwiseLogitModule_basic",
E2E support for AtenRemainderScalarOp (#1200)
2022-08-11 08:02:06 +08:00
"ElementwiseRemainderScalarModule_Int_Float_basic",
"ElementwiseRemainderScalarModule_Bool_basic",
Implement lowering of torch.aten.lerp.Scalar (#2773) Closes nod-ai/SHARK-Turbine#356
2024-02-01 01:39:38 +08:00
"ElementwiseLerpScalarIntModule_basic",
"ElementwiseLerpScalarFloatModule_basic",
[MLIR][TORCH] Add Byte and Char Dtype support
2022-09-20 02:50:51 +08:00
"AtenIntTensorByteDtypeModule_basic",
"AtenIntTensorCharDtypeModule_basic",
[MLIR][TORCH] Add E2E support for aten.upsample_nearest2d_backward.vec op Signed-Off By: Vivek Khandelwal<vivek@nod-labs.com>
2022-11-01 21:08:04 +08:00
"UpSampleNearest2dBackwardVec_basic",
"UpSampleNearest2dBackwardOutputSizeNone_basic",
[MLIR][TORCH] Add E2E support aten.convolution_backward op This commit adds the decomposition for the `aten.convolution_backward` and `aten.convolution_backward_overrideable` op.
2022-11-04 15:57:29 +08:00
"ConvolutionBackwardModule2D_basic",
"ConvolutionBackwardModule2DPadded_basic",
[MLIR][TORCH] Add decomposition for aten.var_mean.correction op Signed-Off By: Vivek Khandelwal<vivek@nod-labs.com>
2022-11-15 22:39:40 +08:00
"VarMeanCorrectionModule_basic",
[MLIR][TORCH] Add E2E support for prims.convert_element_type op Signed-Off By: Vivek Khandelwal<vivek@nod-labs.com>
2022-11-21 16:38:47 +08:00
"VarMeanCorrectionNoneModule_basic",
Prelu lowering to linalg (#1712) Prelu lowering to linalg
2022-12-28 11:21:33 +08:00
"ElementwisePreluModule_basic",
[MLIR][TORCH] Add e2e support for aten.var_mean op Signed-Off By: Vivek Khandelwal<vivek@nod-labs.com>
2022-12-09 23:22:26 +08:00
"VarMeanBiasedModule_basic",
"VarMeanUnbiasedModule_basic",
[MLIR][TORCH] Add decomposition for aten.randn_like op This commit decomposes aten.randn_like op into aten.randn.generator op. Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2023-01-16 19:40:21 +08:00
"RandnLikeModule_basic",
"RandnLikeDtypeModule_basic",
Decompose AtenNormalFunctionalOp into AtenRandn* and other arithmetic. (#2737)
2024-01-16 14:49:29 +08:00
"NormalFunctionalModule_basic",
build: manually update PyTorch version Set PyTorch and TorchVision version to nightly release 2023-02-27. This commit also adds the lowering for aten.add and aten.Float.Scalar op. Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2023-02-28 10:32:21 +08:00
"BernoulliFloatModule_basic",
"BernoulliModule_basic",
"BernoulliPModule_basic",
"DropoutTrainModule_basic",
[Torch Dialect] Support aten.native_dropout (#2259) * [Torch Dialect] Support aten.native_dropout * update
2023-06-27 14:19:33 +08:00
"DropoutTrainStaticShapeModule_basic",
"NativeDropoutTrainModule_basic",
"NativeDropoutTrainStaticShapeModule_basic",
build: manually update PyTorch version Set PyTorch and TorchVision version to nightly release 2023-02-27. This commit also adds the lowering for aten.add and aten.Float.Scalar op. Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2023-02-28 10:32:21 +08:00
"StdCorrectionKeepDimModule_basic",
"StdCorrectionNoneModule_basic",
"VarCorrectionKeepDimModule_basic",
"VarCorrectionNoneModule_basic",
[MLIR][TORCH] Add decomposition for prims::squeeze op This commit adds the decomposition for the prims.squeeze op. Signed-Off By: Vivek Khandelwal<vivek@nod-labs.com>
2022-11-16 13:57:58 +08:00
"AtenFloatScalarModule_basic",
"PrimsSqueezeModule_basic",
"PrimsSqueezeEmptyDimensionsModule_basic",
[MLIR][TORCH] Add support for prims::view_of op This op does nothing and just returns the input operand as the result of the op. Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2023-04-10 11:50:26 +08:00
"PrimsViewOfModule_basic",
"PrimsViewOfZeroRankModule_basic",
[Torch Dialect] support for aten.one_hot (#1852)
2023-04-11 16:02:28 +08:00
"OneHotModule_basic",
[MLIR][TORCH] Add E2E support for aten.var_mean.dim op This commit adds the decomposition for the aten.var_mean.dim op. Signed-Off By: Vivek Khandelwal<vivek@nod-labs.com>
2023-04-26 15:14:06 +08:00
"VarMeanDimModule_basic",
"VarMeanDimBiasedModule_basic",
Add complex types support with basic complex ops. Add complex types support with basic complex types. Add aten.imag and aten.real op lowering via linalg_backend.
2023-04-20 00:22:57 +08:00
"AtenComplexImagModule_basic",
"AtenComplexRealModule_basic",
[Torch Op] Add unbind.int support with ListUnpack (#2058) * add unbind int * reformat * use unpack canonicalize * address comments * Empty commit, trigger test * add ltc blacklist * clean up * address comments * check permute list * erase in recompose --------- Co-authored-by: zhekun.zhang <zhekun.zhang@bytedance.com>
2023-05-19 10:07:58 +08:00
"AtenComplexViewModule_basic",
[MLIR][TORCH] Add E2E support for view_as_real op (#2419) * view_as_real test case, allow dtype in testutils.randn * abstract python upstream func implemented * fixed upstream dtype func, implemented view_as_real backend op * formatted AtenViewAsRealOp, removed change in e2etest/framework * removed test suit from reshape_like.py, because it's moved to basic.py * implemented C-API wrapper for mlirComplexF128 type * fixed torch.complex dtype width in MLIR and Torch MLIR, deleted float16 dtype dict * Changed IR input of aten fft_fft unit test * code refactored * code refactored and fixed ci test * refactored: removed white spaces, and rolled back to having both input/output affine expr * refactored: deleted output affine expr to reduce redundancy * xfail ltc backend * removed ComplexImag and ComplexReal from torchdynamo xfail set * copied and pasted from main branch as there's no change to be made in this file * refactored abstract_interp_lib_gen.py * refactored: torchtypes.td, formatted, removed commented out code
2023-09-02 12:12:01 +08:00
"AtenRealView128Module_basic",
"AtenRealView64Module_basic",
[TM_TENSOR] Add `aten.scatter.[src|value]` op This commit adds support of `aten.scatter.src` and `aten.scatter.value` ops. Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
2022-10-16 05:46:06 +08:00
"ScatterValueFloatModule_basic",
"ScatterValueIntModule_basic",
[Torch Dialect] add folder for aten.add (#2264) * [Torch Dialect] add folder for aten.add * update * update * update
2023-06-27 10:55:28 +08:00
"UniformStaticShapeModule_basic",
[MLIR][TORCH] Add StableHLO lowering for embedding_bag.padding_idx op Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2023-09-05 21:28:37 +08:00
"AtenEmbeddingBagStaticModule_basic",
[MLIR][TORCH] Add E2E support for aten.empty_strided decomposition op (redo PR) (#2459) Making the same PR with #2457, as I accidentally thought the review was already made and merged it (reverted). Add decompose empty_strided op. Referring to #1776, this decomposition op only supports default stride values, because accessing the tensor or indexing over that, the indices are determined by the strides. In MLIR, this is not implicitly supported but assumes that the strides are default while iterating over the tensor.
2023-09-14 01:04:31 +08:00
"EmptyStridedModule_basic",
Rework AtenEmptyStridedOp checks (#2537) Now using Value instead of Ints. Trades compile failure for a runtime assert
2023-11-01 11:56:54 +08:00
"EmptyStridedSizeIntStrideModule_basic",
[MLIR][TORCH] Add support for bitwise_right_shit and bitwise_and.Scalar op Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2023-09-28 20:53:02 +08:00
"ElementwiseBitwiseAndScalarInt64Module_basic",
"ElementwiseBitwiseAndScalarInt32Module_basic",
[MLIR][TORCH] Add support for int8 dtype for sub, add, and bitwise_and op Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2023-10-03 19:59:56 +08:00
"ElementwiseBitwiseAndScalarInt8Module_basic",
[torch] Support `torch.convolution` quantized lowering to `linalg` (#2811) Linalg has quantized specific operations. We can lower to these operations when there is a known zeropoint and scale operations. This allows the `convolution` to occur with lower bitwidth's, improving the overall performance.
2024-01-31 05:46:47 +08:00
"Conv2dQInt8Module_basic",
Added e2e LTC tests (#916) * Added e2e LTC Torch MLIR tests * Fix seed for reproducability * Check if computation is None before getting debug string * Updated unit tests, and added numeric tests * Print name of the model layer that fails numeric validation * Run LTC e2e test with CI/CD * Set seed in main function, instead of beginning of execution * Add comment to specify number of digits of precision * Fixed typo * Remove tests for LTC example models * Added LTC option to torchscript e2e * Implement compile and run for LTC e2e test * xfail all tests that use ops that aren't currently supported
2022-06-10 03:56:01 +08:00
}
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
ONNX_XFAIL_SET = {
[ONNX] Support onnx.LSTM (#2969) This PR only performs a lit test. In lieu of an e2e test, https://github.com/nod-ai/SHARK-TestSuite/pull/142 makede sure that the lowering works & the numbers check out. Co-authored-by: Xida Ren <xida.ren.dev@gmail.com>
2024-04-09 03:23:33 +08:00
[onnx] Fix ReduceMean lowering to torch (#2956) Torch lowering only supported the most recent version. Refactored the lowering so more easily handle default values and optional operands / attributes.
2024-02-28 14:48:07 +08:00
# Failure - cast error
"PermuteNegativeIndexModule_basic",
# Failure - incorrect numerics
"ElementwiseAtan2TensorIntModule_basic",
"ElementwiseLog10IntModule_basic",
"ElementwiseLog2IntModule_basic",
"ElementwiseSeluModule_basic",
"FlipModuleStaticShape_basic",
"FlipNegativeIndexModule_basic",
"HardsigmoidModule_basic",
"HardsigmoidRandomModule_basic",
"PixelShuffleModuleStaticRank4Float32_basic",
"SliceCopyEndGreaterThanDimSize_Module_basic",
"SliceCopyNegative_Module_basic",
"SliceCopyNonZeroDim_Module_basic",
"SliceCopy_Module_basic",
"TupleModule_basic",
# Failure - incorrect shape
"ArangeStartOutDtypeModule_basic",
"ArangeStartOutViewModule_basic",
"BroadcastDynamicDimModule_basic",
"MoveDimIntNegativeIndexModule_basic",
"ViewSizeFromOtherTensor_basic",
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
# Failure - onnx_export
[Torch Dialect] canonicalize aten.sign to aten.sgn (#3112) * `aten.sign` is a sub-set of `aten.sgn` (`aten.sgn` support complex type).
2024-04-08 20:05:42 +08:00
"ElementwiseSgnModule_basic",
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
"AdaptiveAvgPool1dGeneralDynamic_basic",
"AdaptiveAvgPool1dNonUnitOutputSizeDynamicModule_basic",
"AdaptiveAvgPool1dStaticLargerOutput_basic",
"AdaptiveAvgPool2dNonUnitOutputSizeDynamicModule_basic",
[Torch] Add general AdaptiveAvgPool2dOp decompose support (#3111) Previously, it could only handle the situations where outputsize == (1, 1) or outputsize == (input_H, input_W). Now it supports all situations where input_H % output_H== 0 && input_W % output_W == 0
2024-04-11 17:02:59 +08:00
"AdaptiveAvgPool2dOutputSizeDivisibleByInputDynamicModule_basic",
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
"AdaptiveMaxPool2dDynamicWithIndices_basic",
"AdaptiveMaxPool2dDynamic_basic",
"AdaptiveMaxPool2dStaticWithIndices_basic",
"AdaptiveMaxPool2dStatic_basic",
Converts all Adaptive Pooling Ops to Linalg (#2808) The previous conversions for AtenAdaptiveAvgPool1dOp and AtenAdaptiveMaxPool2dOp are refactored into a general templated conversion that works for all of the AtenAdaptive...PoolNdOp's. New support is added for the following ops: 1. AtenAdaptiveMaxPool1d 2. AtenAdaptiveMaxPool3d 3. AtenAdaptiveAvgPool3d Support is also provided for passing inputs without batch dimensions. For example, applying adaptive_avg_pool2d to an input tensor of rank 3. After [pytorch #118162](https://github.com/pytorch/pytorch/pull/118162) gets down to torch-mlir, I'll add a test for AdaptiveMaxPool1d with return_indices (which will pass with that upstream fix). --------- Co-authored-by: James Newling <james.newling@gmail.com>
2024-03-23 02:05:20 +08:00
"AdaptiveMaxPool3dStatic_basic",
"AdaptiveMaxPool3dStaticWithIndices_basic",
"AdaptiveMaxPool3dDynamic_basic",
"AdaptiveMaxPool3dDynamicWithIndices_basic",
"AdaptiveMaxPool3dDynamicNoBatch_basic",
"AdaptiveMaxPool2dDynamicNoBatch_basic",
"AdaptiveMaxPool1dStatic_basic",
"AdaptiveMaxPool1dDynamic_basic",
"AdaptiveMaxPool1dDynamicNoBatch_basic",
"AdaptiveAvgPool3dDynamic_basic",
"AdaptiveAvgPool3dDynamicNoBatch_basic",
"AdaptiveAvgPool2dDynamic_basic",
"AdaptiveAvgPool2dDynamicNoBatch_basic",
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
"AddCDivModule_basic",
"AddIntModule_basic",
"Add_Module_basic",
"AllBoolFalseModule_basic",
"AllBoolTrueModule_basic",
"AnyBoolFalseModule_basic",
"AnyBoolTrueModule_basic",
"AtenComplex64Module_basic",
"AtenComplexImagModule_basic",
"AtenComplexRealModule_basic",
"AtenComplexViewModule_basic",
"AtenEmbeddingBagStaticModule_basic",
"AtenEmbeddingBagSumExample_basic",
"AtenFloatScalarModule_basic",
"AtenIntBoolOpConstFalseModule_basic",
"AtenIntBoolOpConstTrueModule_basic",
"AtenIntBoolOpModule_basic",
"AtenIntTensorByteDtypeModule_basic",
"AtenIntTensorCharDtypeModule_basic",
"AtenItemFpOpModule_basic",
"AtenItemIntOpModule_basic",
Adds Some Quantization Support for AtenMatmulOp (#3147) 1. onnx.MatMulInteger now converts to aten.matmul instead of aten.mm 2. aten.matmul, for ranks >=2, now allows quantized inputs and will lower to linalg::quantized_matmul or linalg::quantized_batch_matmul. 3. added AtenMatmulOp to the FuseQuantizeOps rewrite patters QuantizeOperands, QuantizeTransposedOperands, and QuantizeAccumulator 4. added several tests, including some to test AtenMmOp with varying quantization signed-ness. 5. a quantized matmul mat-vec test is added to verify the failure to lower to linalg; cleaned of out-of-date code related to common torch-mlir lowering xfails. 6. in debugging a real model with quantized matmuls, I found a bug on the scalarize-shapes pass which resulted from the aten.full op folder returning an incompatible result type. This is fixed by the small change here to [lib/Dialect/Torch/IR/TorchOps.cpp](https://github.com/llvm/torch-mlir/compare/main...zjgarvey:torch-mlir:MatMulIntegerFix?expand=1#diff-dc8ed165c207918e606490eee3984b1ad51d7034e6aac36fc046bf47f6f03f4f).
2024-04-16 07:06:47 +08:00
"AtenMmQint8_basic",
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
"AtenMmQuint8_basic",
Adds Some Quantization Support for AtenMatmulOp (#3147) 1. onnx.MatMulInteger now converts to aten.matmul instead of aten.mm 2. aten.matmul, for ranks >=2, now allows quantized inputs and will lower to linalg::quantized_matmul or linalg::quantized_batch_matmul. 3. added AtenMatmulOp to the FuseQuantizeOps rewrite patters QuantizeOperands, QuantizeTransposedOperands, and QuantizeAccumulator 4. added several tests, including some to test AtenMmOp with varying quantization signed-ness. 5. a quantized matmul mat-vec test is added to verify the failure to lower to linalg; cleaned of out-of-date code related to common torch-mlir lowering xfails. 6. in debugging a real model with quantized matmuls, I found a bug on the scalarize-shapes pass which resulted from the aten.full op folder returning an incompatible result type. This is fixed by the small change here to [lib/Dialect/Torch/IR/TorchOps.cpp](https://github.com/llvm/torch-mlir/compare/main...zjgarvey:torch-mlir:MatMulIntegerFix?expand=1#diff-dc8ed165c207918e606490eee3984b1ad51d7034e6aac36fc046bf47f6f03f4f).
2024-04-16 07:06:47 +08:00
"AtenMmQMixedSigni8_basic",
"AtenMatmulQMixedSigni8Transpose_basic",
"AtenMatmulQMixedSigni8_basic",
"AtenMatmulQint8MV_basic",
[TorchToLinalg] Adds Support for Remaining Quantized Matmul Cases (#3167) The new cases added for quantized matmuls are: 1. vec-vec 2. vec-mat 3. mat-vec each of which are now lowered to expand(s), quantized_matmul, and collapse.
2024-04-17 00:28:28 +08:00
"AtenMatmulQint8VV_basic",
"AtenMatmulQint8VM_basic",
Adds Some Quantization Support for AtenMatmulOp (#3147) 1. onnx.MatMulInteger now converts to aten.matmul instead of aten.mm 2. aten.matmul, for ranks >=2, now allows quantized inputs and will lower to linalg::quantized_matmul or linalg::quantized_batch_matmul. 3. added AtenMatmulOp to the FuseQuantizeOps rewrite patters QuantizeOperands, QuantizeTransposedOperands, and QuantizeAccumulator 4. added several tests, including some to test AtenMmOp with varying quantization signed-ness. 5. a quantized matmul mat-vec test is added to verify the failure to lower to linalg; cleaned of out-of-date code related to common torch-mlir lowering xfails. 6. in debugging a real model with quantized matmuls, I found a bug on the scalarize-shapes pass which resulted from the aten.full op folder returning an incompatible result type. This is fixed by the small change here to [lib/Dialect/Torch/IR/TorchOps.cpp](https://github.com/llvm/torch-mlir/compare/main...zjgarvey:torch-mlir:MatMulIntegerFix?expand=1#diff-dc8ed165c207918e606490eee3984b1ad51d7034e6aac36fc046bf47f6f03f4f).
2024-04-16 07:06:47 +08:00
"AtenMatmulQint8_basic",
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
"AtenRealView128Module_basic",
"AtenRealView64Module_basic",
"AtenSubFloatModule_basic",
"AtenTopKModule_basic",
"AtenTopKSmallestModule_basic",
"Aten_EmbeddingBagExample_basic",
"AvgPool2dWithoutPadModule_basic",
"BatchMlpLayerModule_basic",
"BincountMinlengthModule_basic",
"BincountModule_basic",
"BincountStaticSizeModule_basic",
"BoolFloatConstantModule_basic",
"BoolFloatFalseModule_basic",
"BoolFloatTrueModule_basic",
"BoolIntConstantModule_basic",
"BoolIntFalseModule_basic",
"BoolIntTrueModule_basic",
"CeilFloatModule_basic",
"ChunkListUnpackDynamic_Module_basic",
"ChunkListUnpackUnevenDynamic_Module_basic",
"CollapseAllDimensionsModule_basic",
"CollapseFullDynamicModule_basic",
"CollapsePartialDynamicModule_basic",
"CollapseRank1DynamicModule_basic",
"CollapseStaticModule_basic",
"ConstantBoolParameterModule_basic",
"ContainsIntList_False",
"ContainsIntList_True",
"Conv1dModule_basic",
"Conv2dBiasNoPaddingModule_basic",
"Conv2dModule_basic",
"Conv2dNoPaddingModule_basic",
"Conv2dQInt8Module_basic",
"Conv2dWithPaddingDilationStrideModule_basic",
"Conv2dWithPaddingModule_basic",
"Conv3dModule_basic",
"ConvTbcModule_basic",
"Conv_Transpose2dModule_basic",
"Convolution2DModule_basic",
"Convolution2DStridedModule_basic",
"ConvolutionBackwardModule2DPadded_basic",
"ConvolutionBackwardModule2DStatic_basic",
"ConvolutionBackwardModule2DStrided_basic",
"ConvolutionBackwardModule2D_basic",
"ConvolutionModule2DGroups_basic",
"ConvolutionModule2DTransposeNonUnitOutputPadding_basic",
"ConvolutionModule2DTransposeStrided_basic",
"ConvolutionModule2DTranspose_basic",
"DivFloatModule_basic",
"DivIntModule_basic",
"ElementwiseAcoshIntModule_basic",
"ElementwiseAcoshModule_basic",
[Torch] Support Aten__And__ScalarOp (#3114)
2024-04-08 20:24:17 +08:00
"ElementwiseAndScalarModule_basic",
"ElementwiseAndScalarStaticShapeModule_basic",
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
"ElementwiseAsinhIntModule_basic",
"ElementwiseAsinhModule_basic",
"ElementwiseAtanhIntModule_basic",
"ElementwiseAtanhModule_basic",
"ElementwiseAtenIsneginfOpModule_basic",
"ElementwiseAtenIsposinfOpModule_basic",
"ElementwiseBitwiseAndModule_basic",
"ElementwiseBitwiseAndScalarInt32Module_basic",
"ElementwiseBitwiseAndScalarInt64Module_basic",
"ElementwiseBitwiseAndScalarInt8Module_basic",
"ElementwiseBitwiseAndStaticShapeModule_basic",
"ElementwiseBitwiseLeftShiftInt32Module_basic",
"ElementwiseBitwiseLeftShiftInt64Module_basic",
"ElementwiseBitwiseLeftShiftInt8Module_basic",
"ElementwiseBitwiseNotInt32Module_basic",
"ElementwiseBitwiseNotInt64Module_basic",
"ElementwiseBitwiseOrModule_basic",
"ElementwiseBitwiseOrStaticShapeModule_basic",
"ElementwiseBitwiseRightShiftInt32Module_basic",
"ElementwiseBitwiseRightShiftInt64Module_basic",
"ElementwiseBitwiseRightShiftInt8Module_basic",
"ElementwiseBitwiseXorModule_basic",
"ElementwiseBitwiseXorStaticShapeModule_basic",
"ElementwiseCoshIntModule_basic",
"ElementwiseCoshModule_basic",
"ElementwiseDequantizePerChannelModule_basic",
"ElementwiseDequantizePerTensorModule_basic",
"ElementwiseEluNonDefaultModule_basic",
"ElementwiseExpm1IntModule_basic",
"ElementwiseExpm1Module_basic",
"ElementwiseMulTensorComplexModule_basic",
"ElementwiseOrTensorModule_basic",
"ElementwiseOrTensorStaticShapeModule_basic",
"ElementwiseQuantizePerTensorModule_basic",
[torch] Fix clamp ranges on quantize_per_tensor on unsigned (#3018) SExtValue was used for `int` and `uint` clamp values. This caused the result to always be outputed as `zero`.
2024-03-21 04:37:47 +08:00
"ElementwiseQuantizePerTensorUIntModule_basic",
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
"ElementwiseRemainderTensorModule_Int_basic",
Implement lowering of torch.aten.fmod.Tensor (#2767) Closing https://github.com/nod-ai/SHARK-Turbine/issues/351
2024-02-29 13:52:03 +08:00
"ElementwiseFmodTensor_Int_basic",
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
"EmptyStridedModule_basic",
"EmptyStridedSizeIntStrideModule_basic",
"EqIntModule_basic",
"ExponentialModule_basic",
[onnx] Fix ReduceMean lowering to torch (#2956) Torch lowering only supported the most recent version. Refactored the lowering so more easily handle default values and optional operands / attributes.
2024-02-28 14:48:07 +08:00
"FloatImplicitModule_basic",
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
"GeFloatIntModule_basic",
"GeFloatModule_basic",
"GeIntModule_basic",
"GeluBackwardModule_basic",
"GtFloatIntModule_basic",
"GtIntModule_basic",
"HardtanhBackward_basic",
"IndexPutImpl1DFloatAccumulateModule_basic",
"IndexPutImpl1DFloatNonAccumulateModule_basic",
[torch] Support implicit batch for index_put (#3128) If there is only a single value scattered there can be an implicit batch dimension. This includes a check for the implicit batch dimension when reshaping the update tensor. It includes an e2e test to verify correctness.
2024-04-12 01:18:03 +08:00
"IndexPutImpl2DImplicitModule_basic",
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
"IndexPutImpl1DIntAccumulateModule_basic",
"IndexPutImpl1DIntNonAccumulateModule_basic",
"IndexPutImpl2DFloatAccumulateModule_basic",
"IndexPutImpl2DFloatNonAccumulateModule_basic",
"IndexPutImpl2DIndexModule_basic",
"IndexPutImpl2DNoneIndexStaticModule_basic",
"IndexPutImpl3DFloatAccumulateModule_basic",
"IndexPutImpl3DFloatNonAccumulateModule_basic",
"IndexPutImplIndexWithNoneModule_basic",
"IntFloatModule_basic",
[onnx] Fix ReduceMean lowering to torch (#2956) Torch lowering only supported the most recent version. Refactored the lowering so more easily handle default values and optional operands / attributes.
2024-02-28 14:48:07 +08:00
"IntImplicitModule_basic",
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
"IouOfModule_basic",
"IsFloatingPointFloat_True",
"IsFloatingPointInt_False",
"IscloseStaticModuleTrue_basic",
"IscloseStaticModule_basic",
"LeakyReluBackwardModule_basic",
"LeakyReluBackwardStaticModule_basic",
"LenStrModule_basic",
"LiftFreshCopyModule_basic",
"LogSoftmaxBackwardModule_basic",
"MaxPool2dCeilModeTrueModule_basic",
"MaxPool2dModule_basic",
"MaxPool2dWithIndicesAllOnesModule_basic",
"MaxPool2dWithIndicesBackwardDynamic3DModule_basic",
"MaxPool2dWithIndicesBackwardDynamic4DModule_basic",
"MaxPool2dWithIndicesBackwardStatic3DModule_basic",
"MaxPool2dWithIndicesBackwardStatic4DModule_basic",
"MaxPool2dWithIndicesCeilModeTrueModule_basic",
"MaxPool2dWithIndicesFullSizeKernelModule_basic",
"MaxPool2dWithIndicesModule_basic",
"MaxPool2dWithIndicesNonDefaultDilationModule_basic",
"MaxPool2dWithIndicesNonDefaultParamsModule_basic",
"MaxPool2dWithIndicesNonDefaultStrideModule_basic",
"MaxPool3dCeilModeTrueModule_basic",
"MaxPool3dLargeDatadModule_basic",
"MaxPool3dModuleRandomSimple_basic",
"MaxPool3dModule_basic",
"MeanDimEmptyDimModule_basic",
"Mlp1LayerModule_basic",
"Mlp2LayerModuleNoBias_basic",
"Mlp2LayerModule_basic",
"MulFloatModule_basic",
"MulIntModule_basic",
"NarrowHorizontalTest2_basic",
"NarrowHorizontalTest_basic",
"NarrowTensorHorizontalModule_basic",
"NarrowTensorVerticalModule_basic",
"NarrowVerticalTest2_basic",
"NarrowVerticalTest_basic",
"NativeBatchNorm1DModule_basic",
"NativeBatchNorm2DModule_basic",
"NativeBatchNorm3DModule_basic",
"NativeBatchNormNoneWeightModule_basic",
"NativeDropoutEvalFloatModule_basic",
"NativeGroupNormBackwardModule_basic",
"NativeGroupNormModule_basic",
"NativeLayerNormDynamicModule_basic",
"NeFloatIntModule_basic",
"NeIntModule_basic",
"NewEmptyStridedModuleDefaultDtype_basic",
"NllLossModuleBackward1DMeanWeight_basic",
"NllLossModuleBackward1DMean_basic",
"NllLossModuleBackward1DSumWeight_basic",
"NllLossModuleBackward1DSum_basic",
"NllLossModuleBackward1DWeight_basic",
"NllLossModuleBackward1D_basic",
"NllLossModuleBackwardMeanWeight_basic",
"NllLossModuleBackwardMean_basic",
"NllLossModuleBackwardSumWeight_basic",
"NllLossModuleBackwardSum_basic",
"NllLossModuleBackwardWeight_basic",
"NllLossModuleBackward_basic",
"NllLossModuleBackward_ignore_index",
"NllLossModule_1D_basic",
"NllLossModule_basic",
"NllLossModule_ignore_index_out_of_bounds_basic",
"NllLossModule_mean_basic",
"NllLossModule_sum_basic",
Implement lowering of torch.aten.norm.Scalar (#2899) Closes [nod-ai/SHARK-Turbine#365](https://github.com/nod-ai/SHARK-Turbine/issues/365)
2024-02-27 00:46:56 +08:00
"NormScalarModule_basic",
Add complex support for aten.norm and similar operations (#3052) Add support for complex-type input tensors for norm, vector norm, and Frobenius norm operations.
2024-04-02 16:33:30 +08:00
"NormScalarComplexModule_basic",
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
"NormScalarOptDimKeepDimModule_basic",
"NormScalarOptDimModule_basic",
Add complex support for aten.norm and similar operations (#3052) Add support for complex-type input tensors for norm, vector norm, and Frobenius norm operations.
2024-04-02 16:33:30 +08:00
"NormScalarOptDimKeepDimComplexModule_basic",
"LinalgNormKeepDimComplexModule_basic",
"LinalgVectorNormComplexModule_basic",
"ReduceFrobeniusNormComplexModule_basic",
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
"NormalFunctionalModule_basic",
"NumToTensorFloatModule_basic",
"NumToTensorIntModule_basic",
"NumelModule_basic",
"NumelZeroRankModule_basic",
"PixelShuffleModuleFullDynamic_basic",
"PixelShuffleModuleSpatiallyDynamic_basic",
"PixelShuffleModuleSpatiallyStatic_basic",
"PixelShuffleModuleStaticRank3Int64_basic",
"PowIntFloatModule_basic",
"PrimMaxIntModule_basic",
"PrimMinIntDynamicModule_basic",
"PrimMinIntModule_basic",
"PrimsConvertElementTypeModule_basic",
"PrimsSqueezeEmptyDimensionsModule_basic",
"PrimsSqueezeModule_basic",
"PrimsViewOfModule_basic",
"PrimsViewOfZeroRankModule_basic",
"RandIntDtypeModule_basic",
"RandIntModule_basic",
"RandIntPinMemoryModule_basic",
"ReshapeAliasCollapseModule_basic",
"ReshapeAliasExpandModule_basic",
"ReshapeExpandModule_basic",
"ScalarConstantTupleModule_basic",
"ScalarImplicitFloatModule_basic",
"ScalarImplicitIntModule_basic",
"ScatterReduceFloatMaxModule",
"ScatterReduceFloatMeanModule",
"ScatterReduceFloatMeanModuleIncludeSelf",
"ScatterReduceFloatMinModule",
"ScatterReduceFloatProdModule",
"ScatterReduceFloatSumModule",
"ScatterReduceIntMaxModule",
"ScatterReduceIntMeanModule",
"ScatterReduceIntMeanModuleIncludeSelf",
"ScatterReduceIntMinModule",
"ScatterReduceIntProdModule",
"ScatterReduceIntSumModule",
"SelectScattertModule_basic",
"SelectScattertStaticModule_basic",
"SliceEndSleStartModule_basic",
"SliceOutOfUpperBoundIndexModule_basic",
"SliceScatterModule_basic",
"SliceScatterNegativeDimModule_basic",
"SliceScatterNegativeEndModule_basic",
"SliceScatterStaticModule_basic",
"SliceScatterStepVariationModule_basic",
"SliceScatterZeroDimModule_basic",
"SliceStartEqEndModule_basic",
"SoftmaxBackwardModule_basic",
"SortIntListReverse_basic",
"SortIntList_basic",
"SplitDimDynamicModule_basic",
"SplitDimStaticModule_basic",
"SqrtIntConstantModule_basic",
"SqrtIntModule_basic",
"StdCorrectionEmptyDimModule_basic",
"StdDimEmptyDimModule_basic",
"SubFloatModule_basic",
"SubIntModule_basic",
"TanhBackward_basic",
"TensorToBoolZeroRank_basic",
"TensorToBool_basic",
"TensorToFloatZeroRank_basic",
"TensorToFloat_basic",
"TensorToIntZeroRank_basic",
"TensorToInt_basic",
"TestMultipleTensorAndPrimitiveTypesReturn_basic",
"Threshold1dFloatModule_basic",
"Threshold1dIntI32Module_basic",
"Threshold1dIntModule_basic",
"Threshold2dFloatModule_basic",
"Threshold2dIntModule_basic",
"Threshold3dFloatModule_basic",
"Threshold3dIntModule_basic",
"ThresholdBackward1dFloatModule_basic",
"ThresholdBackward1dIntModule_basic",
"ThresholdBackward1dMixedModule_basic",
"ThresholdBackward2dFloatModule_basic",
"ThresholdBackward2dIntModule_basic",
"ThresholdBackward2dMixedModule_basic",
"ThresholdBackward3dFloatModule_basic",
"ThresholdBackward3dIntModule_basic",
"ThresholdBackward3dMixedModule_basic",
"ToCopyBoolDTypeStaticModule_basic",
"ToCopyModule_basic",
"ToCopyWithDTypeFalsePinMemoryModule_basic",
"ToCopyWithDTypeModule_basic",
"TorchPrimLoopForLikeModule_basic",
"TorchPrimLoopWhileLikeModule_basic",
"TraceModule_basic",
"TraceModule_empty",
"TraceModule_nonsquare",
"TraceSignedIntModule_basic",
"TraceUnsignedIntModule_basic",
"TraceUnsignedIntModule_empty",
"UniformModule_basic",
"UniformNoCorrelationModule_basic",
"UniformStaticShapeModule_basic",
"UnsafeIndexPutHackedTwin1DFloatNonAccumulateModule_basic",
"UnsafeView1DFoldModule_basic",
"UnsafeViewCollapseDynamicWithAtenSizeIntModule_basic",
"UnsafeViewCollapseModule_basic",
"UnsafeViewDynamicExpandModule_basic",
"UnsafeViewDynamicExpandWithAtenSizeIntModule_basic",
"UnsafeViewExpandModule_basic",
"UpSampleNearest2dBackwardScalesNone_basic",
"UpSampleNearest2dBackward_basic",
"UpSampleNearest2dDynamicFactor_basic",
"UpSampleNearest2dStaticFactor_basic",
"UpSampleNearest2d_basic",
"VarCorrectionEmptyDimModule_basic",
"VarDimEmptyDimModule_basic",
"ViewCollapseDynamicWithAtenSizeIntModule_basic",
"ViewCollapseModule_basic",
"ViewDynamicExpandCollapseModule_basic",
"ViewDynamicExpandCollapseWithAtenIntModule_basic",
"ViewDynamicExpandModule_basic",
"ViewDynamicExpandWithAtenSizeIntModule_basic",
"ViewExpandDynamicDimModule_basic",
"ViewNoChange1dModule_basic",
"ViewNoChange2dModule_basic",
"ViewNoChange3dModule_basic",
"_Convolution2DAllFalseModule_basic",
"_Convolution2DBenchmarkModule_basic",
"_Convolution2DCudnnModule_basic",
"_Convolution2DDeterministicModule_basic",
"_Convolution2DTF32Module_basic",
"_ConvolutionDeprecated2DAllFalseModule_basic",
"_ConvolutionDeprecated2DBenchmarkModule_basic",
"_ConvolutionDeprecated2DCudnnModule_basic",
"_ConvolutionDeprecated2DDeterministicModule_basic",
"_SoftmaxModule_basic",
[onnx] Fix ReduceMean lowering to torch (#2956) Torch lowering only supported the most recent version. Refactored the lowering so more easily handle default values and optional operands / attributes.
2024-02-28 14:48:07 +08:00
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
# Failure - onnx_import
"DiagonalModule_basic",
"DiagonalModule_nonsquare",
"DiagonalModule_transposed",
"DiagonalModule_with_dims",
"DiagonalModule_with_dims_and_offset",
"DiagonalModule_with_negative_dims",
"DiagonalModule_with_offset",
Implement linalg lowering of diag_embed torch op (#2885) This PR adds lowering of diag_embed to linalg dilect. Tracked in https://github.com/nod-ai/SHARK-Turbine/issues/288 --------- Co-authored-by: sachink <sachink@xilinx.com>
2024-03-23 07:32:50 +08:00
"AtenDiagEmbedDefaultDiag_basic",
"AtenDiagEmbedDimDiag_basic",
"AtenDiagEmbedOffsetDiag_basic",
"AtenDiagEmbedRevDimDiag_basic",
"AtenDiagEmbedNegOffsetDiag_basic",
"AtenDiagEmbedNonDefault4DDiag_basic",
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
"ScatterReduceFloatMaxModuleIncludeSelf",
"ScatterReduceFloatMinModuleIncludeSelf",
"ScatterReduceFloatProdModuleIncludeSelf",
"ScatterReduceFloatSumModuleIncludeSelf",
"ScatterReduceIntMaxModuleIncludeSelf",
"ScatterReduceIntMinModuleIncludeSelf",
"ScatterReduceIntProdModuleIncludeSelf",
"ScatterReduceIntSumModuleIncludeSelf",
"TileBigDimsSizeModule_basic",
"TileSmallDimsSizeModule_basic",
e2e support aten.linalg_norm to aten.linalg_vector_norm (#2953) Add e2d support for `aten.linalg_norm` by decompose it to `aten.linalg_vector_norm`. Lowering to `aten.linalg_matrix_norm` is still unsupported. To Test: `python -m e2e_testing.main -v` --------- Co-authored-by: Ze Zhang <ze.zhang@getcruise.com>
2024-03-06 08:31:01 +08:00
"LinalgNormKeepDimModule_basic",
"LinalgNormModule_basic",
[onnx] Fix ReduceMean lowering to torch (#2956) Torch lowering only supported the most recent version. Refactored the lowering so more easily handle default values and optional operands / attributes.
2024-02-28 14:48:07 +08:00
# Failure - onnx_lowering: onnx.AveragePool
Converts all Adaptive Pooling Ops to Linalg (#2808) The previous conversions for AtenAdaptiveAvgPool1dOp and AtenAdaptiveMaxPool2dOp are refactored into a general templated conversion that works for all of the AtenAdaptive...PoolNdOp's. New support is added for the following ops: 1. AtenAdaptiveMaxPool1d 2. AtenAdaptiveMaxPool3d 3. AtenAdaptiveAvgPool3d Support is also provided for passing inputs without batch dimensions. For example, applying adaptive_avg_pool2d to an input tensor of rank 3. After [pytorch #118162](https://github.com/pytorch/pytorch/pull/118162) gets down to torch-mlir, I'll add a test for AdaptiveMaxPool1d with return_indices (which will pass with that upstream fix). --------- Co-authored-by: James Newling <james.newling@gmail.com>
2024-03-23 02:05:20 +08:00
"AdaptiveAvgPool1dGeneralDynamicNoBatches_basic",
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
"AvgPool2dDivisorOverrideModule_basic",
[onnx] Fix ReduceMean lowering to torch (#2956) Torch lowering only supported the most recent version. Refactored the lowering so more easily handle default values and optional operands / attributes.
2024-02-28 14:48:07 +08:00
# Failure - onnx_lowering: onnx.Clip
"NormalizeModule_basic",
# Failure - onnx_lowering: onnx.MaxPool
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
"MaxPool2dWithIndicesAllNegativeValuesModule_basic",
"MaxPool2dWithIndicesNonDefaultPaddingModule_basic",
"MaxPool2dWithIndicesStaticModule_basic",
[onnx] Fix ReduceMean lowering to torch (#2956) Torch lowering only supported the most recent version. Refactored the lowering so more easily handle default values and optional operands / attributes.
2024-02-28 14:48:07 +08:00
# Failure - onnx_lowering: onnx.OneHot
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
"OneHotModule_basic",
[onnx] Fix ReduceMean lowering to torch (#2956) Torch lowering only supported the most recent version. Refactored the lowering so more easily handle default values and optional operands / attributes.
2024-02-28 14:48:07 +08:00
# Failure - onnx_lowering: onnx.Pad
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
"ReflectionPad1dModule2dInput_Right",
"ReflectionPad1dModule2dInput_basic",
"ReflectionPad1dModule3dInput_Left",
"ReflectionPad1dModule3dInput_basic",
"ReflectionPad2dModule_Bottom",
"ReflectionPad2dModule_Left",
"ReflectionPad2dModule_Right",
"ReflectionPad2dModule_Top",
"ReflectionPad2dModule_basic",
"ReplicationPad2dModule_basic",
"ReplicationPad2dModule_bottom0",
"ReplicationPad2dModule_left0",
"ReplicationPad2dModule_right0",
"ReplicationPad2dModule_top0",
[onnx] Fix ReduceMean lowering to torch (#2956) Torch lowering only supported the most recent version. Refactored the lowering so more easily handle default values and optional operands / attributes.
2024-02-28 14:48:07 +08:00
# Failure - onnx_lowering: onnx.RandomNormal
"RandnDtypeDeviceModule_basic",
"RandnGeneratorF64Module_basic",
"RandnGeneratorModule_basic",
"RandnModule_basic",
# Failure - onnx_lowering: onnx.RandomNormalLike
"RandnLikeDtypeModule_basic",
"RandnLikeModule_basic",
# Failure - onnx_lowering: onnx.RandomUniform
"RandIntLowDtypeModule_basic",
"RandIntLowModule_basic",
# Failure - onnx_lowering: onnx.RandomUniformLike
"BernoulliFloatModule_basic",
"BernoulliPModule_basic",
"BernoulliTensorModule_basic",
"RandLikeDtypeModule_basic",
"RandLikeModule_basic",
"RandModule_basic",
# Failure - onnx_lowering: onnx.ReduceL1
Add complex support for aten.norm and similar operations (#3052) Add support for complex-type input tensors for norm, vector norm, and Frobenius norm operations.
2024-04-02 16:33:30 +08:00
"ReduceL1NormComplexModule_basic",
[onnx] Fix ReduceMean lowering to torch (#2956) Torch lowering only supported the most recent version. Refactored the lowering so more easily handle default values and optional operands / attributes.
2024-02-28 14:48:07 +08:00
# Failure - onnx_lowering: onnx.ReduceL2
"ReduceL2NormModule_basic",
Add complex support for aten.norm and similar operations (#3052) Add support for complex-type input tensors for norm, vector norm, and Frobenius norm operations.
2024-04-02 16:33:30 +08:00
"ReduceL2NormComplexModule_basic",
# Failure - onnx_lowering: onnx.ReduceL3
"ReduceL3NormKeepDimModule_basic",
"ReduceL3NormKeepDimComplexModule_basic",
[onnx] Fix ReduceMean lowering to torch (#2956) Torch lowering only supported the most recent version. Refactored the lowering so more easily handle default values and optional operands / attributes.
2024-02-28 14:48:07 +08:00
# Failure - onnx_lowering: onnx.ReduceProd
"BernoulliModule_basic",
"DropoutTrainModule_basic",
"DropoutTrainStaticShapeModule_basic",
"NativeDropoutTrainModule_basic",
"NativeDropoutTrainStaticShapeModule_basic",
"ReduceProdDimIntFloatModule_basic",
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
"StdCorrectionLargeInputModule_basic",
"VarCorrectionLargeInputModule_basic",
[onnx] Fix ReduceMean lowering to torch (#2956) Torch lowering only supported the most recent version. Refactored the lowering so more easily handle default values and optional operands / attributes.
2024-02-28 14:48:07 +08:00
# Failure - onnx_lowering: onnx.Resize
"UpSampleNearest2dDynamicSize_basic",
"UpSampleNearest2dStaticSize_basic",
# Failure - onnx_lowering: onnx.ScatterElements
"ScatterSrcModule_basic",
"ScatterSrcStaticModule_basic",
"ScatterValueFloatModule_basic",
"ScatterValueIntModule_basic",
# Failure - onnx_lowering: onnx.ScatterND
"IndexPut1DFloatAccumulateModule_basic",
"IndexPut1DFloatNonAccumulateModule_basic",
"IndexPut1DIntAccumulateModule_basic",
"IndexPut1DIntNonAccumulateModule_basic",
"IndexPut2DFloatAccumulateModule_basic",
"IndexPut2DFloatNonAccumulateModule_basic",
"IndexPut2DIntAccumulateModule_basic",
"IndexPut2DIntNonAccumulateModule_basic",
"IndexPut3DFloatAccumulateModule_basic",
"IndexPut3DFloatNonAccumulateModule_basic",
"IndexPut3DIntAccumulateModule_basic",
"IndexPut3DIntNonAccumulateModule_basic",
"IndexPutHackedTwin1DFloatAccumulateModule_basic",
"IndexPutHackedTwin1DFloatNonAccumulateModule_basic",
"IndexPutHackedTwin1DIntAccumulateModule_basic",
"IndexPutHackedTwin1DIntNonAccumulateModule_basic",
"IndexPutHackedTwin2DFloatAccumulateModule_basic",
"IndexPutHackedTwin2DFloatNonAccumulateModule_basic",
"IndexPutHackedTwin2DIntAccumulateModule_basic",
"IndexPutHackedTwin2DIntNonAccumulateModule_basic",
"IndexPutHackedTwin3DFloatAccumulateModule_basic",
"IndexPutHackedTwin3DFloatNonAccumulateModule_basic",
"IndexPutHackedTwin3DIntAccumulateModule_basic",
"IndexPutHackedTwin3DIntNonAccumulateModule_basic",
# Failure - onnx_lowering: onnx.SoftmaxCrossEntropyLoss
"CrossEntropyLossModule_basic",
"CrossEntropyLossNoReductionModule_basic",
# Failure - onnx_lowering: onnx.Squeeze
"SqueezeModule_allUnitDim",
"SqueezeModule_broadcast",
"SqueezeModule_static",
[onnx] Migrate `onnx.ReduceMax` to match `onnx.ReduceMin` (#2981) This mostly copy-pastes the reduce minimum implementation to reduce max to improve test coverage. We also improve the aten lowering for min/max dim for unsigned types.
2024-03-07 08:48:21 +08:00
# Failure - incorrect dtype
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
"ReduceMaxAlongDimUnsignedInt_basic",
[ONNX] Preliminary Work Towards Supporting QuantizedMLP_basic onnx e2e test (#3089) See the related issues here: [SHARK-Turbine#556](https://github.com/nod-ai/SHARK-Turbine/issues/556) 1. Adds uint8 casting to onnx.Cast op 2. Fixes an issue with onnx.DequantizeLinear when the scale comes with shape [1]. 3. Adds support for unsigned types in an AtenItemOp folder 4. Adds a simpler quantized model for easier debugging 5. Adds a fusion pass to convert [quant -> dequant -> transpose -> mm] patterns to [transpose -> quant -> mm]. 6. Moved some xfails that are still not passing, but for different reasons than onnx.cast failures.
2024-04-02 07:21:05 +08:00
"ElementwiseToDtypeI64ToUI8Module_basic",
[onnx] Fix ReduceMean lowering to torch (#2956) Torch lowering only supported the most recent version. Refactored the lowering so more easily handle default values and optional operands / attributes.
2024-02-28 14:48:07 +08:00
# Failure - torch.aten.view lower
[torch] Improve shape inference for dynamic shapes (#3091) Shapes can be processed as tensors to represent the set of dimensions. As reshapes take a list of scalars this can result in a single dynamic dimension blocking the adjacent static dimensions. This pass attempts to de-couple tensor computations related to shapes and propagate values to better support lowering scalar tensor computations.
2024-04-03 07:19:57 +08:00
"IndexTensorDyanmicInputContiguousWithNoneModule_basic",
"IndexTensorDyanmicInputNonContiguousWithNoneModule_basic",
"IndexTensorHackedTwinMultiInputNonContiguousMultipleStaticDims_basic",
"IndexTensorMultiInputContiguousCenter_basic",
"IndexTensorMultiInputNonContiguousMultipleStaticDims_basic",
"IndexTensorMultiInputNonContiguous_basic",
"IndexTensorMultiInputOneDim_basic",
"IndexTensorMultiInputThreeIndexers_basic",
"IndexTensorMultiInput_basic",
"IndexTensorMultiInputContiguousOneDimDynamic_basic",
"IndexTensorMultiInputNonContiguousOneDimDynamic_basic",
[onnx] Fix `onnx.sigmoid` for integer inputs/outputs (#2914) Sample compilation crashes due to sigmoid with integer inputs/outputs. This fix avoids crashing but still experiences an error.
2024-02-17 05:35:25 +08:00
[ONNX] Preliminary Work Towards Supporting QuantizedMLP_basic onnx e2e test (#3089) See the related issues here: [SHARK-Turbine#556](https://github.com/nod-ai/SHARK-Turbine/issues/556) 1. Adds uint8 casting to onnx.Cast op 2. Fixes an issue with onnx.DequantizeLinear when the scale comes with shape [1]. 3. Adds support for unsigned types in an AtenItemOp folder 4. Adds a simpler quantized model for easier debugging 5. Adds a fusion pass to convert [quant -> dequant -> transpose -> mm] patterns to [transpose -> quant -> mm]. 6. Moved some xfails that are still not passing, but for different reasons than onnx.cast failures.
2024-04-02 07:21:05 +08:00
# Failure - torch.aten.squeeze lower
"BucketizeTensorOutInt32RightModule_basic", # unsupported by backend contract: tensor with unknown rank
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
# Failure - unknown
[onnx] Fix ReduceMean lowering to torch (#2956) Torch lowering only supported the most recent version. Refactored the lowering so more easily handle default values and optional operands / attributes.
2024-02-28 14:48:07 +08:00
"BucketizeTensorFloatModule_basic",
"BucketizeTensorModule_basic",
"BucketizeTensorStaticFloatModule_basic",
"BucketizeTensorStaticModule_basic",
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
"Conv2dWithPaddingDilationStrideStaticModule_depthwise_multiplier",
"CopyWithDifferentDTypesAndSizesModule_basic",
"CopyWithDifferentDTypesModule_basic",
"CosineSimilarityStaticBroadcastModule_basic",
"CumsumInputDtypeInt32Module_basic",
[onnx] Fix ReduceMean lowering to torch (#2956) Torch lowering only supported the most recent version. Refactored the lowering so more easily handle default values and optional operands / attributes.
2024-02-28 14:48:07 +08:00
"ElementwiseAcosIntModule_basic",
"ElementwiseAsinIntModule_basic",
"ElementwiseAtanTensorIntModule_basic",
"ElementwiseCosIntModule_basic",
Added 2 Ops: Floor divide scalar and Floor divide scalar mode (#3156) - Added linalg lowering for `AtenFloorDivideScalarOp` - Needed `AtenDivScalarModeOp` for the decomp. - Added linalg lowering for `AtenDivScalarModeOp` - Moved linalg payload logic to `createDivModePayload()` since the logic was nearly identical for both `AtenDivScalarModeOp` and `AtenDivTensorModeOp`. Just a template function - Added `AtenDivScalarModeOp` lowering for stablehlo Pytorch's [`torch.floor_divide()`](https://pytorch.org/docs/stable/generated/torch.floor_divide.html) in a previous version (for a reason unknown to me) preformed a truncation instead of "floor". The already implemented op `AtenFloorDivideTensorOp` was done before this change. However, this wasn't caught because our testcases only tested positive floor division. I changed this to floor as well as adding a few test cases.
2024-04-16 04:45:10 +08:00
"ElementwiseDivTensorRoundingModeFloorIntStaticModule_basic",
"ElementwiseDivTensorRoundingModeTruncIntStaticModule_basic",
"ElementwiseDivTensorRoundingModeTruncModule_basic",
"ElementwiseDivTensorRoundingModeTruncStaticModule_basic",
"ElementwiseErfIntModule_basic",
[onnx] Fix ReduceMean lowering to torch (#2956) Torch lowering only supported the most recent version. Refactored the lowering so more easily handle default values and optional operands / attributes.
2024-02-28 14:48:07 +08:00
"ElementwiseErfIntModule_basic",
"ElementwiseExpIntModule_basic",
"ElementwiseLogIntModule_basic",
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
"ElementwisePreluModule_basic",
[Torch] Support prelu decomposition (#3069)
2024-03-29 08:05:00 +08:00
"ElementwisePreluStaticModule_basic",
[onnx] Fix ReduceMean lowering to torch (#2956) Torch lowering only supported the most recent version. Refactored the lowering so more easily handle default values and optional operands / attributes.
2024-02-28 14:48:07 +08:00
"ElementwiseSigmoidIntModule_basic",
"ElementwiseSinIntModule_basic",
"ElementwiseTanIntModule_basic",
"ElementwiseUnaryIntModule_basic",
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
"ElementwiseUnsqueezeNegDimsModule_basic",
[onnx] Fix ReduceMean lowering to torch (#2956) Torch lowering only supported the most recent version. Refactored the lowering so more easily handle default values and optional operands / attributes.
2024-02-28 14:48:07 +08:00
"EmbeddingModuleF16_basic",
"EmbeddingModuleI32_basic",
"EmbeddingModuleI64_basic",
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
"FlattenDynamicModule_basic",
"GluStaticModule_basic",
[onnx] Fix ReduceMean lowering to torch (#2956) Torch lowering only supported the most recent version. Refactored the lowering so more easily handle default values and optional operands / attributes.
2024-02-28 14:48:07 +08:00
"GroupNormModule_basic",
"IndexTensorHackedTwinModule3dInput_basic",
"IndexTensorHackedTwinModule_basic",
"IndexTensorModule3dInput_basic",
"IndexTensorModule_basic",
"IndexTensorSelectDimModule_basic",
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
"MaskedFillTensorFloatValueModule_basic",
"ReduceAllDimEmpty_basic",
"ReduceAllDimFloat_basic",
"ReduceAllDimInt_basic",
"ReduceMinAlongDimUnsignedInt_basic",
"TensorsStackNegativeDimModule_basic",
"TensorsStackPromoteDTypeModule_basic",
Implement lowering of torch.aten.linalg_cross (#2986) Closes [nod-ai/SHARK-Turbine#497](https://github.com/nod-ai/SHARK-Turbine/issues/497)
2024-03-14 03:17:22 +08:00
# Failure - "RuntimeError: linalg.cross: inputs dimension 1 must have length 3. Got 1 and 1"
Added 2 Ops: Floor divide scalar and Floor divide scalar mode (#3156) - Added linalg lowering for `AtenFloorDivideScalarOp` - Needed `AtenDivScalarModeOp` for the decomp. - Added linalg lowering for `AtenDivScalarModeOp` - Moved linalg payload logic to `createDivModePayload()` since the logic was nearly identical for both `AtenDivScalarModeOp` and `AtenDivTensorModeOp`. Just a template function - Added `AtenDivScalarModeOp` lowering for stablehlo Pytorch's [`torch.floor_divide()`](https://pytorch.org/docs/stable/generated/torch.floor_divide.html) in a previous version (for a reason unknown to me) preformed a truncation instead of "floor". The already implemented op `AtenFloorDivideTensorOp` was done before this change. However, this wasn't caught because our testcases only tested positive floor division. I changed this to floor as well as adding a few test cases.
2024-04-16 04:45:10 +08:00
"AtenLinalgCrossDynamic_basic",
# Failure - value not close to golden value (op is incorrectly truncating)
"ElementwiseAtenFloorDivideTensorNegativeModule_basic",
"ElementwiseAtenFloorDivideScalarNegativeModule_basic",
[onnx] Add testing using the `onnx` compilation using torch tests (#2795) We can route the torch tests via `onnx` using the `torch.onnx.export` tooling. We can then reimport, lower to torch, and compile to linalg to validate the onnx path is working correctly. The current implementation exposes some failures in the `onnx` path so we cannot enable the onnx test suite yet due to segmentation faults.
2024-02-16 02:17:13 +08:00
}
[onnx] Update the importer to create a `none` for missing operands (#2931) Some operands are optional so we require a placeholder for missing operands. We invent an `onnx.None` operation as our placeholder.
2024-02-21 01:30:30 +08:00
[MLIR][TORCH] Add OnnxToTorch lowering for ReduceL1 Op (#3146) Adds OnnxToTorch Lowering for the ReduceL1 op.
2024-04-16 14:54:46 +08:00
if torch_version_for_comparison() >= version.parse("2.4.0.dev"):
ONNX_XFAIL_SET = ONNX_XFAIL_SET | {
# ERROR: Found dtype (torch.float64) but expected (torch.float32)
"ReduceL1NormWithDTypeModule_basic",
}
[Torch Dialect] support aten.fake_quantize_per_tensor_affine (#3014)
2024-03-15 08:53:29 +08:00
ONNX_CRASHING_SET = {
"FakeQuantizePerTensorAffineModule_basic",
"FakeQuantizePerTensorAffineDynamicShapeModule_basic",
[MLIR][TORCH] Support parallel dimemsions expand/collapse (#3051) This PR support `aten.view` with unique unknown dimension both in input shape and output shape while the pass convert-torch-to-linalg that lowing `aten.view` to `tensor.collapse_shape` or `tensor.expand_shape`. Below is an example ``` func.func @test_reshape(%arg0: !torch.vtensor<[1,?,50,16],f32>) -> !torch.vtensor<[1,?,16],f32> attributes {torch.assume_strict_symbolic_shapes, torch.onnx_meta.ir_version = 9 : si64, torch.onnx_meta.opset_version = 19 : si64, torch.onnx_meta.producer_name = "backend-test", torch.onnx_meta.producer_version = ""} { %int1 = torch.constant.int 1 %int-1 = torch.constant.int -1 %int16 = torch.constant.int 16 %0 = torch.prim.ListConstruct %int1, %int-1, %int16 : (!torch.int, !torch.int, !torch.int) -> !torch.list<int> %1 = torch.aten.view %arg0, %0 : !torch.vtensor<[1,?,50,16],f32>, !torch.list<int> -> !torch.vtensor<[1,?,16],f32> return %1 : !torch.vtensor<[1,?,16],f32> } ```
2024-04-12 01:43:03 +08:00
"ViewDynamicExpandCollapseWithParallelUnknownDimModule_basic",
[Torch Dialect] support aten.fake_quantize_per_tensor_affine (#3014)
2024-03-15 08:53:29 +08:00
}