31ef08b63d
[Stablehlo]Add support for AvgPool1dOp ( #2268 )
...
* Add support for AvgPool1d
* Update AbstractInterpLibrary
* support avgpool1d in linalg
* refactored code
* fix nit problem
2023-07-25 14:09:53 +08:00
d57f67e7f8
[Torch Dialect] emit aten.nonzero, aten.nonzero_numpy, aten.nonzero_static op ( #2338 )
...
By the way, this PR also adds the missing shape function for aten.masked_select.
2023-07-25 09:01:19 +08:00
9535be7903
[Torch-Dialect] emit aten.narrow.Tensor op and decompose it to aten.narrow op ( #2297 )
2023-07-20 16:46:44 +08:00
3f843c8fd9
[torch-dialect] fix aten.type_as op's folder ( #2283 )
...
[torch-dialect] fix torch.type_as op's folder by decomposing it to prim.dtype + aten.to_dtype
2023-07-20 09:51:58 +08:00
5706697e0b
[TOSA] Add aten._index_put_impl support ( #2031 )
...
Add e2e support by add "tosa-to-scf"
2023-07-17 09:51:24 -07:00
c7fa42b7d3
[Torch Dialect] Add canonicalizer for aten.to.other op ( #2273 )
...
Canonicalize aten.to.other to prim.device + prim.dtype + aten.to.device
Co-authored-by: wujiawei.aml <wujiawei.aml@bytedance.com>
2023-06-30 09:43:08 +08:00
449cfb8375
[Torch Dialect] add more scalar op folders ( #2265 )
2023-06-29 10:37:13 +08:00
1ea2b57ab7
[Torch Dialect] add folder for aten.add ( #2264 )
...
* [Torch Dialect] add folder for aten.add
* update
* update
* update
2023-06-27 10:55:28 +08:00
0548e2ef3b
[Stablehlo] fix promoteType() when input doesn't have DefiningOp ( #2262 )
2023-06-26 00:04:17 +08:00
96b14e952e
[Torch Dialect] Support aten.device.with_index ( #2254 )
2023-06-23 01:07:14 +08:00
a0d2789840
[MLIR][TORCH] Add e2e support for aten.alias
...
-- This commit adds e2e support for aten.alias op.
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com>
2023-06-21 12:15:31 +05:30
0244f540a7
Add typeids to CAPI. ( #2253 )
2023-06-20 22:06:43 -05:00
6f420019cb
TorchToTosa: Cast float constants to correct type to support bfloat16 ( #2239 )
2023-06-16 09:51:24 +02:00
7c6961bcbf
[Torch Dialect] Support aten.cuda and add canonicalizer for aten.cuda ( #2231 )
2023-06-14 09:56:39 +08:00
0caaf8d32a
Bump LLVM ( #2176 )
...
* Bump LLVM
---------
Co-authored-by: Matthias Gehre <matthias.gehre@xilinx.com>
2023-06-13 16:17:23 +02:00
27a3d09917
Torch: Fold RuntimeAssertOp when condition is true ( #2198 )
2023-06-09 19:06:25 +08:00
5a7bf4e4cb
[Torch Dialect] Add canonicalize pattern for aten.is_floating_point ( #2194 )
...
* [Torch Dialect] Add canonicalize pattern for aten.is_floating_point
* implement as fold
* add lit test
2023-06-07 17:05:31 +08:00
e4f8fb1b8c
[Torch Dialect] add support for AtenIsnanOp ( #2170 )
...
* add support for mhlo
* Add Test for torch.ne
* fix torch.ne shape/add static test case
* add support for static torch.ne
---------
Co-authored-by: root <root@n31-177-039.byted.org>
2023-06-07 10:06:27 +08:00
da886280fe
[MLIR][TORCH] Add E2E support for aten.tril op ( #2202 )
...
Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2023-06-05 16:17:01 -07:00
8af3e50662
[Torch Dialect] Add support for AtenScalarTensorOp ( #2085 )
...
* add scalar_tensor op
* add dynamo pass test; needs PR2062
* try to fix
* Empty commit, trigger test
* Empty commit, trigger test
* address comments
* use dtype function
* fix decompose rule
* remove unused include
* Empty commit, trigger test
* fix test
* disable ltc
* fix dtype
---------
Co-authored-by: zhekun.zhang <zhekun.zhang@bytedance.com>
2023-06-01 11:38:50 +08:00
479b2175ef
Add `ReadOnly` trait to `copy.to_vtensor` ( #2179 )
...
Before inlining a global slot, the users of the global slot are
checked to see if they are `ReadOnly` or `MemoryEffectFree` to make
sure that the global slot is not being mutated. Because the op
`copy.to_vtensor` currently does not have the `ReadOnly` trait, if a
global slot is passed to `copy.to_vtensor`, the pass
`InlineGlobalSlots` will fail.
The op `copy.to_vtensor` is `ReadOnly`, since it does not modify the
contents of the input tensor; it simply makes a new copy. This commit
adds the trait as well as an e2e test that generates the case of a
global slot being passed to a `copy.to_vtensor`.
2023-05-30 21:40:36 +00:00
552887783a
[TM_TENSOR] Add `aten.scatter.[src|value]` op
...
This commit adds support of `aten.scatter.src` and `aten.scatter.value`
ops.
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
2023-05-29 12:35:53 +05:30
69e993b03f
[Torch Op] Add AtenChunkOp support ( #2152 )
...
* add chunkOp support
* update LTC xfail list
* address comments
* address comments
---------
Co-authored-by: zhekun.zhang <zhekun.zhang@bytedance.com>
2023-05-26 10:05:19 +08:00
a426363b7d
[Torch Dialect] Add split.tensor support + recompose rules ( #2102 )
...
* add split.tensor support + recompose rules
* add e2e test
* address comments
* address comments
* erase op in recomposeOp
---------
Co-authored-by: zhekun.zhang <zhekun.zhang@bytedance.com>
2023-05-23 12:43:33 -07:00
938a489e74
[TORCH-MLIR] Add ODS for aten.sign op.
...
This commit adds ODS for the aten.sign op.
Signed-Off-By: Prateek Gupta <prateek.gupta2@cerebras.net>
2023-05-23 11:06:42 +05:30
5b63138d55
[Torch Dialect] Enforce signless attribute for ConstantIntOp ( #2078 )
...
* fix torch_c.to_i64
* restore dialect.cpp
* Empty commit, trigger test
* Empty commit, trigger test
* fix uint case
* address comments
* update error msg
* clean up
* use i64 for ConstantIntOp
* use I64Attr
---------
Co-authored-by: zhekun.zhang <zhekun.zhang@bytedance.com>
2023-05-22 19:21:34 -05:00
aa97c8383e
[Torch Op] Add unbind.int support with ListUnpack ( #2058 )
...
* add unbind int
* reformat
* use unpack canonicalize
* address comments
* Empty commit, trigger test
* add ltc blacklist
* clean up
* address comments
* check permute list
* erase in recompose
---------
Co-authored-by: zhekun.zhang <zhekun.zhang@bytedance.com>
2023-05-18 19:07:58 -07:00
ed4ecb072f
[tosa] support lowering basic torch binary ops with mixed dtypes ( #2122 )
...
Lowering torch operations that allow different compatible data types
in its operands to tosa end up generating invalid tosa IR with mixed
data types. In tosa spec, certain operations (generally element-wise
operations) require all operands to have the same data type.
Add wrapper functions for those element-wise tosa ops to perform op
creation with type conversion if necessary.
2023-05-18 17:12:18 -07:00
0302cf1d92
Add TMTensor::Attention and lower ScaledDotProductAttentionOp to it ( #2027 )
2023-05-16 15:17:45 -04:00
c76a48308e
[CAPI] add isValidSubtype to CAPI ( #2127 )
2023-05-13 22:15:45 -05:00
17db2aafa3
add mse_loss_backward ( #2111 )
2023-05-12 14:29:13 -07:00
de02b56e17
Replace RefineTypes with dtype functions ( #2105 )
...
This commit adds dtype functions for all the torch ops that did not
previously have one and removes the pass `RefineTypes`, since the
abstract interpretation library now takes care of all the dtype
propagation.
All dtype functions added are tested except for
- `aten.embedding`
- `aten._embedding_bag`
- `aten.embedding_bag`
These functions need a change to the testing framework to allow
specifying the actual data inside the tensor used for testing. I will
fix this in a follow up patch.
Co-authored-by: Jiahao Li <liplus17@163.com>
2023-05-12 13:40:45 -07:00
3cd91affbc
Add complex types support with basic complex ops.
...
Add complex types support with basic complex types.
Add aten.imag and aten.real op lowering via linalg_backend.
2023-05-11 21:29:07 +05:30
40a2c501a1
Add ODS for group_norm
...
- Add ODS for native_group_norm/backward.
- Add shape-inference for native_group_norm/backward .
Signed-off-by: rahul shrivastava <rahul.shrivastava@cerebras.net>
2023-05-11 21:21:12 +05:30
d7614c261d
Integrate LLVM
...
LLVM: 26ee8947702d79ce2cab8e577f713685a5ca4a55
MHLO: 4805d8498dfb81566076f56f52273b426c1cc5bf
Per: https://github.com/llvm/torch-mlir/issues/1178#issuecomment-1538492185
2023-05-09 10:14:27 -07:00
0cf9ee340b
[Torch Dialect] Add to.dtype_layout canonicalize patterns ( #2062 )
...
* add to.dtype_layout canonicalize patterns
* update comment
---------
Co-authored-by: zhekun.zhang <zhekun.zhang@bytedance.com>
2023-05-02 20:06:02 -07:00
c596d11b98
[Torch Dailect] add canonicalize pattern for prim.device ( #2066 )
2023-05-02 20:05:46 -07:00
7b73e0cfaf
Add e2e linalg support for aten.atan ( #2070 )
...
* new atan op
* update shape
---------
Co-authored-by: Ze Zhang <ze.zhang@getcruise.com>
2023-04-28 00:04:58 -07:00
a58442b50d
Add ODS for aten.pow.Scalar
...
Signed-off-by: rahul shrivastava <rahul.shrivastava@cerebras.net>
2023-04-27 22:09:45 +05:30
491ae5eda4
[MLIR][TORCH] Add E2E support for aten.var_mean.dim op
...
This commit adds the decomposition for the aten.var_mean.dim op.
Signed-Off By: Vivek Khandelwal<vivek@nod-labs.com>
2023-04-27 22:00:44 +05:30
e3d876af42
Add aten.scatter.value Op ODS
...
Signed-off-by: rahul shrivastava <rahul.shrivastava@cerebras.net>
2023-04-25 11:40:19 +05:30
b0f166bb9a
Add Nll_loss2d
...
- Add both forward and backward op
- Add end-to-end xfailed testcases
Signed-off-by: rahul shrivastava <rahul.shrivastava@cerebras.net>
2023-04-24 23:47:26 +05:30
85916dab33
Add ODS for aten.scatter.src
...
Signed-off-by: rahul shrivastava <rahul.shrivastava@cerebras.net>
2023-04-24 23:46:35 +05:30
4d98f76d4f
[Torch Dialect] fold aten.detach ( #2021 )
2023-04-18 08:59:14 -07:00
ed56e614b7
[MLIR][TORCH] Add E2E support for cross entropy lowering
...
Signed-Off By: Vivek Khandelwal<vivek@nod-labs.com>
2023-04-18 08:00:20 +05:30
a13d301356
[MLIR][TORCH] Add e2e support for aten.sort op
...
-- This commit adds e2e support for atend.sort op.
-- 1. Adds aten.sort op in torch dialect.
-- 2. Adds tm_tensor.sort op in TMTensor dialect.
-- 3. Adds lowering of aten.sort -> tm_tensor.sort.
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com>
2023-04-13 12:59:43 +05:30
72c3326097
[Torch Dialect] support for aten.one_hot ( #1852 )
2023-04-11 01:02:28 -07:00
98747d09a8
[MLIR][TORCH] Add support for prims::view_of op
...
This op does nothing and just returns the input operand as the
result of the op.
Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2023-04-11 07:58:10 +05:30
5337944ddb
[MLIR][TORCH] Add e2e support for aten.randint
...
-- This commit adds e2e support for aten.randint by decomposing it into
an aten.randint.low by setting low=0.
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com>
2023-04-07 00:13:56 +05:30
e90ea3d7ab
[MLIR][TORCH] Extend implementation of aten._index_put_impl op.
...
This commits adds the support for cases for index_put_op:
1.) where index is a 2-d tensor.
2.) where indices is a list of tensors and none, with exactly
2 non none tensors along the consecutive dimensions.
This commit also adds a utility to compute the broadcast shape
given the two input tensors.
Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2023-04-05 14:04:30 +05:30
JianzheXiao
Jiawei Wu
Chi_Liu
Jiawei Wu
Yuanqiang Liu
Abhishek Varma
Maksim Levental
Matthias Gehre
JianzheXiao
Vivek Khandelwal
Zhekun Zhang
Ramiro Leal-Cavazos
Gaurav Shukla
Prateek Gupta
TatWai Chong
gpetters94
David Gens
Prashant Kumar
rahul shrivastava
Sean Silva
Ze Zhang
Abhishek Varma