c7fa42b7d3
[Torch Dialect] Add canonicalizer for aten.to.other op ( #2273 )
...
Canonicalize aten.to.other to prim.device + prim.dtype + aten.to.device
Co-authored-by: wujiawei.aml <wujiawei.aml@bytedance.com>
2023-06-30 09:43:08 +08:00
449cfb8375
[Torch Dialect] add more scalar op folders ( #2265 )
2023-06-29 10:37:13 +08:00
859885c1d3
[Torch Dialect] Support aten.native_dropout ( #2259 )
...
* [Torch Dialect] Support aten.native_dropout
* update
2023-06-27 14:19:33 +08:00
1ea2b57ab7
[Torch Dialect] add folder for aten.add ( #2264 )
...
* [Torch Dialect] add folder for aten.add
* update
* update
* update
2023-06-27 10:55:28 +08:00
64afc08dab
[Torch Dialect] add missing one_hot dtype function ( #2143 )
...
* [Torch Dialect] add missing one_hot dtype function
* update
* update
* update
2023-06-23 16:11:33 +08:00
6f2bf31291
Fix single-element tuple construction in abstract interp library ( #2258 )
...
Single element tuples in Python need a comma after the
element. However, the `registry.py` file, which generates the expected
abstract interpretation function signatures, was not inserting the
comma. This commit changes the expected signature generator to add a
comma after the last element in any non-empty default tuple argument.
2023-06-22 11:27:40 -07:00
96b14e952e
[Torch Dialect] Support aten.device.with_index ( #2254 )
2023-06-23 01:07:14 +08:00
a0d2789840
[MLIR][TORCH] Add e2e support for aten.alias
...
-- This commit adds e2e support for aten.alias op.
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com>
2023-06-21 12:15:31 +05:30
7c6961bcbf
[Torch Dialect] Support aten.cuda and add canonicalizer for aten.cuda ( #2231 )
2023-06-14 09:56:39 +08:00
0caaf8d32a
Bump LLVM ( #2176 )
...
* Bump LLVM
---------
Co-authored-by: Matthias Gehre <matthias.gehre@xilinx.com>
2023-06-13 16:17:23 +02:00
4e2ba2e0af
Support aten.sign ( #2205 )
2023-06-10 20:45:35 +02:00
5a7bf4e4cb
[Torch Dialect] Add canonicalize pattern for aten.is_floating_point ( #2194 )
...
* [Torch Dialect] Add canonicalize pattern for aten.is_floating_point
* implement as fold
* add lit test
2023-06-07 17:05:31 +08:00
816880774b
Fix version comparison against stable ( #2209 )
2023-06-07 10:19:38 +02:00
e4f8fb1b8c
[Torch Dialect] add support for AtenIsnanOp ( #2170 )
...
* add support for mhlo
* Add Test for torch.ne
* fix torch.ne shape/add static test case
* add support for static torch.ne
---------
Co-authored-by: root <root@n31-177-039.byted.org>
2023-06-07 10:06:27 +08:00
da886280fe
[MLIR][TORCH] Add E2E support for aten.tril op ( #2202 )
...
Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2023-06-05 16:17:01 -07:00
8af3e50662
[Torch Dialect] Add support for AtenScalarTensorOp ( #2085 )
...
* add scalar_tensor op
* add dynamo pass test; needs PR2062
* try to fix
* Empty commit, trigger test
* Empty commit, trigger test
* address comments
* use dtype function
* fix decompose rule
* remove unused include
* Empty commit, trigger test
* fix test
* disable ltc
* fix dtype
---------
Co-authored-by: zhekun.zhang <zhekun.zhang@bytedance.com>
2023-06-01 11:38:50 +08:00
72b8070e57
[Importer] import constant tuple ( #2132 )
...
* [Importer] import constant tuple
* update
* update
* update
2023-05-31 14:14:14 +08:00
db3f2e3fde
Add Stable PyTorch CI Pipeline ( #2038 )
...
* feat: split pytorch requirements into stable and nightly
* fix: add true to tests to see full output
* refactor: add comments to explain true statement
* feat: move some tests to experimental mode
* refactor: refactor pipeline into more fine grained difference
* feat: add version differentiation for some tests
* feat: activate more configs
* refactor: change implementation to use less requirement files
* refactor: remove contraints used for testing
* fix: revert some requirement file names
* refactor: remove unnecessary ninja install
* fix: fix version parsing
* refactor: remove dependency on torchvision in main requirements file
* refactor: remove index url
* style: remove unnecesary line switch
* fix: readd index url
2023-05-30 12:16:24 -07:00
552887783a
[TM_TENSOR] Add `aten.scatter.[src|value]` op
...
This commit adds support of `aten.scatter.src` and `aten.scatter.value`
ops.
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
2023-05-29 12:35:53 +05:30
69e993b03f
[Torch Op] Add AtenChunkOp support ( #2152 )
...
* add chunkOp support
* update LTC xfail list
* address comments
* address comments
---------
Co-authored-by: zhekun.zhang <zhekun.zhang@bytedance.com>
2023-05-26 10:05:19 +08:00
a426363b7d
[Torch Dialect] Add split.tensor support + recompose rules ( #2102 )
...
* add split.tensor support + recompose rules
* add e2e test
* address comments
* address comments
* erase op in recomposeOp
---------
Co-authored-by: zhekun.zhang <zhekun.zhang@bytedance.com>
2023-05-23 12:43:33 -07:00
938a489e74
[TORCH-MLIR] Add ODS for aten.sign op.
...
This commit adds ODS for the aten.sign op.
Signed-Off-By: Prateek Gupta <prateek.gupta2@cerebras.net>
2023-05-23 11:06:42 +05:30
aa97c8383e
[Torch Op] Add unbind.int support with ListUnpack ( #2058 )
...
* add unbind int
* reformat
* use unpack canonicalize
* address comments
* Empty commit, trigger test
* add ltc blacklist
* clean up
* address comments
* check permute list
* erase in recompose
---------
Co-authored-by: zhekun.zhang <zhekun.zhang@bytedance.com>
2023-05-18 19:07:58 -07:00
5698893ae4
build: manually update PyTorch version
...
Set PyTorch and TorchVision version to nightly release 2023-05-16.
Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2023-05-18 21:30:11 +05:30
0302cf1d92
Add TMTensor::Attention and lower ScaledDotProductAttentionOp to it ( #2027 )
2023-05-16 15:17:45 -04:00
17db2aafa3
add mse_loss_backward ( #2111 )
2023-05-12 14:29:13 -07:00
de02b56e17
Replace RefineTypes with dtype functions ( #2105 )
...
This commit adds dtype functions for all the torch ops that did not
previously have one and removes the pass `RefineTypes`, since the
abstract interpretation library now takes care of all the dtype
propagation.
All dtype functions added are tested except for
- `aten.embedding`
- `aten._embedding_bag`
- `aten.embedding_bag`
These functions need a change to the testing framework to allow
specifying the actual data inside the tensor used for testing. I will
fix this in a follow up patch.
Co-authored-by: Jiahao Li <liplus17@163.com>
2023-05-12 13:40:45 -07:00
c3cd7471b4
Pure-Python FX importer. ( #2098 )
...
Co-authored-by: Sean Silva <silvasean@google.com>
2023-05-12 00:46:33 -05:00
8eb0c7e656
torch.complex to builtin complex types matching.
...
The right approach would be to create our own !torch.complex type
and use that during import than have a pass that converts to the MLIR
complex types.
2023-05-11 21:29:07 +05:30
ab694dfbc1
Add complex dtype support on refbackend
2023-05-11 21:29:07 +05:30
3cd91affbc
Add complex types support with basic complex ops.
...
Add complex types support with basic complex types.
Add aten.imag and aten.real op lowering via linalg_backend.
2023-05-11 21:29:07 +05:30
40a2c501a1
Add ODS for group_norm
...
- Add ODS for native_group_norm/backward.
- Add shape-inference for native_group_norm/backward .
Signed-off-by: rahul shrivastava <rahul.shrivastava@cerebras.net>
2023-05-11 21:21:12 +05:30
378860f51b
[MLIR][TORCH] Add E2E support for aten.topk op
...
This commit adds the decomposition for the aten.topk op.
Signed-Off By: Vivek Khandelwal<vivek@nod-labs.com>
2023-05-05 15:50:33 +05:30
0cf9ee340b
[Torch Dialect] Add to.dtype_layout canonicalize patterns ( #2062 )
...
* add to.dtype_layout canonicalize patterns
* update comment
---------
Co-authored-by: zhekun.zhang <zhekun.zhang@bytedance.com>
2023-05-02 20:06:02 -07:00
c596d11b98
[Torch Dailect] add canonicalize pattern for prim.device ( #2066 )
2023-05-02 20:05:46 -07:00
c9fba95642
[Dynamo] turn on `no_python=True` for dynamo tests ( #2040 )
2023-04-28 18:05:17 -05:00
7b73e0cfaf
Add e2e linalg support for aten.atan ( #2070 )
...
* new atan op
* update shape
---------
Co-authored-by: Ze Zhang <ze.zhang@getcruise.com>
2023-04-28 00:04:58 -07:00
a58442b50d
Add ODS for aten.pow.Scalar
...
Signed-off-by: rahul shrivastava <rahul.shrivastava@cerebras.net>
2023-04-27 22:09:45 +05:30
491ae5eda4
[MLIR][TORCH] Add E2E support for aten.var_mean.dim op
...
This commit adds the decomposition for the aten.var_mean.dim op.
Signed-Off By: Vivek Khandelwal<vivek@nod-labs.com>
2023-04-27 22:00:44 +05:30
e3d876af42
Add aten.scatter.value Op ODS
...
Signed-off-by: rahul shrivastava <rahul.shrivastava@cerebras.net>
2023-04-25 11:40:19 +05:30
b0f166bb9a
Add Nll_loss2d
...
- Add both forward and backward op
- Add end-to-end xfailed testcases
Signed-off-by: rahul shrivastava <rahul.shrivastava@cerebras.net>
2023-04-24 23:47:26 +05:30
85916dab33
Add ODS for aten.scatter.src
...
Signed-off-by: rahul shrivastava <rahul.shrivastava@cerebras.net>
2023-04-24 23:46:35 +05:30
96d662647f
Fix import of constant bool tensor parameters ( #2047 )
...
Bool tensors are represented in TorchScript as an array of
`int8_t`s. However, when importing them into Torch-MLIR, the importer
was assuming the array had `int32_t` elements, leading to the importer
reading into memory that was out of bounds. This commit fixes the
casting of the bool tensor.
2023-04-20 18:38:48 -07:00
4d98f76d4f
[Torch Dialect] fold aten.detach ( #2021 )
2023-04-18 08:59:14 -07:00
ed56e614b7
[MLIR][TORCH] Add E2E support for cross entropy lowering
...
Signed-Off By: Vivek Khandelwal<vivek@nod-labs.com>
2023-04-18 08:00:20 +05:30
a13d301356
[MLIR][TORCH] Add e2e support for aten.sort op
...
-- This commit adds e2e support for atend.sort op.
-- 1. Adds aten.sort op in torch dialect.
-- 2. Adds tm_tensor.sort op in TMTensor dialect.
-- 3. Adds lowering of aten.sort -> tm_tensor.sort.
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com>
2023-04-13 12:59:43 +05:30
c2c96c430a
Add Shape inference for CopyOp for lazy tensor core backend ( #2006 )
...
- Add Shape inference for CopyOp for LTC backend
2023-04-12 09:37:03 -04:00
72c3326097
[Torch Dialect] support for aten.one_hot ( #1852 )
2023-04-11 01:02:28 -07:00
98747d09a8
[MLIR][TORCH] Add support for prims::view_of op
...
This op does nothing and just returns the input operand as the
result of the op.
Signed-Off By: Vivek Khandelwal <vivek@nod-labs.com>
2023-04-11 07:58:10 +05:30
5337944ddb
[MLIR][TORCH] Add e2e support for aten.randint
...
-- This commit adds e2e support for aten.randint by decomposing it into
an aten.randint.low by setting low=0.
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com>
2023-04-07 00:13:56 +05:30
Jiawei Wu
Yuanqiang Liu
Ramiro Leal-Cavazos
Abhishek Varma
Maksim Levental
Matthias Gehre
JianzheXiao
Vivek Khandelwal
Zhekun Zhang
maxbartel
Gaurav Shukla
Prateek Gupta
gpetters94
David Gens
Prashant Kumar
rahul shrivastava
Ze Zhang
Abhishek Varma
rahuls-cerebras