torch-mlir/include/npcomp/Dialect/Torch/IR/GeneratedAtenOps.td

393 lines
12 KiB
TableGen
Raw Normal View History

Significantly restructure torch/aten import design. This is a really major and invasive restructuring of the way we get torch operators (`torch::jit::Operator` / `c10::OperatorHandle`) into MLIR. Please forgive the challenging review, but due to the sheer invasiveness, it wasn't really practical do do it in sane smaller pieces. This fully replaces everything that was already working on the TorchScript path (actually, more -- we added tanh support to TorchToLinalg in order to delete the older code paths). Additionally, I've kept the lights on for the acap path too, including what little e2e stuff was working before (for expediency I made a few tiny compromises along the way that will be easy to undo when we give that path proper attention). Overview of the new design: - The torch operator `somens::someunqualname.someoverloadname` is imported as `torch.somens.someunqualname.someoverloadname` (skip the last dotted part if the overload name is empty), OR, if we don't have such an op registered, it is imported as `torch.operator "somens.someunqualname.someoverloadname" (...) : ...`. - The addition of the "overload name" is a critical element here, as the `(ns,unqual,overload)` triple is unique, which solves a lot of problems we were having. - This involves having separate MLIR ops for the `trailing_` and `.out` variants and all the different overloads. This seemed necessary, because the set of overloads is so wild and varied and unstructured. The previous design was leaning into some underlying structure that just isn't there -- the default situation is the "random overload that we want to manage on the MLIR side", rather than that being an exception. E.g. `aten::ne` (not-equal) has 21 overloads, only 4 of which are c10 dispatcher ops see [gist](https://gist.github.com/silvasean/190ba918c550c956260e21254e1b8aa1), and the "out" variant is really called `.Tensor_out` instead of `.out` as it frequently is for other ops. - Rationale for all being in `torch` namespace: the set of operators are so varied and unstructured that "dialect per namespace" doesn't result in anything resembling the typical MLIR dialect boundary expectations. We could maybe draw the boundary at dispatcher ops vs non-dispatcher ops, but that doesn't seem to really result in very much useful structure at this point in time. - Note: within the torch operator registry, we effectively have a mini-basicpy subdialect (already type-resolved), which is reasonably structured. - The existing Torch op interfaces are also removed -- now that we track the overload name, we can losslessly find the original operator. - Instead of `ATenRecognizeKernelsPass`, we now have a `ReduceOpVariantsPass` that keys off certain traits (and perhaps eventually interfaces) to reduce variants of ops to a smaller set, ideally operating on immutable tensors and using surrounding ops to model the mutability/aliasing aspects. - Note: `torch.ns.unqual.overload` ops allow both immutable and mutable tensors (unlike the previous hard distinction in the common case). This is a premonition for a future change that will introduce a bona fide `!torch.tensor` type that will clean up a bunch of stuff. - `TorchToLinalg` / `TorchToStd` supercede the existing "ATen->TCF->TCP->Linalg" path. - The new `torch_ods_gen.py` supercedes `torch_signature_ods_gen.py`. It should look somewhat familiar, but the benefit of hindsight has allowed a lot of simplifications. The overall trend seems to be to make the `torch` dialect a nice layer independent of anything else. It feels like as a natural result of various future changes we will be removing the reliance on basicpy+numpy dialects and have a nice self-contained type system too that properly models the TorchScript type system (including proper subtyping, mutable/immutable tensors, optional dtype, etc.). Recommended review order: - Start at some of the new import IR, e.g. in `frontends/pytorch/test/node_import/prim.py`, `frontends/pytorch/test/acap_export/test_export_add3.py`, and other tests. - `frontends/pytorch/python/torch_mlir_utils/codegen/torch_ods_gen.py` and associated generated files: - `include/npcomp/Dialect/Torch/IR/GeneratedAtenOps.td` - `include/npcomp/Dialect/Torch/IR/GeneratedPrimOps.td` - Inspect `ReduceOpVariants.cpp` / `reduce-op-variants.mlir` and the new traits in `include/npcomp/Dialect/Torch/IR/TorchTraits.h` - Various code changes in the import path in `frontends/pytorch/csrc/builder`. Probably most interesting is the new code in `torch_to_mlir_utils.cpp` that has the logic to create the `torch.operator` ops or `torch.ns.unqual.overload` ops. This is the [new ResNet IR](https://gist.github.com/silvasean/5407aafb710d07612b7b5b92eabecebe), just to be able to look at a substantial sample of IR in the new style.
2021-05-05 05:42:50 +08:00
//===-------------------------------------------------------*- tablegen -*-===//
//
// This file is licensed under the Apache License v2.0 with LLVM Exceptions.
// See https://llvm.org/LICENSE.txt for license information.
// SPDX-License-Identifier: Apache-2.0 WITH LLVM-exception
//
// Operation summaries and descriptions were systematically derived from public
// API docstrings and are licensed accordingly:
// https://github.com/pytorch/pytorch/blob/master/LICENSE
//===----------------------------------------------------------------------===//
//
// This file is automatically generated. Please do not edit.
// Generated via:
// python -m torch_mlir_utils.codegen.torch_ods_gen
//
//===----------------------------------------------------------------------===//
def Torch_AtenTanhOp : Torch_Op<"aten.tanh", [
AllowsTypeRefinement,
HasValueSemantics
]> {
let summary = "Generated op for `aten::tanh : (Tensor) -> (Tensor)`";
let arguments = (ins
AnyTorchTensorType:$self
);
let results = (outs
AnyTorchTensorType:$result
);
let assemblyFormat = "$self attr-dict `:` type($self) `->` type($result)";
}
def Torch_AtenTanh_Op : Torch_Op<"aten.tanh_", [
IsTrailingUnderscoreInplaceVariant,
AllowsTypeRefinement
]> {
let summary = "Generated op for `aten::tanh_ : (Tensor) -> (Tensor)`";
let arguments = (ins
AnyTorchTensorType:$self
);
let results = (outs
AnyTorchTensorType:$result
);
let assemblyFormat = "$self attr-dict `:` type($self) `->` type($result)";
}
def Torch_AtenReluOp : Torch_Op<"aten.relu", [
AllowsTypeRefinement,
HasValueSemantics
]> {
let summary = "Generated op for `aten::relu : (Tensor) -> (Tensor)`";
let arguments = (ins
AnyTorchTensorType:$self
);
let results = (outs
AnyTorchTensorType:$result
);
let assemblyFormat = "$self attr-dict `:` type($self) `->` type($result)";
}
def Torch_AtenRelu_Op : Torch_Op<"aten.relu_", [
IsTrailingUnderscoreInplaceVariant,
AllowsTypeRefinement
]> {
let summary = "Generated op for `aten::relu_ : (Tensor) -> (Tensor)`";
let arguments = (ins
AnyTorchTensorType:$self
);
let results = (outs
AnyTorchTensorType:$result
);
let assemblyFormat = "$self attr-dict `:` type($self) `->` type($result)";
}
def Torch_AtenAddTensorOp : Torch_Op<"aten.add.Tensor", [
AllowsTypeRefinement,
HasValueSemantics
]> {
let summary = "Generated op for `aten::add.Tensor : (Tensor, Tensor, Scalar) -> (Tensor)`";
let arguments = (ins
AnyTorchTensorType:$self,
AnyTorchTensorType:$other,
AnyTorchScalarType:$alpha
);
let results = (outs
AnyTorchTensorType:$result
);
let assemblyFormat = "$self `,` $other `,` $alpha attr-dict `:` type($self) `,` type($other) `,` type($alpha) `->` type($result)";
}
def Torch_AtenAdd_TensorOp : Torch_Op<"aten.add_.Tensor", [
IsTrailingUnderscoreInplaceVariant,
AllowsTypeRefinement
]> {
let summary = "Generated op for `aten::add_.Tensor : (Tensor, Tensor, Scalar) -> (Tensor)`";
let arguments = (ins
AnyTorchTensorType:$self,
AnyTorchTensorType:$other,
AnyTorchScalarType:$alpha
);
let results = (outs
AnyTorchTensorType:$result
);
let assemblyFormat = "$self `,` $other `,` $alpha attr-dict `:` type($self) `,` type($other) `,` type($alpha) `->` type($result)";
}
def Torch_AtenLinearOp : Torch_Op<"aten.linear", [
AllowsTypeRefinement,
HasValueSemantics
]> {
let summary = "Generated op for `aten::linear : (Tensor, Tensor, Tensor?) -> (Tensor)`";
let arguments = (ins
AnyTorchTensorType:$input,
AnyTorchTensorType:$weight,
AnyTorchOptionalTensor:$bias
);
let results = (outs
AnyTorchTensorType:$result
);
let assemblyFormat = "$input `,` $weight `,` $bias attr-dict `:` type($input) `,` type($weight) `,` type($bias) `->` type($result)";
}
def Torch_AtenMmOp : Torch_Op<"aten.mm", [
AllowsTypeRefinement,
HasValueSemantics
]> {
let summary = "Generated op for `aten::mm : (Tensor, Tensor) -> (Tensor)`";
let arguments = (ins
AnyTorchTensorType:$self,
AnyTorchTensorType:$mat2
);
let results = (outs
AnyTorchTensorType:$result
);
let assemblyFormat = "$self `,` $mat2 attr-dict `:` type($self) `,` type($mat2) `->` type($result)";
}
def Torch_AtenConv2dOp : Torch_Op<"aten.conv2d", [
AllowsTypeRefinement,
HasValueSemantics
]> {
let summary = "Generated op for `aten::conv2d : (Tensor, Tensor, Tensor?, int[], int[], int[], int) -> (Tensor)`";
let arguments = (ins
AnyTorchTensorType:$input,
AnyTorchTensorType:$weight,
AnyTorchOptionalTensor:$bias,
AnyTorchIntListType:$stride,
AnyTorchIntListType:$padding,
AnyTorchIntListType:$dilation,
AnyTorchIntType:$groups
);
let results = (outs
AnyTorchTensorType:$result
);
let assemblyFormat = "$input `,` $weight `,` $bias `,` $stride `,` $padding `,` $dilation `,` $groups attr-dict `:` type($input) `,` type($weight) `,` type($bias) `,` type($stride) `,` type($padding) `,` type($dilation) `,` type($groups) `->` type($result)";
}
def Torch_AtenBatchNormOp : Torch_Op<"aten.batch_norm", [
AllowsTypeRefinement,
HasValueSemantics
]> {
let summary = "Generated op for `aten::batch_norm : (Tensor, Tensor?, Tensor?, Tensor?, Tensor?, bool, float, float, bool) -> (Tensor)`";
let arguments = (ins
AnyTorchTensorType:$input,
AnyTorchOptionalTensor:$weight,
AnyTorchOptionalTensor:$bias,
AnyTorchOptionalTensor:$running_mean,
AnyTorchOptionalTensor:$running_var,
AnyTorchBoolType:$training,
AnyFloat:$momentum,
AnyFloat:$eps,
AnyTorchBoolType:$cudnn_enabled
);
let results = (outs
AnyTorchTensorType:$result
);
let assemblyFormat = "$input `,` $weight `,` $bias `,` $running_mean `,` $running_var `,` $training `,` $momentum `,` $eps `,` $cudnn_enabled attr-dict `:` type($input) `,` type($weight) `,` type($bias) `,` type($running_mean) `,` type($running_var) `,` type($training) `,` type($momentum) `,` type($eps) `,` type($cudnn_enabled) `->` type($result)";
}
def Torch_AtenMaxPool2dOp : Torch_Op<"aten.max_pool2d", [
AllowsTypeRefinement,
HasValueSemantics
]> {
let summary = "Generated op for `aten::max_pool2d : (Tensor, int[], int[], int[], int[], bool) -> (Tensor)`";
let arguments = (ins
AnyTorchTensorType:$self,
AnyTorchIntListType:$kernel_size,
AnyTorchIntListType:$stride,
AnyTorchIntListType:$padding,
AnyTorchIntListType:$dilation,
AnyTorchBoolType:$ceil_mode
);
let results = (outs
AnyTorchTensorType:$result
);
let assemblyFormat = "$self `,` $kernel_size `,` $stride `,` $padding `,` $dilation `,` $ceil_mode attr-dict `:` type($self) `,` type($kernel_size) `,` type($stride) `,` type($padding) `,` type($dilation) `,` type($ceil_mode) `->` type($result)";
}
def Torch_AtenAdaptiveAvgPool2dOp : Torch_Op<"aten.adaptive_avg_pool2d", [
AllowsTypeRefinement,
HasValueSemantics
]> {
let summary = "Generated op for `aten::adaptive_avg_pool2d : (Tensor, int[]) -> (Tensor)`";
let arguments = (ins
AnyTorchTensorType:$self,
AnyTorchIntListType:$output_size
);
let results = (outs
AnyTorchTensorType:$result
);
let assemblyFormat = "$self `,` $output_size attr-dict `:` type($self) `,` type($output_size) `->` type($result)";
}
def Torch_AtenFlattenUsingIntsOp : Torch_Op<"aten.flatten.using_ints", [
AllowsTypeRefinement
]> {
let summary = "Generated op for `aten::flatten.using_ints : (Tensor, int, int) -> (Tensor)`";
let arguments = (ins
AnyTorchTensorType:$self,
AnyTorchIntType:$start_dim,
AnyTorchIntType:$end_dim
);
let results = (outs
AnyTorchTensorType:$result
);
let assemblyFormat = "$self `,` $start_dim `,` $end_dim attr-dict `:` type($self) `,` type($start_dim) `,` type($end_dim) `->` type($result)";
}
def Torch_AtenDimOp : Torch_Op<"aten.dim", [
AllowsTypeRefinement,
HasValueSemantics
]> {
let summary = "Generated op for `aten::dim : (Tensor) -> (int)`";
let arguments = (ins
AnyTorchTensorType:$self
);
let results = (outs
AnyTorchIntType:$result
);
let assemblyFormat = "$self attr-dict `:` type($self) `->` type($result)";
}
def Torch_AtenSizeOp : Torch_Op<"aten.size", [
AllowsTypeRefinement,
HasValueSemantics
]> {
let summary = "Generated op for `aten::size : (Tensor) -> (int[])`";
let arguments = (ins
AnyTorchTensorType:$self
);
let results = (outs
AnyTorchIntListType:$result
);
let assemblyFormat = "$self attr-dict `:` type($self) `->` type($result)";
let hasCanonicalizer = 1;
}
def Torch_AtenGtIntOp : Torch_Op<"aten.gt.int", [
AllowsTypeRefinement,
HasValueSemantics
]> {
let summary = "Generated op for `aten::gt.int : (int, int) -> (bool)`";
let arguments = (ins
AnyTorchIntType:$a,
AnyTorchIntType:$b
);
let results = (outs
AnyTorchBoolType:$result
);
let assemblyFormat = "$a `,` $b attr-dict `:` type($a) `,` type($b) `->` type($result)";
}
def Torch_AtenNeIntOp : Torch_Op<"aten.ne.int", [
AllowsTypeRefinement,
HasValueSemantics
]> {
let summary = "Generated op for `aten::ne.int : (int, int) -> (bool)`";
let arguments = (ins
AnyTorchIntType:$a,
AnyTorchIntType:$b
);
let results = (outs
AnyTorchBoolType:$result
);
let assemblyFormat = "$a `,` $b attr-dict `:` type($a) `,` type($b) `->` type($result)";
}
def Torch_AtenAddIntOp : Torch_Op<"aten.add.int", [
AllowsTypeRefinement,
HasValueSemantics
]> {
let summary = "Generated op for `aten::add.int : (int, int) -> (int)`";
let arguments = (ins
AnyTorchIntType:$a,
AnyTorchIntType:$b
);
let results = (outs
AnyTorchIntType:$result
);
let assemblyFormat = "$a `,` $b attr-dict `:` type($a) `,` type($b) `->` type($result)";
}
def Torch_AtenMulIntOp : Torch_Op<"aten.mul.int", [
AllowsTypeRefinement,
HasValueSemantics
]> {
let summary = "Generated op for `aten::mul.int : (int, int) -> (int)`";
let arguments = (ins
AnyTorchIntType:$a,
AnyTorchIntType:$b
);
let results = (outs
AnyTorchIntType:$result
);
let assemblyFormat = "$a `,` $b attr-dict `:` type($a) `,` type($b) `->` type($result)";
}
def Torch_AtenAddFloatIntOp : Torch_Op<"aten.add.float_int", [
AllowsTypeRefinement,
HasValueSemantics
]> {
let summary = "Generated op for `aten::add.float_int : (float, int) -> (float)`";
let arguments = (ins
AnyFloat:$a,
AnyTorchIntType:$b
);
let results = (outs
AnyFloat:$result
);
let assemblyFormat = "$a `,` $b attr-dict `:` type($a) `,` type($b) `->` type($result)";
}
def Torch_AtenMulFloatOp : Torch_Op<"aten.mul.float", [
AllowsTypeRefinement,
HasValueSemantics
]> {
let summary = "Generated op for `aten::mul.float : (float, float) -> (float)`";
let arguments = (ins
AnyFloat:$a,
AnyFloat:$b
);
let results = (outs
AnyFloat:$result
);
let assemblyFormat = "$a `,` $b attr-dict `:` type($a) `,` type($b) `->` type($result)";
}
def Torch_AtenLtFloatIntOp : Torch_Op<"aten.lt.float_int", [
AllowsTypeRefinement,
HasValueSemantics
]> {
let summary = "Generated op for `aten::lt.float_int : (float, int) -> (bool)`";
let arguments = (ins
AnyFloat:$a,
AnyTorchIntType:$b
);
let results = (outs
AnyTorchBoolType:$result
);
let assemblyFormat = "$a `,` $b attr-dict `:` type($a) `,` type($b) `->` type($result)";
}
def Torch_Aten__Is__Op : Torch_Op<"aten.__is__", [
AllowsTypeRefinement,
HasValueSemantics
]> {
let summary = "Generated op for `aten::__is__ : (t1, t2) -> (bool)`";
let arguments = (ins
AnyTorchType:$self,
AnyTorchType:$obj
);
let results = (outs
AnyTorchBoolType:$result
);
let assemblyFormat = "$self `,` $obj attr-dict `:` type($self) `,` type($obj) `->` type($result)";
let hasFolder = 1;
}
def Torch_AtenLenTOp : Torch_Op<"aten.len.t", [
AllowsTypeRefinement,
HasValueSemantics
]> {
let summary = "Generated op for `aten::len.t : (t[]) -> (int)`";
let arguments = (ins
Basicpy_ListType:$a
);
let results = (outs
AnyTorchIntType:$result
);
let assemblyFormat = "$a attr-dict `:` type($a) `->` type($result)";
let hasCanonicalizer = 1;
}