pytorch_learn

jjsjann123 7b419e8513 [NVFuser] Upstream push 1026 (#87779 ) Syncing nvfuser devel branch to upstream master. https://github.com/csarofeen/pytorch/ Codegen changes include: * codegen improvement: i. allow non-root trivial reductions, allow empty/no-op fusion ii. fixes vectorization checks and size calculation iii. bank conflict handle improvement iv. enables transpose scheduler * misc: i. CI tests failure fixes ii. cpp tests file clean up iii. trivial forwarding supports added in codegen runtime iv. added factory methods support in codegen Commits that's in this PR from the devel branch: ``` `7117a7e37e` patching nvfuser conv cudnn test numerics mismatch (#2048) `65af1a4e70` Inserting sync for redundant parallel types is already done at the (#2023) `6ac74d1816` Fix sync map (#2047) `f5bca33335` Bank conflict checker improvements (#2032) `d2ca7e3fd2` Minor update on cp.async code generation. (#1901) `d36cf61f55` Test file cleanup (#2040) `0b8e83f49c` Allow non-root trivial reductions (#2037) `a2dfe40b27` Fix vectorize size calculation (#2035) `e040676a31` Use withPredicate to replace setPredicate to maintain Exprs immutable (#2025) `197221b847` removing ci workflow (#2034) `40e2703d00` Reduction rand like patch (#2031) `bc772661cb` Add utility for checking bank conflict of shared memory (#2029) `ddd1cf7695` Add back FusionReductionWithTrivialReduction_CUDA (#2030) `fbd97e5ef1` Revert "Cleanup trivial reduction workarounds (#2006)" (#2024) `bca20c1dfb` Cleanup trivial reduction workarounds (#2006) `e4b65850ee` Trivial forwarding (#1995) `1a0e355b50` Fix contiguity analysis of predicates to match updated contiguity. (#1991) `a4effa6a5f` Enable output allocation cache (#2010) `35440b7953` Patching bn inference (#2016) `0f9f0b4060` Add matmul benchmark (#2007) `45045cd05e` Enable tests previously disabled due to an aliasing bug (#2005) `967aa77d2c` Contiguous indexing for View operations (#1990) `a43cb20f48` Make inlining even more modular (#2004) `dc458358c0` Test util cleanup (#2003) `3ca21ebe4d` More strict validation (#2000) `a7a7d57331` Fix build problem (#1999) `fc235b064e` Just fixes comments (#1998) `482386c050` cleanup (#1997) `4cbe0db655` Improve divisible split detection (#1970) `42ccc52bdc` Minor build fix. (#1996) `fcf8c091f7` Cleanup of lower_utils.cpp: Isolate out GpuLower usage (#1989) `15f2f6dba8` Move ConcretizedBroadcastDomains to shared_ptr in GpuLower. (#1988) `8f1c7f5267` Minor cleanup lower_unroll.cpp (#1994) `1d9858c803` Minor cleanup (#1992) `f262d9cab5` Add support for uniform RNG (#1986) `eb1dad10c7` Remove non-const functions, remove GpuLower instance on build, pass in ca_map. (#1987) `634820c5e3` Add support for some empty fusion (#1981) `eabe8d844a` Segment self mapping fusions (#1954) `e96aacfd9c` Enable Transpose operation (#1882) `425dce2777` Add a null scheduler that helps segmenting away no-op schedules (#1835) `306d4a68f1` Fix canScheduleCompileTime check of transpose scheduler (#1969) `b1bd32cc1b` Minor fix (#1967) `bd93578143` Enable transpose scheduler (#1927) `b7a206e93b` Move scheduler vectorize utilities into their own file (#1959) `d9420e4ca0` View scheduling (#1928) `c668e13aea` Upstream push ci fixes (#1965) `c40202bb40` Fix dump effective bandwidth (#1962) `93505bcbb9` WAR on index mapping when exact and permissive maps differ (#1960) `45e95fd1d3` Allow splitting inner-most ID to create virtual innermost ID in transpose scheduler (#1930) `a3ecb33944` Improve the comments at the beginning of index_compute.h (#1946) `f7bc3417cc` Remove unused variables (#1955) `df3393adbb` Some cleanup (#1957) `7d1d7c8724` TVDomainGuard factory (#1953) `357ba224c0` Fill allocation with nan on tests (#1956) `8eafc54685` Fix detection of unmappable root domains (#1952) `90a51f2826` Some indexing cleanups, Add eye support (#1940) `ddc01e4e16` Exclude unsupported data types (#1951) `992e17c068` test the groups the same order as they are merged (#1949) `208262b75d` Move detection of self mapping IDs to IterDomainGraph from (#1941) `ac4de38c6e` Merge pull request #1945 from csarofeen/master_merge_0828 `631094891a` Add full, full_like, zeros, zeros_like, ones, ones_like (#1943) `aab10bce45` Merge remote-tracking branch 'upstream/viable/strict' into HEAD `4c254c063b` Fix arange when step is negative (#1942) `89330aa23a` Tensor factories must set the output shape as its input (#1939) ``` RUN_TORCHBENCH: nvfuser Differential Revision: [D40869846](https://our.internmc.facebook.com/intern/diff/D40869846) Pull Request resolved: https://github.com/pytorch/pytorch/pull/87779 Approved by: https://github.com/davidberard98	1 year ago
..
api	Reland "[pytorch][PR] Support dataclasses in TorchScript" take 2 (#74353) (#74353) (#76771)	1 year ago

backends	[coreml] delegate multiple outputs (#88345)	1 year ago

codegen	[NVFuser] Upstream push 1026 (#87779)	1 year ago

cuda	canonicalize includes of form <aten/src/ATen/...>	1 year ago

docs	Fix typo under torch directory (#87274)	1 year ago

frontend	Enable max.unary_out (#86855)	1 year ago

ir	Add 'share_from_this' to 'torch::jit::Graph' (#87343)	1 year ago

mobile	[edge profiler] Add support for performance events counting (#87876)	1 year ago

operator_upgraders	Fix typos under torch directory (#88172)	1 year ago

passes	[vulkan] enable prepacking for Batchnorm op (#88433)	1 year ago

python	Fix `PyTorchStreamWriter` exception handling (#88128)	1 year ago

runtime	Fix typos under torch directory (#88172)	1 year ago

serialization	[fix] allow saving python attr on Tensor and Parameter via torch.save (#81616)	1 year ago

tensorexpr	Fix bugs found by static analysis (#85705)	1 year ago

testing	Reland "Make debug_pkl smaller by only emitting unique traces." (#73368)	2 years ago

JIT-AUTOCAST.md	[JIT][Autocast] document that scripted autocast context cannot disable eager-enabled autocast (#81747)	1 year ago

OVERVIEW.md	Fix typos under torch directory (#88172)	1 year ago

README.md	[JIT] improve documentation (#57991)	3 years ago

jit_log.cpp	Remove copies in jit_log.cpp (#67841)	2 years ago

jit_log.h	[JIT] script & logging for extracting IR from logs (#72889)	2 years ago

jit_opt_limit.cpp	Implement optimization bisect (#49031)	3 years ago

jit_opt_limit.h	Remove WindowsTorchApiMacro.h in favor of Export.h (#69585)	2 years ago

resource_guard.h	Fix modernize-use-equals-default nolint failures in torch/csrcs (#61142)	2 years ago

jjsjann123 7b419e8513 [NVFuser] Upstream push 1026 (#87779 )

Syncing nvfuser devel branch to upstream master. https://github.com/csarofeen/pytorch/

Codegen changes include:

* codegen improvement:
    i. allow non-root trivial reductions, allow empty/no-op fusion
    ii. fixes vectorization checks and size calculation
    iii. bank conflict handle improvement
    iv. enables transpose scheduler

* misc:
    i. CI tests failure fixes
    ii. cpp tests file clean up
    iii. trivial forwarding supports added in codegen runtime
    iv. added factory methods support in codegen

Commits that's in this PR from the devel branch:

```
7117a7e37e patching nvfuser conv cudnn test numerics mismatch (#2048)
65af1a4e70 Inserting sync for redundant parallel types is already done at the (#2023)
6ac74d1816 Fix sync map (#2047)
f5bca33335 Bank conflict checker improvements (#2032)
d2ca7e3fd2 Minor update on cp.async code generation. (#1901)
d36cf61f55 Test file cleanup (#2040)
0b8e83f49c Allow non-root trivial reductions (#2037)
a2dfe40b27 Fix vectorize size calculation (#2035)
e040676a31 Use withPredicate to replace setPredicate to maintain Exprs immutable (#2025)
197221b847 removing ci workflow (#2034)
40e2703d00 Reduction rand like patch (#2031)
bc772661cb Add utility for checking bank conflict of shared memory (#2029)
ddd1cf7695 Add back FusionReductionWithTrivialReduction_CUDA (#2030)
fbd97e5ef1 Revert "Cleanup trivial reduction workarounds (#2006)" (#2024)
bca20c1dfb Cleanup trivial reduction workarounds (#2006)
e4b65850ee Trivial forwarding (#1995)
1a0e355b50 Fix contiguity analysis of predicates to match updated contiguity. (#1991)
a4effa6a5f Enable output allocation cache (#2010)
35440b7953 Patching bn inference (#2016)
0f9f0b4060 Add matmul benchmark (#2007)
45045cd05e Enable tests previously disabled due to an aliasing bug (#2005)
967aa77d2c Contiguous indexing for View operations (#1990)
a43cb20f48 Make inlining even more modular (#2004)
dc458358c0 Test util cleanup (#2003)
3ca21ebe4d More strict validation (#2000)
a7a7d57331 Fix build problem (#1999)
fc235b064e Just fixes comments (#1998)
482386c050 cleanup (#1997)
4cbe0db655 Improve divisible split detection (#1970)
42ccc52bdc Minor build fix. (#1996)
fcf8c091f7 Cleanup of lower_utils.cpp: Isolate out GpuLower usage (#1989)
15f2f6dba8 Move ConcretizedBroadcastDomains to shared_ptr in GpuLower. (#1988)
8f1c7f5267 Minor cleanup lower_unroll.cpp (#1994)
1d9858c803 Minor cleanup (#1992)
f262d9cab5 Add support for uniform RNG (#1986)
eb1dad10c7 Remove non-const functions, remove GpuLower instance on build, pass in ca_map. (#1987)
634820c5e3 Add support for some empty fusion (#1981)
eabe8d844a Segment self mapping fusions (#1954)
e96aacfd9c Enable Transpose operation (#1882)
425dce2777 Add a null scheduler that helps segmenting away no-op schedules (#1835)
306d4a68f1 Fix canScheduleCompileTime check of transpose scheduler (#1969)
b1bd32cc1b Minor fix (#1967)
bd93578143 Enable transpose scheduler (#1927)
b7a206e93b Move scheduler vectorize utilities into their own file (#1959)
d9420e4ca0 View scheduling (#1928)
c668e13aea Upstream push ci fixes (#1965)
c40202bb40 Fix dump effective bandwidth (#1962)
93505bcbb9 WAR on index mapping when exact and permissive maps differ (#1960)
45e95fd1d3 Allow splitting inner-most ID to create virtual innermost ID in transpose scheduler (#1930)
a3ecb33944 Improve the comments at the beginning of index_compute.h (#1946)
f7bc3417cc Remove unused variables (#1955)
df3393adbb Some cleanup (#1957)
7d1d7c8724 TVDomainGuard factory (#1953)
357ba224c0 Fill allocation with nan on tests (#1956)
8eafc54685 Fix detection of unmappable root domains (#1952)
90a51f2826 Some indexing cleanups, Add eye support (#1940)
ddc01e4e16 Exclude unsupported data types (#1951)
992e17c068 test the groups the same order as they are merged (#1949)
208262b75d Move detection of self mapping IDs to IterDomainGraph from (#1941)
ac4de38c6e Merge pull request #1945 from csarofeen/master_merge_0828
631094891a Add full, full_like, zeros, zeros_like, ones, ones_like (#1943)
aab10bce45 Merge remote-tracking branch 'upstream/viable/strict' into HEAD
4c254c063b Fix arange when step is negative (#1942)
89330aa23a Tensor factories must set the output shape as its input (#1939)
```

RUN_TORCHBENCH: nvfuser

Differential Revision: [D40869846](https://our.internmc.facebook.com/intern/diff/D40869846)
Pull Request resolved: https://github.com/pytorch/pytorch/pull/87779
Approved by: https://github.com/davidberard98

1 year ago

api

Reland "[pytorch][PR] Support dataclasses in TorchScript" take 2 (#74353) (#74353) (#76771)

1 year ago

backends

[coreml] delegate multiple outputs (#88345)

1 year ago

codegen

[NVFuser] Upstream push 1026 (#87779)

1 year ago

cuda

canonicalize includes of form <aten/src/ATen/...>

1 year ago

docs

Fix typo under torch directory (#87274)

1 year ago

frontend

Enable max.unary_out (#86855)

1 year ago

Add 'share_from_this' to 'torch::jit::Graph' (#87343)

1 year ago

mobile

[edge profiler] Add support for performance events counting (#87876)

1 year ago

operator_upgraders

Fix typos under torch directory (#88172)

1 year ago

passes

[vulkan] enable prepacking for Batchnorm op (#88433)

1 year ago

python

Fix `PyTorchStreamWriter` exception handling (#88128)

1 year ago

runtime

Fix typos under torch directory (#88172)

1 year ago

serialization

[fix] allow saving python attr on Tensor and Parameter via torch.save (#81616)

1 year ago

tensorexpr

Fix bugs found by static analysis (#85705)

1 year ago

testing

Reland "Make debug_pkl smaller by only emitting unique traces." (#73368)

2 years ago

JIT-AUTOCAST.md

[JIT][Autocast] document that scripted autocast context cannot disable eager-enabled autocast (#81747)

1 year ago

OVERVIEW.md

Fix typos under torch directory (#88172)

1 year ago

README.md

[JIT] improve documentation (#57991)

3 years ago

jit_log.cpp

Remove copies in jit_log.cpp (#67841)

2 years ago

jit_log.h

[JIT] script & logging for extracting IR from logs (#72889)

2 years ago

jit_opt_limit.cpp

Implement optimization bisect (#49031)

3 years ago

jit_opt_limit.h

Remove WindowsTorchApiMacro.h in favor of Export.h (#69585)

2 years ago

resource_guard.h

Fix modernize-use-equals-default nolint failures in torch/csrcs (#61142)

2 years ago

PyTorch JIT

This folder contains (most of) the C++ code for the PyTorch JIT, a language
and compiler stack for executing PyTorch models portably and efficiently. To
learn more about the JIT from a user perspective, please consult our
reference documentation and
tutorials.

A brief summary of the source tree:

OVERVIEW.md: High-level technical overview of the JIT.

frontend/: Taking PyTorch modules in Python and translating them into the
JIT IR.

ir/: Core IR abstractions.

runtime/: Interpreter, graph execution, and JIT operators.

codegen/: Generating efficient, hardware-specific code for JIT subgraphs.

serialization/: Saving and loading modules.

api/: Any user-facing C++ or Python interfaces.

python/: Binding stuff into Python or accessing information from the Python
environment.

testing/: Utilities and helpers for testing.

mobile/: Mobile-specific implementations of runtime components.

passes/: IR-to-IR passes, generally for optimization and lowering.

generated/: This folder is generated by the PyTorch build, and contains
bindings for native PyTorch operators into the JIT.

Refer to each folder for more in-depth documentation.

Other relevant parts of the codebase not contained here:

aten/src/ATen/core: contains JIT code re-used by other elements of the
runtime system (eager, mobile, etc.)

Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.

README.md

PyTorch JIT

Contributors (25+) All

Contributors (25+)
All