Skip to content

An interactive web-based tool for exploring intermediate representations of PyTorch and Triton models

License

Notifications You must be signed in to change notification settings

fodinabor/PytorchExplorer

 
 

Repository files navigation

PyTorch IR Explorer

Nightly

An interactive web-based tool for exploring intermediate representations (IRs) of PyTorch and Triton models. Designed to help developers, researchers, and students visualize and understand compilation pipelines by tracing models through various IR stages and transformations.

Features

  • Live editing of PyTorch, Triton models and raw IR input
  • Pre-defined lowering IR support:
    • TorchScript Graph IR
    • Torch MLIR (and TOSA, Linalg, StableHLO dialects)
    • LLVM MLIR and LLVM IR
    • Triton IRs (TTIR, TTGIR, LLVM IR, NVPTX)
  • Customizable compiler pipelines with toolchain steps like:
    • torch-mlir-opt
    • mlir-opt
    • mlir-translate
    • opt, llc, or any external tool via $PATH
  • Visual pipeline builder to control and inspect transformation flow
  • IR viewer with syntax highlighting
  • Side-by-side IR windows
  • "Print after all opts" toggle to inspect intermediate outputs

Known issues and limitations

  • (PyTorch) The model and input tensor must be initialized in the provided code. If multiple models are defined, it is recommended to explicitly pair each model and its input tensor using the internal __explore__(model, input) function.

  • (Triton) The current implementation runs Triton kernels and retrieves IR dumps from the Triton cache directory. Timeout is set to 20s.

Getting Started

Prerequisites

  • Python 3.11+
  • Node.js + npm
  • PyTorch
  • Torch-MLIR
  • Triton
  • LLVM with mlir-opt

To setup PyTorch and Torch-MLIR it's a good idea to visit https://github.com/llvm/torch-mlir repository and follow instructions from there.

Current version of the application is tested on Ubuntu 22.04 windows subsystem using LLVM 21 dev.

Install dependencies

In case of missing prerequisites here are some scripts to help set them up (runs on Debian and its derivatives).

git clone https://github.com/MrSidims/PytorchExplorer.git
cd PytorchExplorer
source setup_frontend.sh

When you have venv suitable for torch-mlir work, install fastapi, uvicorn etc in venv like this:

pip install fastapi uvicorn pytest httpx

Otherwise here is the script to setup torch, llvm etc:

source setup_backend.sh

If you want to use your builds of the tools like torch-mlir-opt, mlir-opt etc without placing them in PATH please setup TORCH_MLIR_OPT_PATH and LLVM_BIN_PATH environment variables.

Run the application

npm run start:all

Then open http://localhost:3000/ in your browser and enjoy!

Run the tests

With the application (or just backend) started, run:

pytest tests -v

User manual

TBD

Implementation details

The app uses fx.export_and_import under the hood to inpect IR output for PyTorch, therefore for pre-defined lowering paths it's required for a module to have forward method.

Lowering to LLVM IR goes through:

module = fx.export_and_import(model, example_input, output_type=OutputType.LINALG_ON_TENSORS)
mlir-opt --one-shot-bufferize="bufferize-function-boundaries"
         -convert-linalg-to-loops
         -convert-scf-to-cf
         -convert-cf-to-llvm
         -lower-affine
         -finalize-memref-to-llvm
         -convert-math-to-llvm
         -convert-math-to-llvm
         -convert-func-to-llvm
         -reconcile-unrealized-casts
         str(module) -o output.mlir
mlir-translate --mlir-to-llvmir output.mlir

About

An interactive web-based tool for exploring intermediate representations of PyTorch and Triton models

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • JavaScript 52.0%
  • Python 39.6%
  • CSS 5.4%
  • Shell 1.9%
  • C++ 1.1%