Post from Nov 18, 2025
Successfully compiled the VAE of Stable Diffusion 1.5 using graph-compiler.
ml¶
Post from Nov 13, 2025
PolyBlocks is another interesting ML compiler, written using MLIR. It's a startup incubated in IISc Bangalore, run by someone (Uday Bondhugula) who co-authored a paper on compiler optimizations for GPGPUs back in 2008 (17 years ago)!
Post from Nov 07, 2025
Wrote a simple script to convert ONNX to GGML. It auto-generates C++ code that calls the corresponding ggml functions (for each ONNX operator). This file can then be compiled and run like a normal C++ ggml program, and will produce the same results as the original model in PyTorch.
Post from Jan 13, 2025
Spent the last few days writing torchruntime, which will automatically install the correct torch distribution based on the user's OS and graphics card. This package was written by extracting this logic out of Easy Diffusion, and refactoring it into a cleaner implementation (with tests).