Post from Oct 24, 2025
Good post on using MLIR for compiling ML models to GPUs. It gives a good broad overview of a GPU architecture, and how MLIR fits into that. The overall series looks pretty interesting too!
2025¶
Post from Oct 22, 2025
Wrote a fresh implementation of most of the popular samplers and schedulers used for image generation (Stable Diffusion and Flux) at https://github.com/cmdr2/samplers.cpp. A few other schedulers (like Align Your Steps) have been left out for now, but are pretty easy to implement.
Post from Oct 10, 2025
Some notes on machine-learning compilers, gathered while researching tech for Easy Diffusion's next engine (i.e. sdkit v3). For context, see the design constraints of the new engine.
Post from Oct 10, 2025
The design constraints for Easy Diffusion's next engine (i.e. sdkit v3) are:
- Lean: Install size of < 200 MB uncompressed (excluding models).
- Fast: Performance within 10% of the best-possible speed on that GPU for that model.
- Capable: Supports Stable Diffusion 1.x, 2.x, 3.x, XL, Flux, Chroma, ControlNet, LORA, Embedding, VAE. Supports loading custom model weights (from civitai etc), and memory offloading (for smaller GPUs).
- Targets: Desktops and Laptops, Windows/Linux/Mac, NVIDIA/AMD/Intel/Apple.
Post from Sep 01, 2025
Cleared the backlog of stale issues on ED's github repo. This brought down the number of open issues from ~350 to 74.
Post from Aug 25, 2025
Experimented with TensorRT-RTX (a new library offered by NVIDIA).
Post from Jun 17, 2025
Development update for Easy Diffusion - It's chugging along in starts and stops. Broadly, there are three tracks:
Post from Mar 04, 2025
Upgraded the default version of Easy Diffusion to Python 3.9. Newer versions of torch don't support Python 3.8, so this became urgent after the release of NVIDIA's 50xx series GPUs.
Post from Feb 10, 2025
Easy Diffusion (and sdkit) now also support AMD on Windows automatically (using DirectML), thanks to integrating with torchruntime. It also supports integrated GPUs (Intel and AMD) on Windows, making Easy Diffusion faster on PCs without dedicated graphics cards.
Post from Feb 10, 2025
Spent the last week or two getting torchruntime fully integrated into Easy Diffusion, and making sure that it handles all the edge-cases.