Topic
kernels
2 blogs filed here.
Writing a high performant GEMV + dequant for Metal
Notes on writing a high performant quant linear kernel for Metal (hitting 90% of Metal's MBU).
LLAMA 1B Optimizing Kernels
Notes on optimizing kernels for Llama 1B
Topic
2 blogs filed here.
Notes on writing a high performant quant linear kernel for Metal (hitting 90% of Metal's MBU).
Notes on optimizing kernels for Llama 1B