Make this forward pass as fast as possible

(ianbarber.blog)

23 points | by matt_d 1 day ago

2 comments

  • 0-_-0 48 minutes ago
    If AI models were trained for optimising kernels, they could easily replace ML compilers. With no branches a numerical check gives you the correctness guarantees you need. However we already see anthropic deliberately nerfing kernel optimisation capabilities of their latest models, Chinese AI companies on the other hand have the opposite incentive.
    • augment_me 0 minutes ago
      Really? Can you give source for kernel generation being nerfed?
  • etskinner 38 minutes ago
    As someone who doesn't know much about kernels and compilation, this reads like a modern-day Retroencabulator