In the future we will have custom kernels for new models hours after they come out. This will make inference so much better. developer.nvidia.com/blog/automat... - ThreadSky | a Reddit-style client for Bluesky

maxkannen.bsky.social • 21 days ago

In the future we will have custom kernels for new models hours after they come out. This will make inference so much better.

https://developer.nvidia.com/blog/automating-gpu-kernel-generation-with-deepseek-r1-and-inference-time-scaling/

Comments