This also has improvements for #koboldcpp (whole llamacpp ecosystem) users who have RDNA3/4 with very big coopmat prompt processing improvements on par with rocm.
Once it lands in the Kisak PPA I will add it to our docker for those who can't easily install it natively and those who prefer using the container.
nostr:nevent1qvzqqqqqqypzqga5kmn36sdltc9rfzfrkxtccxwplfvvatpd0rnly38x8um9tk8fqyvhwumn8ghj7un9d3shjtnddakk7um5wgh8q6twdvhsqgyr23g7fypp8z2sxmul23hjmzp70zwq7zag2d35excas95dk5vywqtvh6u7