We should be able to clamp passed-in premultiplied alpha values to be at least the same magnitude as the color channels. This may not already be the case if the user provides a corrupt image.
It'll slow us down, so there should be a SMOL_DISABLE_ALPHA_CLAMP flag for performance freaks like yours truly.