Change dsa_verify_* returns values to 0/1

Remove the footgun where certain failures returned negative error codes,
which when checked as bool would evaluate to true.

WinSparkle used the API correctly, but consistency with ed25519_verify()
interface is still preferable.