It was something I still don't understand with gpg 2 ignoring --keyserver but also not using the default one when dirmngr is not configured