Well, I eventually fixed the issue, doing the following :

- adding my domain name to /etc/hosts
- configuring again the reverse DNS on my VPS host panel
- rebooting the server

Because of the propagation time of DNS, I don't know it the two first step were
useful (before rebooting, the issue wasn't fixed).