Hi Markus,
just a guess: If you really use IP:PORT then the LDAPS server's certificate CN will not match. The LDAPS server's hostname used for connection needs to match the certificates CN or SAN. Might be that older versions of SAP SSO did not check this.
Regards,
Lutz