The value of the variable *default-client-remote-debugging-server-port* is the default port for start-client-remote-debugging-server and ide-connect-remote-debugging.
Note that if you change the port number on one side you must change it to the same number on the other side.
LispWorks User Guide and Reference Manual - 20 Sep 2017