What you need is a list of the IPs that should be able to access SSH, but if it would be too difficult to set that up, you can change the port that SSH listens on.