In my case the disconnect happens only if I use encryption. I disabled the WPA encryption on my router and rather alow only devices with certain MACs to access my WiFi. That solved the issue.