I installed linux-image-2.6.17-2-686 (version 2.6.17-9) on the server in question and rebooted with that and apache2 now works. That server's a production one so I can't really try again with the 2.4 kernel to see if it's reproducible, but I might try on another machine if I get time.