It turns out one needs to install libapache2-mod-php5 http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=707759