console tool for checking web sites

[Hugo Vanwoerkom <hvw59601@care2.com>]

Hi,

I want to use text-based console api tools for checking the contents of 
web pages. I.e. not for the human eye but for an api.

What is the best tool for that? python-twisted?

E.g: http://scan.sygatetech.com/stealthscan.html gives back the stealth 
scan status of your server, but as an html page. How to abstract that 
data for a console driven app?

Or http://klive.cpushare.com/
gives a page that shows kernel usage, but it is for human consumption, 
not programs. How to get at that data? Can't be that I have to write an 
html extract application?

H