html,cookies = scrapertools.read_body_and_headers('http://www.google.com/ABCD')
genera esto en los logs :
12:50:18 T:4276 NOTICE: send:
12:50:18 T:4276 NOTICE: 'GET /ABCD HTTP/1.1\r\nAccept-Language: es-ES,es;q=0.8,en-US;q=0.5,en;q=0.3\r\nAccept-Encoding: gzip, deflate\r\nHost: www.google.com\r\nAccept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8\r\nUser-Agent: Mozilla/5.0 (Windows NT 6.1; rv:28.0) Gecko/20100101 Firefox/28.0\r\nConnection: close\r\n'
Y si delante delante de esa llamada ponemos :
os.environ["HTTP_PROXY"]=Proxy
El log pone :
12:50:18 T:4276 NOTICE: send:
12:50:18 T:4276 NOTICE: 'GET http://www.google.com/ABCD HTTP/1.1\r\nAccept-Language: es-ES,es;q=0.8,en-US;q=0.5,en;q=0.3\r\nAccept-Encoding: gzip, deflate\r\nHost: www.google.com\r\nAccept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8\r\nUser-Agent: Mozilla/5.0 (Windows NT 6.1; rv:28.0) Gecko/20100101 Firefox/28.0\r\nConnection: close\r\n'
Es decir añade protocolo y host a la peticion al host
Gracias por adelantado...
SalU2
