python - Unable to access AJAX url with requests, BeautifulSoup -

-

i trying read data of table, onclick ajax event of following webpage

the event initiates if click + sign right of tabelas tab, @ bootom of page.

using firebug (for example) browser y can optain ajax url xhr tab of net section.

the url valid , browser picks , shows it.

my script:

 import requests   urls="http://www.hidrografico.pt/components/com_products/scripts/server/data_getestactable.php"   headers = { 'user-agent':'mozilla/5.0 (x11; ubuntu; linux x86_64; rv:39.0) gecko/20100101 firefox/39.0', 'accept': 'application/json, text/javascript, */*; q=0.01', 'content-type': 'application/x-www-form-urlencoded; charset=utf-8', 'x-requested-with': 'xmlhttprequest'  }   s = requests.session()  s.post(urls)   content = s.post(urls, headers=headers)   print content.content

the output gives:

direct access file prohibited.

so seems there no direct access url although if paste url in browser can see table, in source code.

i dont know if missing or page in blocks direct attempt of readinig.

i tried through main webpage access table using beautifulsoup(text) , blabla.find(class,{'id':blabla}) , blabla.findall() gives 

attributeerror: 'nonetype' object has no attribute 'findall'

because de attribute class 'find' finds nothing.

i appreciate kind of , guidance tackle hurdle.

if check post parameters find need send estid=4&param=1 , work if have right cookies can sending get requests front page. 

import requests   # prepare session store cookies. s = requests.session() # cookies s.get("http://www.hidrografico.pt/boias-ondografo.php")  table_url = "http://www.hidrografico.pt/components/com_products/scripts/server/data_getestactable.php"     # prepare parameters payload = { "estid": "4",         "param": "1"          } r = s.post(table_url, data=payload) print r.text

Comments

Post a Comment

Popular posts from this blog

python - pip install -U PySide error -

-
does know how avoid following error when running pip install -u pyside per official website instructions here: https://pypi.python.org/pypi/pyside/#installing-pyside-on-a-mac-os-x-system note have done brew install qt successfully. you using pip version 7.0.3, version 7.1.2 available. should consider upgrading via 'pip install --upgrade pip' command. collecting pyside using cached pyside-1.2.4.tar.gz installing collected packages: pyside running setup.py install pyside complete output command /applications/anaconda/bin/python -c "import setuptools, tokenize;__file__='/private/var/folders/dy/ttgqhqqx3g9bsbsnqnxsk2z80000gq/t/pip-build-cpxemt/pyside/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /var/folders/dy/ttgqhqqx3g9bsbsnqnxsk2z80000gq/t/pip-0r7hri-record/install-record.txt --single-version-externally-managed --compile:
Read more

arrays - C++ error: a brace-enclosed initializer is not allowed here before ‘{’ token -

-
simple question: i'm trying initialize array within c++ class declaration: using namespace std; #include <string> class myclass{ public: string myarray[] = {"a","b","c"}; }; and i'm getting error: error: brace-enclosed initializer not allowed here before ‘{’ token no, without complied c++11 compiler, cannot initialize member array in declaration. have initialize array member in constructor. , don't use open array if know number of elements initialize array.
Read more

cytoscape.js - How to add nodes to Dagre layout with Cytoscape -

-
i trying add nodes dagre graph through cityscape.js. problem nodes not painted. code have: cy.add({ group: "nodes", data: { id:"n0",name:"n0",weight: 75 }, }); $.ajax(url).done(function(jsontree){ var newnodes=[]; for(var i=1;i<6;i++){ //var child = jsontree.result[i]; newnodes.push( { group: "nodes", data: { id: "n"+i, name:"n"+i}}, { group: "edges", data: { id: "e"+i, source: "n0", target: "n"+i } } ); } cy.add(newnodes); any ideas? have used loaded function reload graph not work. not know if have use specific function reload graph. thank in advance. you need add positions new nodes. cytoscape.js docs : it important note positions of newly added nodes must defined when calling cy.add(). nodes can not placed in graph without valid position — otherwise not displayed. yo
Read more