I found the list of projects on bitbucket dashboard by using this

bucket_names = tree.xpath('//div[@class="repo-list--repo"]/a/text()') print(bucket_names)

instead of using

bucket_elems = tree.findall(".//span[@class='execute repo-list--repo-name']") bucket_names = [bucket_elem.text_content().replace("\n", "").strip() for bucket_elem in bucket_elems]

I used python3 (just changed the print method)

Hello i'm getting this error on ubuntu. I'm new to scrapping so can u help me to understand what's the error here. I'm using the exact code with username and password

Traceback (most recent call last):
File "/home/taha/PycharmProjects/login_scraper_example/login_scraper_example.py", line 39, in
main()
File "/home/taha/PycharmProjects/login_scraper_example/login_scraper_example.py", line 32, in main
tree = html.fromstring(result.content)
File "/home/taha/.local/lib/python2.7/site-packages/lxml/html/init.py", line 726, in fromstring
doc = document_fromstring(html, parser=parser, base_url=base_url, **kw)
File "/home/taha/.local/lib/python2.7/site-packages/lxml/html/init.py", line 614, in document_fromstring
value = etree.fromstring(html, parser, **kw)
File "lxml.etree.pyx", line 3103, in lxml.etree.fromstring (src/lxml/lxml.etree.c:70569)
File "parser.pxi", line 1828, in lxml.etree._parseMemoryDocument (src/lxml/lxml.etree.c:106403)
File "parser.pxi", line 1716, in lxml.etree._parseDoc (src/lxml/lxml.etree.c:105194)
File "parser.pxi", line 1086, in lxml.etree._BaseParser._parseDoc (src/lxml/lxml.etree.c:99876)
File "parser.pxi", line 580, in lxml.etree._ParserContext._handleParseResultDoc (src/lxml/lxml.etree.c:94350)
File "parser.pxi", line 690, in lxml.etree._handleParseResult (src/lxml/lxml.etree.c:95786)
File "parser.pxi", line 629, in lxml.etree._raiseParseError (src/lxml/lxml.etree.c:95015)
lxml.etree.XMLSyntaxError: line 324: Tag footer invalid

@kazuar
I copied the exact same code.
is there something I am missing?

How to login https://www.houndify.com/login every request trying to login with python csrf token will be change in every request , Thanks so much if anyone can help me

I need it please help.

Thanks , Best regard

What language is this code in and what program do I use to run this code? Thank you very much

result = session_requests.post(login_url, data = payload, headers = headers)

print result.status_code
print result.content

nextresult = session_requests.get(next_url, headers = dict(referer = next_url))
nexthtmltree = html.fromstring(nextresult.content)
print nextresult.content

the nextresult content again prints the login page