maxence-l / okcupidon Goto Github PK
View Code? Open in Web Editor NEWA python web scraper built on Selenium to gather profile data from okcupid.com
License: MIT License
A python web scraper built on Selenium to gather profile data from okcupid.com
License: MIT License
Hey I have a suggestion.
1.)I saw your code and I want to join you and Develop OkCupid bot that interacts with the Data you've collected.
2.)I want to include "Digital image processing" that will check how "good looking" is the person on the otherside(the person that you want to like him) by percentage.
3.)you can check my code with the SELENIUM(i know it's a lil code but it's doing the job correctly! it's like and dislike people by the location you give them and send them a message eventually).
So i want to cooperate with you so tell me what you think and if it's yes lets start working on that.
Thanks!
This library no longer appears to work. I inspected the webship.py file and it appears to reference button paths that no longer exist and therefore cannot click the like/pass button to proceed to the next profile.
I've setup my config with credentials and the attributes indicated on your page. I'm running python 3.9.6 and getting the following error on launch
% python3 -m okcupidon run
A new database will be created in ...
Traceback (most recent call last):
File "/usr/local/Cellar/[email protected]/3.9.6/Frameworks/Python.framework/Versions/3.9/lib/python3.9/runpy.py", line 197, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/local/Cellar/[email protected]/3.9.6/Frameworks/Python.framework/Versions/3.9/lib/python3.9/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "/usr/local/lib/python3.9/site-packages/okcupidon/main.py", line 207, in
main()
File "/usr/local/lib/python3.9/site-packages/okcupidon/main.py", line 122, in main
okc_db = DataBase(outfile)
File "/usr/local/lib/python3.9/site-packages/okcupidon/ourdatabase.py", line 34, in init
self.__c.executescript(create_database_script)
sqlite3.OperationalError: near "max": syntax error
The scraper crashes upon logging in, I'm getting both an error about cookies and a Selenium error, which sounds like the issue.
OUTPUT:
me@me:~/Documents/ok/okcupidon$ python3 -m okcupidon run
A database was found in /home/me/Documents/ok/okcupidon/okc_db
No usuable cookies were found. Please try entering your id info (id, pwd)
You provided and email and a password which will be used for logging in
Traceback (most recent call last):
File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "/home/me/Documents/ok/okcupidon/okcupidon/__main__.py", line 207, in <module>
main()
File "/home/me/Documents/ok/okcupidon/okcupidon/__main__.py", line 128, in main
my_scrapper.log_to_ok_cupid(id=id, pwd=pwd, save_cookies=store_cookies)
File "/home/me/Documents/ok/okcupidon/okcupidon/webship.py", line 165, in log_to_ok_cupid
__two_fa_login(id=id, pwd=pwd, save_cookies=save_cookies)
File "/home/me/Documents/ok/okcupidon/okcupidon/webship.py", line 103, in __two_fa_login
self.driver.find_element_by_class_name("login-actions-button").click()
File "/home/me/.local/lib/python3.8/site-packages/selenium/webdriver/remote/webelement.py", line 89, in click
self._execute(Command.CLICK_ELEMENT)
File "/home/me/.local/lib/python3.8/site-packages/selenium/webdriver/remote/webelement.py", line 773, in _execute
return self._parent.execute(command, params)
File "/home/me/.local/lib/python3.8/site-packages/selenium/webdriver/remote/webdriver.py", line 430, in execute
self.error_handler.check_response(response)
File "/home/me/.local/lib/python3.8/site-packages/selenium/webdriver/remote/errorhandler.py", line 247, in check_response
raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.ElementClickInterceptedException: Message: element click intercepted: Element <button type="submit" class="login-actions-button" data-cy="login.submitButton">...</button> is not clickable at point (495, 459). Other element would receive the click: <p id="onetrust-policy-text">...</p>
(Session info: chrome=103.0.5060.53)
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.