clueless-community / scrape-up Goto Github PK

An alternative to APIs, Scrape Up is a Python package for web scraping. It allows you to extract data from platforms like GitHub, Twitter, Instagram, or any other website that contains valuable information. It enables you to gather data through programming.

Terms and conditions for use, reproduction, and distribution are under the MIT License.

GirlScript Summer Of Code is a three-month-long Open-Source Program conducted every summer by the Girlscript Foundation. With constant efforts, participants contribute to numerous projects under the extreme guidance of skilled mentors over these months. With such exposure, students begin to contribute to real-world projects from the comfort of their homes. GirlScript Summer Of Code has witnessed active participation over the years, and the 2024 edition aims to carry the legacy with a promising impact.

Learn more about it here

• Flexible Scraping: Customize and define the specific data you want to extract from different platforms.
• Easy-to-Use: Intuitive Python package interface for both beginners and experienced developers.
• Multiple Platforms: Scrape data from various platforms, including GitHub, Twitter, Instagram, and more.
• Efficient and Fast: Designed for efficient and reliable scraping of data from multiple sources.

1. Install the package using pip:

pip install scrape-up --upgrade

2. Import the required module and instantiate an object with the necessary parameters:

# Import the required module
from scrape_up import github

# Instantiate an object with the username
user = github.Users(username="nikhil25803")

3. Call the desired method to scrape the required information. For example, to extract the number of followers of a user:

# Call the followers method
followers_count = user.followers()

# Print the output
print(followers_count)

Output:

83

4. Explore all the available methods provided by Scrape Up on different platforms here.

Happy scrapping! 🕸️

In our project journey, we encountered several challenges, including requesting timeouts and rate limits. To overcome these limitations, we developed a powerful Python tool based on web scraping. Our goal is to provide an alternative to APIs for extracting data from various platforms, including GitHub, Twitter, Instagram, and any other website that contains valuable information. Here's what our project aims to achieve:

With our web-scraping-based Python tool, you can unlock a world of data and overcome the limitations often encountered when relying solely on APIs.

🌟 We value the time and effort you put into contributing, and we look forward to reviewing and merging your contributions. Together, let's make web scraping a powerful and accessible tool for extracting data from various platforms.

✨ Thank you for your contribution!

(Back to top)