Giter VIP home page Giter VIP logo

tholkappiar / jobs-scraper Goto Github PK

View Code? Open in Web Editor NEW

This project forked from pavel401/jobsscraper

0.0 0.0 0.0 145.52 MB

Jobs Scraper: Streamline job searching by scraping and storing job postings from various websites ina SQLite3 database using this Go application.

Home Page: https://jobs-scraper-production.up.railway.app/

License: GNU General Public License v3.0

Go 86.05% HTML 13.95%

jobs-scraper's Introduction

Jobs Scraper

All Contributors

Screenshot

Table of Contents

Introduction

The Jobs Scraper is a powerful Go application designed for scraping job postings from a variety of websites and storing them in an SQLite database. Additionally, it offers endpoints for retrieving and synchronizing job postings, making it a valuable tool for job seekers and developers alike.

Mobile App

Repo: https://github.com/Pavel401/JobScraper-Mobile

Prerequisites

Before getting started with the Jobs Scraper, please ensure you have the following prerequisites installed:

How to setup

To run the application, you have to create a .env file. To configure you can set environment variables in the file. For example:

SYNC_WITH_SQL_PASSWORD=password
go run main.go

Endpoints

The Jobs Scraper package provides a set of powerful endpoints for scraping, managing, and synchronizing job postings. Here's a brief overview of the available endpoints:

  • /atlassian, /amazon, /coursera, /freshworks, /gojek, /mpl: Scrapes job postings from specific websites.
  • /syncwithSql: Synchronizes job postings with a SQL database.
  • /getallJobsFromSQL: Retrieves job postings from a SQL database.
  • /: Serves an HTML file (static/base.html).

Contributing

Contributions to this project are highly encouraged! If you have ideas for improvements or come across any issues, please don't hesitate to open an issue or submit a pull request on the GitHub repository.

This documentation aims to simplify and guide the way beginners make their first contribution. If you are looking to make your first contribution, follow the steps below.

If you don't have git on your machine install it.

Fork this repository

Fork this repository by clicking on the fork button on the top of this page. This will create a copy of this repository in your account.

Open in Github Desktop

Click on the green icon indicating "code" and open your Github desktop.

Clone the repository

Now clone the forked repository to your machine. Go to your GitHub account, open the forked repository, click on the code button and then click on open with Github Desktop ot you can click on copy to clipboard icon if you want to use git bash.

Note: Further command are for Git bash users not for the Git Desktop Users

For Git Desktop users ---> Now just click on Open with VS code and start your contribution.

Example:

Commit Changes

After you have updated the files,click on 'Commit to main' and then click on push origin.

Example :

Now Come back to Github web and click on contribute to submit your changes for review.


Steps for Git Bash Users

Open a terminal and run the following git command:

git clone "url you just copied"

where "url you just copied" (without the quotation marks) is the url to this repository (your fork of this project). See the previous steps to obtain the url.

For example:

git clone https://github.com/this-is-you/fossc.git

Here you're copying the contents of the first-contributions repository on GitHub to your computer.

Create a branch

Change to the repository directory on your computer (if you are not already there):

cd desktop

Now create a branch using the git checkout command:

git checkout -b <your-new-branch-name>

For example:

git checkout -b add-new-file

(The name of the branch does not need to have the word add in it, but it's a reasonable thing to include because the purpose of this branch is to add your name to a list.)

Make necessary changes and commit those changes

Now open add or edit file in a text editor. Add code for any existing algorithm in other language or add some new algorithms. Make sure to update correspond README.md file if needed. Now, save the file.

If you go to the project directory and execute the command git status, you'll see there are changes.

Add those changes to the branch you just created using the git add command:

git add "name of the file you add or edit"

Now commit those changes using the git commit command:

git commit -m "Add message for the change"

Push changes to GitHub

Push your changes using the command git push:

git push origin <add-your-branch-name>

replacing <add-your-branch-name> with the name of the branch you created earlier.

Submit your changes for review

If you go to your repository on GitHub, you'll see a Contribute button. Click on that button.

click on Open pull request.

click on Create pull request.

click on Create pull request.

Where to go from here?

Congrats! You just completed the standard fork -> clone -> edit -> pull request workflow that you'll encounter often as a contributor!

Contributors

All Contributors

Thanks goes to these wonderful people (emoji key):

Mabud Alam
Mabud Alam

๐Ÿ’ป ๐ŸŽจ ๐Ÿ› ๐Ÿšง ๐Ÿ‘€
Debayan Ghosh
Debayan Ghosh

๐Ÿ’ป
Abhishek Parmar
Abhishek Parmar

๐Ÿ“– ๐ŸŽจ ๐Ÿค”
Pinak Dhir
Pinak Dhir

๐Ÿ“–
Tholkappiar M
Tholkappiar M

๐Ÿ’ป
Hemant Chaudhary
Hemant Chaudhary

๐Ÿ’ป

License

This project is licensed under the [GPL-3.0 license] License - see the LICENSE file for details.

jobs-scraper's People

Contributors

pavel401 avatar allcontributors[bot] avatar debayangg avatar hemant933 avatar pinak-dhir avatar gitwiz01 avatar tholkappiar avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.