aw-work-and-holiday's People
aw-work-and-holiday's Issues
Create Web frontend
I want to end up using react and maybe SPA or close to that.
But this would take time so at the beginning I will probably add the views to my web API as if it was MVC.
I need to research if the strcuture is similar/the same and I can easily do this.
Improve pagination
- Show total results
- Show which results we are seeing right now
- Add number pagination
- Stop showing next if we are at the end
- Add pagination at the top of the screen too (create a component)
Right now I do not know the number of jobs for the specific query, I should probably have that value.
Login reloading
Login does not redirect and keeps loading forever in the website.
Filter By Category
- Add filtery by category capability
- Include category in job summary in List view
Login
- Include Identity tables
- Add login and register
- Confirmation pages
- Username
- Persistent cookies (remember me)
- Email verification
- Social login
- Authorization and authentication access
- Roles by user and company
Get sample screenshots
Name and Lastname to sign up
Review Scraping
Last try gave me the following results:
30/625 Jora
288/X WorkingHolidayJobs (could be fine)
314/234 Seek
656/284 Indeed (239 unique, not bad)
1052/1052 Jooble
Indeed downloading duplicates (2-5 duplicates)
Jora not downloading all
Post Job From
- Categorie Tags dropdown with one selection
- Salary dropdown (hourly or yearly )
20-30
30-40
40-50
50-60
60
miles de au$
50-60
60-70
70-80
80-90
90-100
100+
Role Based Authorization
- Add roles to identity management
- Initialize hard coded roles (Company, User)
- Setup role when user is created
- Use role based authorization for job posting
- Use role based authorization for job search?
- Use role based authorizaiton for job application
WorkingHoliday Scraper does not fill Description
In this website, the description is in a different page not in the the main list.
I would have to make a new request to fetch the description.
Sign up from in multiple steps
To avoid people getting overwhelmed with filling all the form.
Just ask for name and email, continue, and then click the rest.
Remove /m from Jooble URL
It is added by default when I scrape the page, but better to remove it before saving the jobs.
If the user uses a mobile they will be redirected.
Add Timestamps to tables in DB
Google Analytics
- Setup de la cuenta
- Incluir link and la web
Scrape backpacker jobs
https://www.backpackerjobboard.com.au/
I created logic to loop through the categories.
When getting to the third round, there is no next button so Last() is breaking. Maybe Last or default?
This is the URL
https://www.backpackerjobboard.com.au/jobs/disaster-relief/
error with dates: ' 25 Augu 2016' the string found a wrong word staring in index 4.
Research about email service
Use MailKit, open source library for .NET.
The author is very active, he also wrote the post in stack overflow and he has step by step on how to use with Gmail.
https://github.com/jstedfast/MailKit
https://stackoverflow.com/questions/33496290/how-to-send-email-by-using-mailkit
https://github.com/jstedfast/MailKit/blob/master/GMailOAuth2.md
I created a console app with the email service working
Import that code into our project
Google was saying the email may not be trusted (solve this)
Company Login
Company register
email
phone number
Accept terms and conditions
Improve job search
Maybe:
show jobs for 1 month with match with every keyword
show jobs with match with 1 keyword
Publish Web
- App Service
- DB service
- Publish
Create another process to delete jobs before scraping
Salary Dictionary
I am using a dictionary now and store the value in SalaryId
I have the legacy field salary used by the scraper that should dissapear.
I should read the scraped information and classify it within my range of salaries instead of using a string field.
Basic Web
The goal would be API and do front end in react, but that can take time so I will start with MVC.
- Basic Web
- Add pagination query
- Create Azure service and map domain
- Deploy to Azure
- Search Bar
- Background Image
Create Class Library
- Class library with Job class and repository
- Use class library in API project
- Use class library in Scraper project
Web Intro and Logos
Social Logos on the footer and maybe menu bar
Explaining our job portal and our blog
Info Visas
Info Farm
Info Australia
Layout and Styles
Create Access Denied View
When authorization is denied, it redirects to that view but it does not exist in my application right now.
Run scraper daily
Link to blog from my website has no https
Remove mobile URL from Jooble jobs
Case Insensitive search
Rename psql columns to follow their standard
Company Login
- Company Login
- Optional
Maybe Company independent register
email
phone number
Accept terms and conditions
Hide Apply button if not registered - scrape from seek and indeed only
Make scraper a console application
Deploy to Digital Ocean
- Configure .NET
- Configure Nginx
- Configure Postgresql
- Configure DNS and SSL
- Configure Basic Firewall
- Deploy ThePopularJob
- Deploy web scraper
- Make DB accessible from local machine
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. ๐๐๐
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google โค๏ธ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.