erin2722 / usau-scraper Goto Github PK

Add in the ability to filter the rankings responses.

Add in competitionDivision, collegeRegion, collegeConference, and numResults fields.

The "data" field should be as follows, which is where we will put competitionDivision, collegeRegion, and collegeConference:

__EVENTTARGET: CT_Main_0$lnkViewAll should also be in the data field to avoid having to deal with the nitty gritty of pagination.

In addition, add in the team URI to the results, so that other functions can query with it specifically.

Add branding and styling to the repository.

buildTeamDict() works by incrementing the "__EVENTTARGET" attribute -- however, when it goes above 9, it stops filtering and just returns the first 20 teams in the whole db. Also, 00 skips the first page and goes straight to the second.

How to fix this?

Example page: https://play.usaultimate.org/events/No-Sleep-Till-Brooklyn-2023/

I want to scrape each tab and store the results as a whole, and also to provide a function that attempts to find the first and second place winners of the tournament.

Add a function that scrapes the team rankings page of the USAU website: https://play.usaultimate.org/teams/events/team_rankings/?RankSet=Club-Women

For now, don't worry about the more specific information in the dropdown menus or pagination, just write a function to scrape the first 20 teams from the rankings page and input the data into a JSON response.

Function Signature:

getRankings(
competitionLevel=<'College' or 'Club'>,
genderDivision=<'Women' or 'Men' or (for Club only) 'Mixed' >,
)

The link should be:
https://play.usaultimate.org/teams/events/team_rankings/?RankSet={competitionLevel}-{genderDivision}

The output format should be:

{
res: "ok" or "not found"
teams: [
    {
        Rank, Team, Power Rating, Competition Level, Gender Division, Competition Division, College Region, College 
        Conference, Wins, Losses
    },
    ...
}

for college,

and the same format but with the row headers for club.

In tournament-scraper, the link format for college tournaments contains CollegeWomen, but for club, it is Club-Women. Because of this, club results are inaccessible.

Change the link format to be conditional on club vs. college.