halmonlui / airbnb-api Goto Github PK

Background
https://www.airbnb.com/rooms/26667415

Scroll down to reviews section and notice the images of the stay.:

This images can be accessed using this URL: https://www.airbnb.com/rooms/26667415/photos

• Make sure to set window size to 500, 951 so the page loads with mobile view.
• 26667415 is the ID of the listing
• Append the '/photos' to the end of the original URL

If you inspect the image, we have an image src URL

Reference selenium_scrape_language_ids.ipynb for a general idea on how to do this. If you have any questions always feel free to ask on the discord!

Specs

• We want to create a jupyter notebook function that takes in the listing ID (look at the end of the URL: 26667415) and return the images in an Array format seen below.

• Selenium is probably not needed for this, can probably request window size in the fetch header (viewport-width maybe?).
  https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers

• Don't need to create a Flask endpoint, only the helper function in a jupyter notebook. Another issue will be opened for that.

[
"https://a0.muscache.com/im/pictures/5aa90401-1b1f-4775-8a76-82b77c6c30a8.jpg?aki_policy=large",
"https://a0.muscache.com/im/pictures/5aa90401-1b1f-4775-8a76-82b77c6c30a8.jpg?aki_policy=large",
"https://a0.muscache.com/im/pictures/5aa90401-1b1f-4775-8a76-82b77c6c30a8.jpg?aki_policy=large",
"https://a0.muscache.com/im/pictures/5aa90401-1b1f-4775-8a76-82b77c6c30a8.jpg?aki_policy=large",
...
]

We used the same link here, but they should be the unique src link of each image

Background
https://www.airbnb.com/rooms/26667415

Scroll down to reviews section and notice the summary of the stay.:

This summary can be accessed using this URL: https://www.airbnb.com/rooms/26667415/description

• Make sure to set window size to 500, 951 so the page loads with mobile view.
• 26667415 is the ID of the listing
• Append the '/description' to the end of the original URL

Reference selenium_scrape_language_ids.ipynb for a general idea on how to do this. If you have any questions always feel free to ask on the discord!

Specs

• We want to create a jupyter notebook function that takes in the listing ID (look at the end of the URL: 26667415) and return the summary text JSON format seen below.

• Selenium is probably not needed for this, can probably request window size in the fetch header (viewport-width maybe?).
  https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers

• Don't need to create a Flask endpoint, only the helper function in a jupyter notebook. Another issue will be opened for that.

{
"Summary": "- Early check-in / late check-out almost always available!
- Restaurants, bar, hookah and grocery just 2 blocks away!
- Shuttle from your front door to 6TH STREET downtown nightlife until 3:20 AM for $1
- 4K TV w/ Chromecast
- Say It to Play It! Play your music or a movie with just your voice!
- Basic cable by Pluto TV
- Party responsibly without worry of noise complaints!
- Private Pool for Condos"
}

Background
We want to be able to request for the experiences page with all of the filter options just like we can right now with /getListings.

Luckily we only have 4 available filters for experiences unlike the many we have for getListings. We also only have 2 search options (location and dates)

Here's an image of the type of research done to get the parameters used in getListings.

Specs
If you take this ticket, let me know so I can give you permission to edit the table.

Find out what parameter names are used to allow the user to search by city/state, date, and each filter. Add all of this information to the spreadsheet as it will be referenced to develop the scripts/endpoints later on.

https://www.airbnb.com/s/Boston--MA/experiences?place_id=ChIJGzE9DS1l44kRoOhiASS_fHg&refinement_paths%5B%5D=%2Fexperiences&search_type=unknown&tab_id=experience_tab&map_toggle=false&query=Boston%2C%20MA
You can see a bunch of the parameters in the URL itself when you click on filters and search options with '&query=' or '&tab_id='. Find out what all of these do

Links that may help you out:
Reverse engineer an API

Background
https://www.airbnb.com/s/Boston--MA/experiences?place_id=ChIJGzE9DS1l44kRoOhiASS_fHg&refinement_paths%5B%5D=%2Fexperiences&search_type=unknown&tab_id=experience_tab&map_toggle=false&query=Boston%2C%20MA

Click link and scroll down to categories as seen in image below:

Notice the arrow to view more categories

Specs
We want to be able to get all the category names as well as the number of experiences there are. Create a Jupyter notebook script to do this. We do not know the total number of categories so be prepared for an n number of cataegories. Return a JSON object in the following format:

A Flask endpoint is not needed yet. This will be added in a separate issue.

[
  {
    "category": "Art and culture",
    "num_experiences": 32
  },
  {
    "category": "Art and culture",
    "num_experiences": 32
  },
  {
    "category": "Art and culture",
    "num_experiences": 32
  },
  ...
]

Background
https://www.airbnb.com/s/Boston--MA/experiences?place_id=ChIJGzE9DS1l44kRoOhiASS_fHg&refinement_paths%5B%5D=%2Fexperiences&search_type=unknown&tab_id=experience_tab&map_toggle=false&query=Boston%2C%20MA

Click into the link and notice the Languages Offered filter seen above.
We are unsure if the languages and IDs offered are different than that of Listings so we are going to create a script to look into it.

Specs
Create a Jupyter Notebook function that returns all of the languages offered and their unique IDs in a JSON object. This should be very similar to the existing /getLanguages endpoint and notebook.
Compare results with the ones from /getLanguages and see if there are any differences. Reference the selenium_scrape_language_ids.ipynb when developing this.

Background
https://www.airbnb.com/rooms/26667415

Scroll down to reviews section and notice the summary of the stay.:

This summary can be accessed using this URL: https://www.airbnb.com/rooms/26667415/amenities

• 26667415 is the ID of the listing
• Append the '/amenities' to the end of the original URL

Reference selenium_scrape_language_ids.ipynb for a general idea on how to do this. If you have any questions always feel free to ask on the discord!

Specs

• We want to create a jupyter notebook function that takes in the listing ID (look at the end of the URL: 26667415) and return the summary text JSON format seen below (says '...' at the bottom but we want to retrieve all of the amenities and put them in the array.

• Selenium is not needed for this

• Don't need to create a Flask endpoint, only the helper function in a jupyter notebook. Another issue will be opened for that.

[
{"amenity": "Wifi", "note": "Continuous access in the listing"},
{"amenity": "Cable TV", "note": Null},
...
]

Background
https://www.airbnb.com/rooms/26667415

Click into link and notice all of the data there is about the listing.

Specs
We want to add an endpoint to retrieve specific listing data by ID and return a giant JSON object with all of the data in it. To do this we're going to first need a bunch of working jupyter notebooks with scripts that scrape each part of the individual listing. These are under the getSpecificListing Projects label and Milestone.

Some of the subcategories include:
Get specific listing summary
Get specific listing photos
Get specific listing amenities
Get specific listing sleeping arrangements
Get specific listing review breakdown
Get specific listing reviews
Get specific listing Things to know
Get specific listing calendar availability

Background
https://www.airbnb.com/rooms/26667415

Scroll down to reviews section and notice the breakdown of the review categories:

Reference selenium_scrape_language_ids.ipynb for a general idea on how to do this. If you have any questions always feel free to ask on the discord!

Specs
We want to create a jupyter notebook function that takes in the listing ID (look at the end of the URL: 26667415) and return the reviews breakdown in JSON format seen below.

Don't need to create a Flask endpoint, only the helper function in a jupyter notebook. Another issue will be opened for that.

{
"Cleanliness": 4.8,
"Accuracy": 4.8,
"Communication": 4.9,
"Location": 4.8,
"Check-in": 4.8,
"Value": 4.8
}

We need to get house rules + their IDs from the filters. Return in a json format.

Create a jupyter notebook for it and then add it to the flask server/documentation.