Giter VIP home page Giter VIP logo

webscraping-anp's Introduction

Scraping ANP's Oil & Gas Data with Selenium

A company participating in Petrobras' divestment processes asked me to obtain the historical production data of a series of mature fields, some of which have more than 1000 wells and have been explored since the 80s. The data is publicly available in ANP's website but is not downloadable, thus the need to use Selenium.

In order to use this project, it's important to set which fields should be scraped in the fields.txt file. Additionally, the user needs to download the Chrome Driver compatible with the version of Google Chrome installed in the machine used. Finally, just run the Python script and wait for the extraction to be completed. The output is a group of Excel files containing the data obtained.

Disclaimer: The spreadsheets in this repository are just examples of the output generated by the script. None of them have anything to do with the fields that the company wanted to analyze. Additionally, the Power BI page containing the data is constantly changing, therefore this script might not be updated to deal with the structure currently being used by ANP.

webscraping-anp's People

Contributors

pedrotramos avatar

Stargazers

 avatar

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.