Giter VIP home page Giter VIP logo

fernandodecastilla / machine-learning-for-predictive-maintenance Goto Github PK

View Code? Open in Web Editor NEW
26.0 3.0 10.0 15.1 MB

Anomaly detection and failure prognosis applied to industrial machines

License: MIT License

Python 0.17% HTML 82.11% Jupyter Notebook 17.72%
data-science machine-learning anomaly-detection failure-prediction industrial-iot jupyter-notebook python-3-6 exploratory-data-analysis feature-engineering

machine-learning-for-predictive-maintenance's Introduction

Machine-Learning-for-Predictive-Maintenance

Anomaly detection and failure prognosis applied to industrial machines.

The raw dataset (1.3 GB) is availbale in: https://pysparksampledata.blob.core.windows.net/sampledata/sampledata.csv

The design and implementation of the Master's Final Project is structured in three directories:

  • Notebooks: implementation of the MFP in Python through phases of the life cycle.
  • Anomaly Detection models: anomaly detection model.
  • Anomaly Prediction models: classification models for prediction of anomalies.

Within the 'Notebooks' directory:

  • Directory 00: Notebook to execute and obtain an interactive Exploratory Data Analysis, in which the user has a series of widgets at his disposal to configure. It is not necessary to run this Notebook to continue with the rest.

  • Directory 01: Initial notebook with an optimal loading of the starting dataset, preparation of data, generation of new variables (feature engineering), and reduction of dimensionality through AutoEncoders.

  • Directory 02: Notebook with a second phase of feature engineering, focused on operations to obtain mobile statistical measures, adapting the code to deal with Memory Error messages.

  • Directory 03: Generation of a balanced dataset between anomalous and non-anomalous records, design of an anomaly detection model by means of an AutoEncoder, and analysis of its suitability from the business point of view. To give credibility to an initial model of anomalies detection, it is key to minimize the number of false positives (false anomalies), at the expense of increasing the number of false negatives (anomalies not reported).

  • Directory 04: Generation of datasets to apply a battery of classification models on categorical features.

  • Directory 05: Generation of datasets to apply a battery of classification models on categorical and numerical features.

  • Directory 06: Generation of datasets to apply two MLP models (Multi Layer Perceptron). The first on all available features, and the second on only those features whose values ​​reach a minimum of standard deviation.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.