Giter VIP home page Giter VIP logo

ml_seminarsuplimentar's Introduction

๐Ÿ“ˆ ML_SeminarSuplimentar

This repository includes implementations of the sigmoidal perceptron, logistic regression using the gradient ascending method and logistic regression using the Newton-Raphson method, made for the additional Machine Learning seminar.

The dataset used is the one from the mushroom problem, exercise 4.2 on page 470 of the Machine Learning Exercise Collection:

Some of these graphs can be found in the presentation of the Regression chapter presented in the Machine Learning course at the Faculty of Computer Science of the "Al. I. Cuza" University in Iasi, academic year 2023-2024.

Results and graphs

  1. Sigmoidal perceptron - uses gradient descent to calculate the minimum value of the conditional probability:

Final results (for 2000 iterations):

Mushroom U is edible: False
Mushroom V is edible: False
Mushroom W is edible: True
  1. Logistic regression (ascending gradient method) - uses the ascending gradient to calculate the maximum value of the conditional probability:

Final results (for 150 iterations):

Mushroom U is edible: False
Mushroom V is edible: False
Mushroom W is edible: True

 w_0 = 0.75287357
 w_1 = 0.00332853
 w_2 = -0.75367651
 w_3 = -0.75768382
 w_4 = -1.51094581
  1. Logistic regression (Newton-Raphson method) - uses the Hessian matrix and the gradient vector to calculate the maximum value of the conditional probability:

Final results (for 10 iterations):

Mushroom U is edible: False
Mushroom V is edible: False
Mushroom W is edible: True

 w_0 = 0.7565
 w_1 = -0.0002
 w_2 = -0.7563
 w_3 = -0.7563
 w_4 = -1.5126

ml_seminarsuplimentar's People

Contributors

alinaduca avatar

Stargazers

 avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.