Giter VIP home page Giter VIP logo

linear_svm_adaboost's Introduction

Linear_SVM_AdaBoost

In this repository an adaboost classifier based on linear SVM was designed to classify the dataset combining 'classA.csv' and 'classB.csv'. Class A and Class B datasets are visualized below in Figure 1.

Figure 1. Datasets 'classA.csv' and 'classB.csv'.

A linear SVM with varying C values {0.1, 1 , 10 , 100} was trained and the decision boundary was visualized alongside the reported accruuacy based on 10-times-10-fold cross validation.The linear SVM decision boundary is shown in Figure 2 for varying C values.

Figure 2.Decision boundary of varying C values.

The accuracy results of the linear SVM classifiers obtained using 10-times-10-fold cross validation are reported in Table I.
TABLE I: LINEAR SVM ACCURACY RESULTS

C Value 0.1 1 10 100
Accuracy - Mean 79.35% 79.80% 79.77% 79.75%

An ensemble of classifiers was created based on the Adaboost-M1 approach to classify the dataset. A linear SVM was used with the C=1 as the weak learner classifier. The maximum number of weak learners was taken as T = 50.

The ensemble model decision boundary using Linear SVM is shown in Figure 3. Figure 3. Decision boundary of ensemble model.
The mean and variance of the accuracy results for the 10-times-10 fold cross validation of the ensemble learning using linear SVM are reported in Table II.
TABLE II: LINEAR SVM ENSEMBLE LEARNING RESULTS

Accuracy Variance Standard Deviation
89.29% 23.98% 4.90%

linear_svm_adaboost's People

Contributors

mattcann1 avatar

Watchers

 avatar  avatar

Forkers

zhoupanyun

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.