Giter VIP home page Giter VIP logo

multi-label-friedman-nemenyi's Introduction

MULTILABEL FRIEDMAN NEMENYI

Compute Friedman and Nemenyi Statistical Tests for Multilabel Classification

SCRIPTS

This source code has the following R scripts

  1. libraries.r
  2. utils.r
  3. ranking.R
  4. Friedman-Nemenyi-v1.R
  5. Friedman-Nemenyi-v2.R
  6. radar_plots.R
  7. example_fn.R
  8. example_radar.R

BEFORE RUNNING

The ranking.R generates the rankings for each of the multilabel measures according to their best value as follow:

Measure Best Value
accuracy 1.0
average-precision 1.0
clp 0.0
coverage 0.0
f1 1.0
hamming-loss 0.0
macro-auc 1.0
macro-f1 1.0
macro-precision 1.0
macro-recall 1.0
margin-loss 0.0
micro-auc 1.0
micro-f1 1.0
micro-precision 1.0
micro-recall 1.0
mlp 0.0
one-error 0.0
precision 1.0
ranking-loss 0.0
recall 1.0
subset-accuracy 1.0
wlp 0.0

The Friedman-Nemenyi_v1.R uses the tsutils package, while Friedman-Nemenyi_v2.R uses the scmamp package.

This source code does not provide the installation of any of the packages used, therefore, you must install the libraries used. Check libraries.R.

The scmamp package can give some installation headaches. For newer versions of R it is not available, so it is necessary to force the installation manually. Consult here and [here] (http://cran.nexr.com/web/packages/scmamp/index.html) all necessary dependencies and I suggest you to install via tar.gz.

CSV FILES

For this code to work correctly, the files must be provided in CSV format. This code was developed to work with the 22 multi-label assessment measures. You can provide just one CSV file, or all 22 files (one for each measure). The CSV file format of the assessment measure should be as follows:

Dataset Method_1 Method_2 .... Method_n
dataset_1
dataset_1
.........
dataset_n

Along with this code are provided examples of csv files in the DATA folder

RADAR PLOTS

You can generate radar plots for your data. An example is provided in example_radar.R

HOW TO USE THIS CODE

You can see an example of how to use this code by referring to the example_fn.R.

ACKNOWLEDGMENT

This study is financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - Brasil (CAPES) - Finance Code 001

LINKS

| Post-Graduate Program in Computer Science | Computer Department | Biomal | CAPES | Embarcados | Read Prensa | Linkedin Company | Linkedin Profile | Instagram | Facebook | Twitter | Twitch | Youtube |

REPORT ERROR

Please contact me: [email protected]

THANKS

multi-label-friedman-nemenyi's People

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.