Giter VIP home page Giter VIP logo

bioinspired-spatial-data's Introduction

Bioinspired Spatial Data

In the domain of AI & ML, images represent one of the most common and widely investigated type of data. Regardless of the specific field they belong to, images carry information hidden in their own spatial correlation.

Well-established models like CNNs can be successfully employed to disclose the relevant patterns that build such correlation.

The same idea can be applied to different data like gene expression, which might not come in form of image but that nevertheless carry information through an intrinsic spatial correlation.

Furthermore, as neuromorphic sensors have shown, this strategy can be even improved by focusing on sparse events rather than on a continuous exploitation of the whole amount of data.

In terms of software implementation, this translates into the adoption of neuro-inspired spiking CNNs, able to achieve state-of-the-art results with much smaller energy consumption.

Authors

Badges

Static Badge

Keras PyTorch TensorFlow Python Matplotlib Jupyter Notebook

Usage

PyTorch+SNNTorch: NNI experiments (local)

  1. Clone the repository
  2. Install the requirements
  3. Move to nni_configs folder
  4. Select the configuration file for the experiment you wish to perform, and then execute the following command:
    nnictl create --config <config_file>.yml --port 5001

Keras+NengoDL: NNI experiments (local)

  1. Clone the repository
  2. Install the requirements
  3. Move to src/nengo_conversion folder
  4. Execute the following comand:
    nnictl create --config nni_snn_config.yml --port 5001

Test

In test folder there are notebooks to test the code, specifically Fast-Denser net search, all the NNI experiments performed in this project and then models evaluation for Pytorch+SNNTorch pipeline. Please download it and run it on Google Colab.
NOTE: the results that comes out from Colab are slightly different in terms of accuracy and training time from the ones that come from experiments performed locally with a NVIDIA GTX 1080Ti.

Experiment log summary on PyTorch CNN + SNNTorch pipeline:

Here are the logs of the NNI experiments. Following that, a summary of the experiments and trials. In the same folder, there are also CSV file generated by Fast-Denser framework to find CNN_K.

CNN experiments for searching hyper parameters:

  • CNN_PT_1 hyperparameters: trial pOdyC
  • CNN_PT_2 hyperparameters: trial hndeI

SNN experiments (optimized with MSE Count Loss, without weight transfer):

  • QrbKOuWJ experiments on SNN_PT_2
  • 1RSZuxno experiments on SNN_PT_1

SNN experiments (optimized with Cross Entropy Count Loss, with weight transfer):

  • Z19hnw4u experiments on SNN_PT_1
    • Best accuracy: trial U6mOB
    • Best tradeoff accuracy/num_steps: trial yxecs
  • ZdQn9mbD experiments on SNN_PT_2
    • Best accuracy: trial lcOk8
    • Best tradeoff accuracy/num_steps: trial CQdzk

Experiment log summary on Fast-Denser3+Nengo-DL pipeline:

  • fykmsgad, NNI experiments on SNN_K:
    • Best accuracy: trial PJTSF

bioinspired-spatial-data's People

Contributors

peteralhachem avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.