This repository contains the Caffe definition files used for our paper 'Modeling the Temporal Nature of Human Behavior for Demographics Prediction' that was published at ECML-PKDD 2017. Below is a short description on how to use our ConvNet architecture in Caffe.

First you will need to output the fitting 'week-matrix' data representation. It is implemented in the bandicoot toolbox, which can be found at bandicoot.mit.edu. The data then needs to be normalized and outputted to a fitting Caffe format such as HDF5. You should add the relevant paths to the datasets at the top of the prototxt files under source.

We use Bayesian optimization to find a good set of hyperparameters for our ConvNet (see the paper for more details). Our Caffe definition files do therefore not include these parameters. To use our ConvNet architecture you must therefore insert these hyperparameters into the prototxt files at the lines marked with <insert>.

You should be good to go once the solver.prototxt and prototxt files for the architecture have been adjusted according to your hyperparameters and file structure. Any version of Caffe released after September 1, 2015 should be able to use the ConvNet architecture. Examples of how to train and run a model in Caffe can be found at https://github.com/BVLC/caffe.

A pretrained model for age or gender prediction can be loaded as net = caffe.Net(path_prototxt, path_pretrained) using the .prototxt and .caffemodel files provided in this repository. These pretrained models can be used for feature extraction using net.blobs[layer_name].data, where layer_name is the name of the layer that you want to extract features from. These features can then be fed into an SVM for classification (see the paper).

Feel free to send any questions to Bjarke Felbo (bfelbo.com) or Yves-Alexandre de Montjoye (demontjoye.com).