Support multithreading in the CPU mode of Solver::Solve about caffe HOT 3 CLOSED

The codes do not have to be changed. Thanks to Michael Rutter, multi-threaded OpenBLAS package is available on all the versions of Ubuntu since Precise (12.04).
Multi-threaded OpenBLAS backported to recent Ubuntu releases
Follow the steps to take advantage of the powerful acceleration:

sudo add-apt-repository ppa:marutter/rdev
sudo apt-get update
sudo apt-get install libopenblas-base

Benchmark results are demonstrated in the related issue: #16

from caffe.

ComputeUpdatedValue() is not a big issue when doing large networks. It is the ForwardBackward() function, and the individual layers that takes the most time. Thus, parallellizing it will not give us much gain.

from caffe.

Within the ForwardBackward() computation, the convolutional layers are the ones which take most of the time (see #83) therefore parallelizing the loops there will be the most effective

from caffe.