Comments (4)
Hi,
according to the SNNS user manual
(http://www.ra.cs.uni-tuebingen.de/downloads/SNNS/SNNSv4.2.Manual.pdf),
bias is doing the following:
bias: In contrast to other network simulators where the bias (threshold)
of a unit is simulated by a link weight from a special 'on'-unit, SNNS
represents it as a unit parameter. In the standard version of SNNS the
bias determines where the activation function has its steepest ascent.
(see e.g. the activation function Act logistic).
Learning procedures like backpropagation change the bias of a unit like
a weight during training.
Does this answer your question?
Regards,
Christoph
On 14/07/2016 3:38 PM, Lucas Venezian Povoa wrote:
I noticed that bias are not applied in a conventional manner in a
Multilayer Perceptron model. It is not clear how the feedforward step
applies bies between the layer and their neurons.Please, could you explain how they work?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
#6, or mute the thread
https://github.com/notifications/unsubscribe/AAf_Gsj4pcDDffvk6ciH25EuJJ2HcBBRks5qVcs5gaJpZM4JMGSw.
from rsnns.
Hi Christoph,
Thank you for attention. It answered my question, but I have another point to ask about. I implemented the feedforward step and applied the weights and bias of a mlp trained using RSNNS.
$fullWeightMatrix
Input_p Input_q Input_lo Hidden_2_1 Hidden_2_2 Hidden_2_3 Hidden_2_4 Hidden_2_5 Hidden_2_6 Output_target
Input_p 0 0 0 -1.7307487 6.173544 1.265264 -5.3201742 0.9761125 6.169746 0.000000
Input_q 0 0 0 -1.8996859 6.228392 1.243880 -5.4633279 0.6697564 6.095452 0.000000
Input_lo 0 0 0 0.3186978 -5.617334 -4.962238 0.5265539 0.1827270 -5.520674 0.000000
Hidden_2_1 0 0 0 0.0000000 0.000000 0.000000 0.0000000 0.0000000 0.000000 -1.564677
Hidden_2_2 0 0 0 0.0000000 0.000000 0.000000 0.0000000 0.0000000 0.000000 10.262736
Hidden_2_3 0 0 0 0.0000000 0.000000 0.000000 0.0000000 0.0000000 0.000000 -10.078181
Hidden_2_4 0 0 0 0.0000000 0.000000 0.000000 0.0000000 0.0000000 0.000000 -8.505977
Hidden_2_5 0 0 0 0.0000000 0.000000 0.000000 0.0000000 0.0000000 0.000000 2.194988
Hidden_2_6 0 0 0 0.0000000 0.000000 0.000000 0.0000000 0.0000000 0.000000 -10.033887
Output_target 0 0 0 0.0000000 0.000000 0.000000 0.0000000 0.0000000 0.000000 0.000000
$unitDefinitions
unitNo unitName unitAct unitBias type posX posY posZ actFunc outFunc sites
1 1 Input_p 0.000000e+00 0.16126040 UNIT_INPUT 1 0 0 Act_Identity Out_Identity
2 2 Input_q 0.000000e+00 -0.28681308 UNIT_INPUT 2 0 0 Act_Identity Out_Identity
3 3 Input_lo 1.000000e+00 -0.02067816 UNIT_INPUT 3 0 0 Act_Identity Out_Identity
4 4 Hidden_2_1 4.247330e-01 -0.62207133 UNIT_HIDDEN 1 2 0 Act_Logistic Out_Identity
5 5 Hidden_2_2 3.001675e-02 2.14181113 UNIT_HIDDEN 2 2 0 Act_Logistic Out_Identity
6 6 Hidden_2_3 9.972194e-01 10.84456730 UNIT_HIDDEN 3 2 0 Act_Logistic Out_Identity
7 7 Hidden_2_4 7.922895e-01 0.81222737 UNIT_HIDDEN 4 2 0 Act_Logistic Out_Identity
8 8 Hidden_2_5 5.398569e-01 -0.02296048 UNIT_HIDDEN 5 2 0 Act_Logistic Out_Identity
9 9 Hidden_2_6 7.310683e-05 -4.00284147 UNIT_HIDDEN 6 2 0 Act_Logistic Out_Identity
10 10 Output_target 3.699642e-06 3.45435309 UNIT_OUTPUT 1 4 0 Act_Logistic Out_Identity
I noticed the unitAct
is not used in the feedforward step and that biases associated to the input units are not used. But why biases for the input units are calculated? And what is unitAct
role?
from rsnns.
Hi,
unitAct is the current activation of that unit, i.e., its current
output. That obviously changes with each pattern/vector of inputs, so it
is probably the activation of the last pattern that was used.
The input units use Act_Identity, which doesn't have bias. If you want
to use bias, you'll have to use Act_IdentityPlusBias.
Regards,
Christoph
On 07/19/2016 08:12 AM, Lucas Venezian Povoa wrote:
Hi Christoph,
Thank you for attention. It answered my question, but I have another
point to ask about. I implemented the feedforward step and applied the
weights and bias of a mlp trained using RSNNS.$fullWeightMatrix
Input_p Input_q Input_lo Hidden_2_1 Hidden_2_2 Hidden_2_3 Hidden_2_4 Hidden_2_5 Hidden_2_6 Output_target
Input_p 0 0 0 -1.7307487 6.173544 1.265264 -5.3201742 0.9761125 6.169746 0.000000
Input_q 0 0 0 -1.8996859 6.228392 1.243880 -5.4633279 0.6697564 6.095452 0.000000
Input_lo 0 0 0 0.3186978 -5.617334 -4.962238 0.5265539 0.1827270 -5.520674 0.000000
Hidden_2_1 0 0 0 0.0000000 0.000000 0.000000 0.0000000 0.0000000 0.000000 -1.564677
Hidden_2_2 0 0 0 0.0000000 0.000000 0.000000 0.0000000 0.0000000 0.000000 10.262736
Hidden_2_3 0 0 0 0.0000000 0.000000 0.000000 0.0000000 0.0000000 0.000000 -10.078181
Hidden_2_4 0 0 0 0.0000000 0.000000 0.000000 0.0000000 0.0000000 0.000000 -8.505977
Hidden_2_5 0 0 0 0.0000000 0.000000 0.000000 0.0000000 0.0000000 0.000000 2.194988
Hidden_2_6 0 0 0 0.0000000 0.000000 0.000000 0.0000000 0.0000000 0.000000 -10.033887
Output_target 0 0 0 0.0000000 0.000000 0.000000 0.0000000 0.0000000 0.000000 0.000000$unitDefinitions
unitNo unitName unitAct unitBias type posX posY posZ actFunc outFunc sites
1 1 Input_p 0.000000e+00 0.16126040 UNIT_INPUT 1 0 0 Act_Identity Out_Identity
2 2 Input_q 0.000000e+00 -0.28681308 UNIT_INPUT 2 0 0 Act_Identity Out_Identity
3 3 Input_lo 1.000000e+00 -0.02067816 UNIT_INPUT 3 0 0 Act_Identity Out_Identity
4 4 Hidden_2_1 4.247330e-01 -0.62207133 UNIT_HIDDEN 1 2 0 Act_Logistic Out_Identity
5 5 Hidden_2_2 3.001675e-02 2.14181113 UNIT_HIDDEN 2 2 0 Act_Logistic Out_Identity
6 6 Hidden_2_3 9.972194e-01 10.84456730 UNIT_HIDDEN 3 2 0 Act_Logistic Out_Identity
7 7 Hidden_2_4 7.922895e-01 0.81222737 UNIT_HIDDEN 4 2 0 Act_Logistic Out_Identity
8 8 Hidden_2_5 5.398569e-01 -0.02296048 UNIT_HIDDEN 5 2 0 Act_Logistic Out_Identity
9 9 Hidden_2_6 7.310683e-05 -4.00284147 UNIT_HIDDEN 6 2 0 Act_Logistic Out_Identity
10 10 Output_target 3.699642e-06 3.45435309 UNIT_OUTPUT 1 4 0 Act_Logistic Out_IdentityI noticed the |unitAct| is not used in the feedforward step and that
biases associated to the input units are not used. But why biases for
the input units are calculated? And what is |unitAct| role?—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
#6 (comment), or
mute the thread
https://github.com/notifications/unsubscribe-auth/AAf_GmyKBNaqLILY3BeeWcpTeMm8566Xks5qW_o-gaJpZM4JMGSw.
from rsnns.
Thank you, Christoph.
from rsnns.
Related Issues (19)
- RBF sites/links handling HOT 1
- How to implement a time-delay neural network using RSNNS? HOT 5
- Loading *.pat files HOT 1
- Where is old `loadNet()` HOT 1
- How to assign new learning algorithm ? HOT 1
- Unable To access repository for package installation in R HOT 1
- Activation Functions about RELU HOT 5
- Different results using Windows or Linux HOT 1
- Jordan segfault when used with more than one layer
- plotting function HOT 2
- Doubt about the forecast with RSNNS
- How to show the values of hidden nodes in a mlp model HOT 3
- Is it possible to use the RSNNS library to perform RBF interpolation when the target output is longer than the input? HOT 6
- predict method for pruned networks HOT 5
- A question for installing RSNNS HOT 4
- R crashes upon running mlp() HOT 3
- Explanation for a command HOT 2
- Suggestion of init method HOT 9
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from rsnns.