Does nnom support siamese model? about nnom HOT 8 OPEN

I am afraid not yet.
NNoM only supports one input currently but siamese has 2 input.
If there is a strong need for multiple inputs, I can plan for it in the next version.
Image processing is not the main focus for NNoM, but I am happy to discuss.

from nnom.

I try to achieve fingerprint comparison on a very low-cost MCU. It has only 70KB ram. At present, only this Siamese network is found. The accuracy is good, so it is necessary to quantify the network parameters，for that limited MCU. I have only one year's experience in neural network. I don't know what better network structure with smaller precision can be recommended?

from nnom.

Fingerprint comparison sounds quite interesting.
If you separate the whole Siamese into 3 models, you should be able to use the current nnom to run it.

Perform 2 image with the identical Conv net model, then sub their output manually. Then pass the number to another NN for ranking.

from nnom.

Yes, that's the essence of Siamese network. Thank you for drawing such a detailed picture. I'm going to try it. At the same time, I have seen your octave conv example, which is very enlightening. I also want to try it to see if it can achieve or surpass the classic SIFT algorithm.

from nnom.

When we try to train the Siamese network, the input is img1, img2, and the label is 1 or 0, which is manually marked in advance. If we split it into two models from the subtract layer and train them separately, then the label of the previous model doesn't know how to do this?

from nnom.

One would train the Siamense network jointly. But use the 3 individual pieces when doing inference. Might want to prototype/test it in Python before translating to C using nnom.

from nnom.

When we try to train the Siamese network, the input is img1, img2, and the label is 1 or 0, which is manually marked in advance. If we split it into two models from the subtract layer and train them separately, then the label of the previous model doesn't know how to do this?

You may try this method:

Build and train the model as you did in keras.
After that, you can create 2 new models out of the one you trained. One for the image processing part and the other for the ranking.
layer_model = Model(inputs=model.input, outputs=layer.output)

This is a ref how creating a sub model out of an existing model is done.

from nnom.

This has been answered, and should be closed. CC @majianjia

from nnom.