re: Neural Engine vs. GPU about yolo-coreml-mpsnngraph HOT 3 OPEN

If you run the app and then pause it, you’ll see that CoreML is using something called ANE, which stands for Apple Neural Engine.

I think the reason MPS supports training is mostly so you can train on the Mac, and that iOS is less of a target for this.

And no, there is no public API for the Neural Engine right now. It wouldn’t be through MPS since that is just for the GPU.

from yolo-coreml-mpsnngraph.

Ah, I see. I suppose what I don't understand is why Apple chose to create a fully-functional computational graph, and then restrict this abstraction (by embedding it in MPS) to the GPU. It just feels strange. I use Tensorflow often on the CPU 🤷‍♂️

from yolo-coreml-mpsnngraph.

I think it’s more the other way around: they first had MPS kernels for doing convolutions etc. Then they realized they could add a graph API. And then even later they added a backwards pass to this API. But it’s not nearly of the same scope as TensorFlow.

from yolo-coreml-mpsnngraph.