Microsoft is pushing AI to the farthest edge – Stacey on IoT | Internet of Things news and analysis
The edge is a tough place for machine learning, or “ML”. There are two elements associated with it: training the model, which requires a lot of processing power and data, and implementing the model, which just requires the model to parse incoming data to see if it matches or not. That second step, called inference, is what companies have been doing at the edge all along. To do so, they are usually using pretty powerful CPUs, clusters of ARM Cortex A-class processors, or even specially designed silicon.