Generative AI at the edge extends AI from data centres to the real world

Rockwell Automation has announced a “breakthrough” that brings generative AI directly to the industrial edge, using Nvidia’s Nemotron Nano – a small language model (SLM) that has been optimised for Rockwell’s FactoryTalk Design Studio platform and other Rockwell products, thus marking “a major step in real-time industrial intelligence”.
In collaboration with Nvidia, Rockwell is using the open-source Nemotron-Nano-9B-v2 model and NVvidia NeMo to deliver an edge-based generative AI capability aimed specifically at industrial environments. Nemotron Nano provides the basis for an SLM that can run in edge environments with low space and power requirements. Rockwell is fine-tuning the model with data used by its FactoryTalk Design Studio Copilot.
The new model – built for use across design, development, production and maintenance operations – runs on HMI panels, industrial appliances, desktop IDEs (integrated development environments), and server or private cloud environments. It supports both edge and air-gapped deployments, and is claimed to offer better reasoning, predictability and responsiveness than other SLMs.
Early evaluations are said to have demonstrated the model achieving reasoning, parallel processing and key performance breakthroughs. The results highlight that it is a good fit for industrial edge applications where instant responsiveness, data security and offline operation are needed.
“Industrial automation demands AI that works reliably at the edge and in secure environments,” says Rockwell’s FactoryTalk Design Studio business manager, Tony Carrara. “By fine-tuning the open Nvidia Nemotron model with FactoryTalk Design Studio data, we’re creating solutions that can be deployed anywhere to help our customers accelerate workflows without compromising predictability or control.”
“Small language models like Nvidia Nemotron Nano bring real-time intelligence to where decisions are made – from factory floors to power grids,” adds Joey Conway, Nvidia’s senior director for enterprise generative AI software. “With Nvidia Nemotron Nano, enterprises using Rockwell FactoryTalk Design Studio can deploy AI in environments with limited space and power, extending AI from data centres into the heart of real-world operations.”

