Enclustra FPGA Solutions | Real-Time Edge AI for Robotics with Enclustra Pluto XZU20 | Real-Time Edge AI for Robotics with Enclustra Pluto XZU20

Real-Time Edge AI for Robotics with Enclustra Pluto XZU20

Hero image for a success story about real-time AI for Robotics with Enclustra Pluto XZU20

Modern robotic systems rely on cameras, sensors, and AI models to understand their environment and react to it in real time.

But deploying AI in robotics requires more than running a neural network. A complete perception platform must acquire data from multiple sources, process it locally, coordinate AI workloads, communicate results to the rest of the system, and provide an effective way to develop and validate the complete workflow.

Why Edge AI Matters in Robotics

Robotic perception often involves continuous streams of sensor and video data. Processing this information directly on the embedded platform reduces the need to transfer raw data to external computing infrastructure continuously and makes AI results available close to the machine.

The architecture combines:

  • local AI inference;
  • low-latency access to perception results;
  • integration of sensor interfaces, processing and programmable logic;
  • multi-model AI pipelines;
  • connectivity with robotic software and external systems;
  • virtual development and validation through ALOE.

Enclustra and MakarenaLabs combine the Enclustra Pluto XZU20, based on the AMD Zynq™ UltraScale+™ MPSoC, with MakarenaLabs MuseBox and the ALOE digital-twin environment to create a flexible reference architecture for real-time Edge AI and robotic perception.

The result is an embedded platform that connects sensors, adaptive computing, AI processing, and digital-twin visualization in a single workflow. The platform provides the building blocks required to develop intelligent perception directly at the edge.

Pluto XZU20: the Tiny Titan for Intelligent Robotics

At the heart of the architecture is the Enclustra Pluto XZU20, an ultra-compact System-on-Module built around the AMD Zynq™ UltraScale+™ MPSoC.

Its heterogeneous architecture combines embedded processing with programmable FPGA logic, allowing sensor interfaces, application software, deterministic processing, and accelerated workloads to coexist on the same platform.

With an ultra-compact form factor of only 30 × 30 mm, the Pluto XZU20 provides a flexible hardware foundation for embedded systems where size, integration, and local processing capabilities are critical.

For robotics developers, this means that camera and sensor acquisition, AI processing, and application logic can be integrated close to the physical system rather than distributed across multiple external computing platforms.

MuseBox: Edge AI from Sensor Input to Application Output

MuseBox, developed by MakarenaLabs, is the Edge AI orchestration layer running on the embedded platform.

Rather than treating AI inference as an isolated task, MuseBox manages the complete data-processing pipeline:

Data acquisition → preprocessing → AI inference → post-processing → data routing → application output

Inputs can originate from cameras, sensors, video streams, and other live data sources. AI workloads are executed locally, and their results can be delivered to robotic software, dashboards, external applications, or other system components.

For robotics applications, MuseBox can provide:

  • live camera and sensor acquisition;
  • low-latency local processing;
  • coordination of multiple AI models;
  • hardware-accelerated inference;
  • preprocessing and post-processing pipelines;
  • ROS/ROS2, MQTT and ZMQ connectivity;
  • visual pipeline configuration through the MuseBox No-Code GUI;
  • operation without a mandatory cloud dependency.

This transforms the Pluto XZU20 from a computing module into the execution platform for the complete robotic perception pipeline.

Concept of a real-time robotics pipeline orchestrated through the MuseBox No-Code GUI

ALOE: Connecting Embedded AI with a Digital Twin

ALOE – ArtificiaL peOplE – is MakarenaLabs' simulation and digital-twin environment. It provides configurable virtual environments that can be used for AI development, benchmarking and system validation. Scenes can include virtual cameras, environmental conditions, physical behaviour and repeatable scenarios.

This makes it possible to develop and evaluate perception pipelines using controlled virtual environments while keeping the same Edge AI architecture used with physical cameras and sensors.

ALOE can support workflows such as synthetic visual data generation, reproduction of repeatable scenarios, AI benchmarking and validation, perception pipeline testing under different environmental conditions, visualization of AI results and system state, and information exchange with external hardware and software.

For robotics development, this creates a bridge between the physical embedded platform and a configurable virtual world.

From Physical Sensors to Real-Time Robotic Perception

The complete architecture brings together sensor acquisition, adaptive computing, AI orchestration and digital-twin integration.

Physical Cameras / Sensors

Enclustra Pluto XZU20
AMD Zynq UltraScale+ MPSoC

MuseBox Edge AI Runtime

AI Results / Perception Data

Robot or Application Logic / ROS2 / ALOE / External Systems

The Pluto XZU20 serves as the embedded computing bridge between the physical sensors and the AI runtime, handling sensor interfacing, deterministic processing, and hardware-accelerated workloads close to the robot. MuseBox handles the embedded AI workflow, while ALOE can be used as both a visualization environment and a source of controlled simulated scenarios for development and validation.

This allows developers to move between virtual scenarios and physical sensors while keeping the core perception architecture consistent.

Target Applications in Robotics

  • Autonomous and Mobile Robotics

    Live camera and sensor streams can be processed locally to provide environmental awareness to autonomous or remotely operated platforms.

    Typical perception tasks can include object detection, person detection, tracking, scene understanding and obstacle or environment awareness.
  • Robotic Inspection

    Embedded vision and AI can be used to inspect products, infrastructure or environments directly on the robotic platform.

    Potential applications include visual inspection, anomaly detection, object identification, quality control and condition monitoring.
  • Human-Aware Robotics

    AI perception can provide information about people and activity around a robotic system through tasks such as person detection, pose estimation, tracking, event recognition and environment classification.
  • Digital-Twin-Assisted Development

    ALOE can provide repeatable simulated environments for testing Edge AI pipelines before or alongside validation with physical sensors.

Developers can reproduce different scenes and operating conditions, compare perception behaviour, and evaluate the same embedded AI pipeline across controlled scenarios.

Conceptual SoC architecture for the LeakCam600 showing FPGA preprocessing, AXI bridge, CPU, MIPI camera and display interfaces, and DDR memory. Target Applications in Robotics

Are you developing intelligent robotics that need a real-time Edge AI solution? Contact our team to learn how the Pluto XZU20 + MuseBox & ALOE can help accelerate your next robotic perception project.