Developing AI Inference Solutions with Vitis AI Platform

AI-INFER

Course Description

This course describes how to use the Vitis™ AI development platform
in conjunction with DNN algorithms, models, inference and training, and frameworks on cloud and edge computing platforms.
The emphasis of this course is on:
▪ Illustrating the Vitis AI tool flow
▪ Utilizing the architectural features of the Deep Learning Processor Unit (DPU)
▪ Optimizing a model using the AI quantizer and AI compiler
▪ Utilizing the Vitis AI Library to optimize pre-processing and post-processing functions
▪ Creating a custom platform and application
▪ Deploying a design
▪ Providing an overview of the Xilinx Kria™ K26 SOM and its advantages
What's New for 2.0
▪ Frameworks Supported by the Vitis AI Development Environment module: Support for 22 new models added—total of 130 models from different deep learning frameworks (Caffe, TensorFlow, TensorFlow 2, and PyTorch)
▪ Introduction to the Deep Learning Processor Unit module:
DPUCADX8G has been deprecated, and features from the
DPUCAHX8L IP have been merged with DPUCAHX8H (DPUv3E)
▪ All labs have been updated to the latest software versions

 

Level – AI 3
Course Details
▪ 2 days ILT
▪ 12 lectures
▪ 6 labs
▪ 1 demo
Price – 16 Training credits or $1600
Course Part Number – AI-INFER
Who Should Attend? – Software and hardware developers, AI/ML engineers, data scientists, and anyone who needs to accelerate their software applications using Xilinx devices
Prerequisites
▪ Basic knowledge of machine learning concepts
▪ Neural Networks Explained - Machine Learning Tutorial for Beginners: www.youtube.com/watch?v=GvQwE2OhL8I
▪ How Convolutional Neural Networks Work:
www.youtube.com/watch?v=FmpDIaiMIeA
▪ Deep learning frameworks (such as TensorFlow, PyTorch, and Caffe)
▪ Comfort with the C/C++/Python programming language
▪ Software development flow
Software Tools
▪ Vitis AI development environment 2.0
▪ Vivado Design Suite 2021.2
Hardware
▪ Architecture: Xilinx Alveo™ accelerator cards and Xilinx SoCs and ACAPs
▪ Zynq® UltraScale+™ MPSoC ZCU104*
▪ Kria KV260 Vision AI Starter Kit (optional)*

▪ MicroSD card (16 or 32 GB)
▪ Power supply (12V, 3A adapter)
▪ Camera module (AR1335 or USB webcam)
▪ 4K monitor as a display device
▪ USB microphone
▪ Cables such as Ethernet, micro-USB to USB-A, and HDMI or DisplayPort

After completing this comprehensive training, you will have the necessary skills to:
▪ Describe Xilinx machine learning solutions with the Vitis AI development environment
▪ Describe the supported frameworks, network modes, and pre-trained models for cloud and edge applications
▪ Utilize DNN algorithms, models, inference and training, and frameworks on cloud and edge computing platforms
▪ Use the Vitis AI quantizer and AI compiler to optimize a trained model
▪ Use the architectural features of the DPU processing engine to optimize a model for an edge application
▪ Identify the high-level libraries and APIs that come with the Xilinx Vitis AI Library
▪ Create a custom hardware overlay based on application requirements
▪ Create a custom application using a custom hardware overlay and deploy the design
▪ Describe the Kria K26 SOM and its advantages
▪ Customize the AI models used in the applications in the Kria K26 SOM

Course Outline

Day 1

Vitis AI Environment Overview
▪ Introduction to the Vitis AI Development Environment

Describes the Vitis AI development environment, which consists of the Vitis AI development kit, for AI inference on Xilinx hardware platforms, including both edge devices and Alveo accelerator cards. {Lecture}
▪ Frameworks Supported by the Vitis AI Development
Environment

Discusses the support for many common machine learning frameworks such as Caffe, TensorFlow, and PyTorch. {Lecture}
▪ Setting Up the Vitis AI Development Environment
Demonstrates the steps to set up a host machine for developing and running AI inference applications on cloud or embedded devices. {Demo}
ML Concepts
▪ Overview of ML Concepts

Overview of ML concepts such as DNN algorithms, models, inference and training, and frameworks. {Lecture}
Vitis AI Environment Toolchain
▪ AI Optimizer

Describes the optimization of a trained model that can prune a model up to 90%.
This topic is for advanced users and will be covered in detail in the Advanced ML training course. {Lecture}
▪ AI Quantizer and AI Compiler
Describes the AI quantizer, which supports model quantization, calibration, and fine tuning. Also describes the AI compiler tool flow. With these tools, deep learning algorithms can deploy in the Deep Learning Processor Unit (DPU), which is an efficient hardware platform running on a Xilinx FPGA or SoC. {Lecture, Labs}
Profiler
▪ AI Profiler

Describes the AI profiler, which provides layer-by-layer analysis to help with bottlenecks. Also covers debugging the DPU running result. {Lecture}
Deep Learning Processor Unit (DPU)
▪ Introduction to the Deep Learning Processor Unit (DPU)

Describes the Deep Learning Processor Unit (DPU) and its variants for edge and cloud applications. {Lecture}
▪ DPUCADX8G Architecture Overview
Overview of the DPUCADX8G architecture, supported CNN operations, and design considerations. {Lecture}
▪ DPUCZDX8G Architecture Overview
Overview of the DPUCZDX8G architecture, supported CNN operations, DPU data flow, and design considerations. {Lecture}

Day 2

AI Libraries
▪ Vitis AI Library

Reviews the Vitis AI Library, which is a set of high-level libraries and APIs built forefficient AI inference with the DPU. It provides an easy-to-use and unified interface for encapsulating many efficient and high-quality neural networks. {Lecture, Lab} Note that the edge flow version of the lab is not available in the
On-Demand curriculum because an evaluation board is required for the entirety of the lab.
Custom Hardware and Application Development
▪ Creating a Custom Hardware Platform with the DPU Using
the Vivado Design Suite Flow (Edge)

Illustrates the steps to build a Vivado Design Suite project, add the DPUCZDX8G IP, and run the design on a target board. {Lab}
▪ Creating a DPU Kernel Using the Vitis Environment Flow
(Edge)

Illustrates the steps to build a Vitis unified software platform project that adds the DPU as the kernel (hardware accelerator) and to run the design on a target board. {Lab}
▪ Creating a Vitis Embedded Acceleration Platform (Edge)
Describes the Vitis embedded acceleration platform, which provides product developers an environment for creating embedded software and accelerated applications on heterogeneous platforms based on FPGAs, Zynq® SoCs, and
Alveo data center cards. {Lecture}
▪ Creating a Custom Application (Edge)
Illustrates the steps to create a custom application, including building the hardware and Linux image, optimizing the trained model, and using the optimized model to accelerate a design. {Lab}
Kria SOM (Optional)
▪ Xilinx Kria KV260 Vision AI Starter Kit Overview

Provides an overview of the Xilinx Kria KV260 Vision AI Starter Kit, its features, and interfaces. The boot devices, heat sink, firmware, and power-on sequence for the kit are also described. {Lecture}
Customizing the AI Models
Shows how to customize the AI models used in the accelerated applications. {Lecture, Lab} 

PDF Verison


Enroll Now.

Scheduled Embedded Courses

Free Workshop! Migrating from ISE & Spartan 6 to Vivado & 7 Series
June 03 : 09:00 am - 05:00 pm
After completing this comprehensive training, you will have the necessary skills to: ▪ Analyze...

*FREE Workshop! Using Vision-based App w/ the Kria KV260 Vision AI Starter Kit & SOM
June 06 - June 07: 10:30 am - 04:00 pm
After completing this comprehensive training, you will have the necessary skills to: ▪ Describe the...

Zynq UltraScale+ MPSoC *Confirmed to run!
June 06 - June 09: 11:00 am - 05:00 pm
Course DescriptionThis course provides an overview of the capabilities and support for the Zynq®...

Designing FPGAs Using the Vivado Design Suite 3
June 09 - June 10: 09:00 am - 05:00 pm
 This course demonstrated timing closure techniques, such are baselining,...

Designing with the IP Integrator Tool
June 17 : 09:00 am - 05:00 pm
After completing this comprehensive training, you will have the necessary skills to:▪ Describe the...

Accelerating Applications with the Vitis Unified Software Environment
June 20 - June 22: 09:00 am - 05:00 pm
After completing this comprehensive training, you will have the necessary skills to:▪ Describe how...

Designing with Versal AI Engine 2:Graph Programming w/AI Engine Kernels
July 07 - July 08: 09:00 am - 05:00 pm
After completing this comprehensive training, you will have thenecessary skills to:▪ Describe the...

Zynq UltraScale+ MPSoC
July 11 - July 14: 11:00 am - 05:00 pm
EMBDZUPMPSoC Course DescriptionThis course provides an overview of the capabilities and support...

Designing w/the Xilinx Serial Transceivers
July 14 - July 15: 09:00 am - 05:00 pm
Learn how to employ serial transceivers in UltraScale™ and UltraScale+™ FPGA designs or Zynq®...

Designing with the Versal ACAP: PCI Express System
July 25 - July 26: 09:00 am - 05:00 pm
Course OutlineDay 1 ▪ Introduction to PCI ExpressIntroduces the course and discusses a few key...

Alternative Dates and Locations

Faster Technology is able to deliver both private classes at client sites and also public classes at alternate locations and dates.  If there are no currently scheduled classes listed above or if none of the classes are convenient, please tell us what dates and locations will meet your needs.  No obligation necessary.