Event Overview
Accelerate MLOps with our hybrid cloud platform
Red Hat open hybrid cloud powered by containers and Kubernetes enables a self-service cloud experience for data scientists. It helps accelerate compute-intensive modeling & inferencing tasks, and enable DevOps for MLOps for streamlining delivery of AI-powered intelligent applications, anywhere.
AiX Keynote
Data Science Software Acceleration at the Edge
Tuesday, May 9, 2023 | 9:00 am EDT
Audrey Reznik Guidera, Senior Principal Software Engineer, Red Hat
How can you accelerate software at the Edge? We are all familiar with being able to accelerate model learning and training through the use of GPU Acceleration, built-in processors and embedded software. With limited CPU, memory and storage at the edge, these traditional approaches to acceleration can be a challenge. And it’s not only at the ‘model and application level’ where software can be accelerated. We can also accelerate software by improving our infrastructure management and deployment methods (e.g. OS image generation and management).
Some scientists have turned to pruning and quantizing their larger models which can make the models smaller and easier to deploy to the Edge. Although pruning and quantization can produce more performant models, the models themselves can be less accurate. And model accuracy is something that many companies can not sacrifice. What options are left? In this session, we will look at current model training and execution at the edge and examine interesting acceleration alternatives in the areas of data augmentation and data curration strategies, containerized models and applications.
SPEAKING SESSIONS
Tuesday, May 9 |
||||
---|---|---|---|---|
9:00 a.m. EDT |
AiX Keynote: Data Science Software Acceleration at the Edge(Ballroom A) How can you accelerate software at the Edge? We are all familiar with being able to accelerate model learning and training through the use of GPU Acceleration, built-in processors and embedded software. With limited CPU, memory and storage at the edge, these traditional approaches to acceleration can be a challenge. And it’s not only at the ‘model and application level’ where software can be accelerated. We can also accelerate software by improving our infrastructure management and deployment methods (e.g. OS image generation and management). Some scientists have turned to pruning and quantizing their larger models which can make the models smaller and easier to deploy to the Edge. Although pruning and quantization can produce more performant models, the models themselves can be less accurate. And model accuracy is something that many companies can not sacrifice. What options are left? In this session, we will look at current model training and execution at the edge and examine interesting acceleration alternatives in the areas of data augmentation and data curration strategies, containerized models and applications. Audrey Reznik Guidera, Senior Principal Software Engineer, Red Hat |
|||
3:45 p.m. EDT |
In-Person Workshop: AI/ML, Edge Computing and 5G in action: anatomy of an Intelligent Agriculture architecture!(Room 307) Whether or not Henry Ford really said: “If I had asked people what they wanted, they would have said faster horses.”, the quote encapsulates the spirit of true innovation, and the idea of leap-frogging changes. So if you are striving to improve and optimize business processes, you might find yourself dealing with new technologies like Drones, Edge Computing, 5G, AI, DevOps or GitOps. This workshop is based on a precision agriculture scenario and demo featuring drones, 5G slices, Edge computing, Computer vision, and Operations Research. All of it orchestrated and developed on OpenShift and OpenShift Data Science. In this zero-to-hero workshop, we will learn how to mix all those ingredients and will go in-depth in the different aspects of an innovative end-to-end architecture that can also be applied to other fields like Smart Cities, Industrial IoT, Telehealth and many more. Guillaume Moutier, Senior Principal Data Engineering Architect, Red Hat |
Wednesday, May 10 |
||||
---|---|---|---|---|
3:35 p.m. EDT |
Virtual Session: Using AI to detect Anomalies in Robotics at the EdgeReal time detection, alerting and remediation of product, equipment and behavioural anomalies can be challenging in cross-industry edge scenarios: Manufactacturing plants (faulty equipment and product imperfections); Retail outlets (faulty product, foot traffic, shoplifting); Transportation hubs and vehicles (equipment maintenance, goods and packaging); Mining sites, oilfields and wind farms (faulty or unsafe equipment degradation). In concert with Red Hat partner Guise.ai we will demonstrate an AI based edge solution that addresses these challenges such as eliminating false-positives amongst a myriad of permutations of allowed and OK scenarios. We will showcase an end-to-end solution that does: Real-time anomaly detection at the edge; AI model training; Model Optimization; MLOPs. Our architecture is: Scalable to cover deployment to multiple edge locations; Extensible to cater for many different edge use cases. The solution will show how Red Hat enables customers and partners to win with a consistent approach across core, edge and cloud. Tom Corcoran, Principal Specialist Solution Architect, Red Hat Andreas Spanner, Senior Principal Chief Architect, Red Hat Arslan Khan, Account Solution Architect, Red Hat Andy Yuen, Senior Specialist Solution Architect, Red Hat |
|||
11:00 a.m. EDT |
Expo Product Demo: What’s the Deal? Creating an Intelligent Coupon App for Retail Shopping(Demo Theater B) Have you ever wandered into a department store and wondered if the item you are looking at is on sale? What if you had the ability to scan the item ‘yourself’ and determine if it was discounted? That ‘ability’ would make your shopping experience easier as you would not have to wait for customer service to look up your item. You would have the ability to find merchandise discounts, yourself, as you browse through the department store! In this session we will examine the model development, training and deployment process we used to create a discount coupon app that is executed from an edge device - your phone. Join us as we walk you through the model development and deployment lifecycle, including topics of object vision, containerizing models, data streaming and MLOps. At the end of the session, you can try the app yourself. Kaitlyn Abdo, Associate Technical Product Marketing Manager, Red Hat |
Demos
Join us for demos at the Red Hat booth
Red Hat is pleased to offer scheduled demos at our booth at ODSC East.
Tuesday, May 9th
10:45 am Using Projects in RHODS
12:15 pm Model Serving in RHODS
1:45 pm Using GPUs in RHODS
3:30 pm KF Pipelines for RHODS
Wednesday, May 10th
10:45 am Using OpenVINO in RHODS
12:15 pm Model Serving in RHODS
1:45 pm Using GPUs in RHODS
3:30 pm Using Projects in RHODS
5:15 pm Model Serving in RHODS
Red Hat & SAS
Bringing advanced analytic capabilities to the hybrid cloud
Red Hat OpenShift and SAS are bringing the latest DataOps, AI and ModelOps capabilities to the leading enterprise Kubernetes platform, built for your open, hybrid cloud strategy.
Red Hat & NVIDIA
Accelerate AI with NVIDIA and Red Hat
Red Hat and NVIDIA are collaborating to enable the latest technological innovations. We share a vision of an IT future fueled by cloud-native, open source technologies where our customers can use familiar infrastructure on many footprints, from virtualized and private cloud deployments in corporate datacenters, to massive-scale services on public clouds, and all the way to the edge.
Read the solution brief to learn more about NVIDIA AI Enterprise on Red Hat OpenShift.