This post was written with the help of Sanjay Doiphode, Senior Technology Executive with focus on AI and Hybrid Cloud Computing, IBM.
At AWS re:Invent 2023, IBM announced support for IBM Watsonx on AWS with support for self-managed Red Hat OpenShift and Red Hat OpenShift Service on AWS (ROSA) in Q1 of 2024. We are excited to announce that Watsonx is now supported on ROSA, a fully-managed OpenShift cloud service. This blog discusses why running Watsonx on ROSA is a great combination for using Generative AI to drive App Modernization and deliver those Cloud Native applications on AWS with ROSA.
Combining Generative AI with application modernization can reduce the developer tasks by creating up to 60% of content in a typical automation use case (IBM CIO ). Forrester Consulting also found that ROSA service on AWS can improve developer productivity by 65% faster development time and improve operational efficiency by 50% (Forrester Total Economic Impact study ) for your developer tasks. The combination can drive real business value by mixing Generative AI and an integrated application platform to deliver a complete App Modernization experience.
To start, let's ask Watsonx why you should run Watsonx on ROSA.
![Watsonx.ai prompt studio answering why Watsonx on ROSA](/rhdc/managed-files/styles/wysiwyg_full_width/private/image4_58.png.webp?itok=owbMt_kK)
Figure 1, Watsonx.ai prompt studio answering why Watsonx on ROSA
That’s a great start but let's provide a bit more clarity on Watsonx so you can get the bigger picture.
IBM Watsonx is a cognitive computing platform that uses artificial intelligence to help organizations solve complex problems. Watsonx consists of several modules that enable you to use Generative AI LLMs (Large Language Models) to help businesses gain productivity improvements with support for chatbots, customer management and app modernization code generation as 3 example use cases.
Watsonx is IBM's commercial generative AI and scientific data platform based on cloud. It offers a studio, data store, and governance toolkit, all 3 available on OpenShift and ROSA. We support multiple large language models (LLMs) including the new OpenSource IBM Granite models that IBM offers indemnification if you use. It also supports a select set of OpenSource models such as Flan, Llama and mt5 but these change dynamically or you can always import your own models.
Watsonx consists of six modules and two of the most used are Watsonx.ai and Watsonx.governance, both available on AWS. Watsonx.data has been available on ROSA for some time.
watsonx.ai™
A pre-integrated GUI based training and prompt studio to enable you to Train, validate, tune and deploy foundation and machine learning models with ease.
watsonx.governance™
A set of work flows and tools to track LLM training, model drift and document the use of models for business use cases. Watsonx.governance will accelerate responsibility, transparency and explainability in your data and AI workflows.
watsonx.data™
A framework of OpenSource data management tools that enable you to build a hybrid Data Lakehouse across your hybrid cloud data assets. With Watsonx.data you can scale analytics and AI workloads for all your data, anywhere with a data store that is open, hybrid and governed.
![Watsonx major components](/rhdc/managed-files/styles/wysiwyg_full_width/private/image3_83.png.webp?itok=Mnv0fFMz)
Figure 2 Watsonx major components
Why Red Hat OpenShift
Red Hat OpenShift Service on AWS (ROSA) is a managed OpenShift offering that automates the deployment and management of OpenShift clusters, so you can build, deploy and scale applications quickly and focus your business, not managing infrastructure.
![Asking Watsonx about Watsonx on the Chat tab](/rhdc/managed-files/styles/wysiwyg_full_width/private/image2_112.png.webp?itok=TUD0VdJx)
Figure 3 Asking Watsonx about Watsonx on the Chat tab
What makes ROSA different? ROSA is a first party solution that is jointly engineered and supported by both Red Hat and AWS that is a comprehensive pre-integrated application platform That means you can:
- Access ROSA directly within the AWS console with a self-service experience
- Contact either Red Hat or AWS for support tickets for an integrated support experience
- Integrate with a wide variety of AWS applications and services including AWS App Runner, Elastic Load Balancing, AWS Directory Service, AWS CloudWatch, AWS X-Ray, and more
- Get a single bill from AWS for both the OpenShift service and AWS infrastructure consumption for streamlined billing and procurement
- Use your AWS committed spend, negotiated discounts and entitlements to procure ROSAHave a consistent OpenShift experience across the hybrid cloud for increased flexibility
Additionally, ROSA provides a declarative managed framework for building, packaging, and deploying containerized applications. Developers have access to comprehensive tooling for consistent application delivery, which natively include CI/CD tools like OpenShift Pipelines and GitOps to enable a consistent approach to software development and delivery so you can move code to production fast.
Click here to learn watch this re:Invent 2023 session about why you should modernize applications on ROSA.
Generative AI and Application LifeCycle
Why do Watsonx and OpenShift or ROSA go great together? The workflow and pipeline for an MLOPs model preparation, model development, deployment and iterative updates is very very similar to the DevOps process followed by application development. In fact in many cases a “model” trained or tuned by Watsonx will be published into a cloud native application that will have the same characteristics of life cycle, scale needs and governance of what is developed and delivered. Combining Watsonx with an application platform like ROSA is a great combination to compound the benefits of running a Generative AI platform alongside the ROSA application platform to integrate your MLOps and DevOps workflows.
![The combined DevOps and MLOps Pipelines](/rhdc/managed-files/styles/wysiwyg_full_width/private/image1_167.png.webp?itok=bxGCmi2D)
Figure 4 The combined DevOps and MLOps Pipelines
Here are some of the key benefits of using Watsonx.ai for app modernization:
- Using LLM’s for Code Translation, Code Generation, Code Transformation and Code documentation tasks can dramatically increase the productivity of developers from 30-60% (IBM CIO link).
- With the ability to utilize the IBM/Red Hat Granite LLM model series, the built in models from OpenSource or bring your own models, you can rapidly trial, tune and build out your Generative AI capabilities to accelerate your application modernization.
Here is the Output from a model code generation and code translation task that is common for a developer working with legacy code looking to modernize an application.
![Figure 5 Watsonx.ai for Code Translation using the IBM granite-34b-code-instruct model](/rhdc/managed-files/styles/wysiwyg_full_width/private/image5_49.png.webp?itok=Wbsl5WVz)
Figure 5 Watsonx.ai for Code Generation using the codellama-34b-instruct-hf model
Now we can try the new Llama-3 with just changing the model identified in seconds.
You can quickly move between models and test out the various options and then progress directly into model tuning with your data samples.
![Watsonx.ai for Code Generation using the codellama-34b-instruct-hf model](/rhdc/managed-files/styles/wysiwyg_full_width/private/image7_26.png.webp?itok=XU01FnNh)
Figure 6 Watsonx.ai for Code Generation using the llama-3-8b-instruct
As of this sampling, here are the available models but there are many other options, or just bring your own models.
![Built in Watsonx LLM Library](/rhdc/managed-files/styles/wysiwyg_full_width/private/image5_48.png.webp?itok=gqoZPeg4)
Figure 7 Built in Watsonx LLM Library
The future of AI is OpenSource
Watsonx currently utilizes the CP4D architecture with enhancements from OpenSource projects called Ray and CloudFlare, which are built into the new Watsonx workflows. In a future release, IBM Watsonx will fully integrate with Red Hat OpenShift AI, which will not only expand the capabilities to work with Watsonx.ai, but also bring in other integrations with ROSA as well as support for a broader set of features for the App Platform and Developer integrations. IBM and Red Hat are both fully committed to the OpenSource paradigm for Watsonx, OpenShift, ROSA and Red Hat OpenShift AI.
![Watsonx, OpenShift and OpenSource integrations.](/rhdc/managed-files/styles/wysiwyg_full_width/private/image6_35.png.webp?itok=C9ZJFpci)
Figure 8 Watsonx, OpenShift and OpenSource integrations.
Other AI OpenSource announcements
On May 8th, IBM and Red Hat partnered to release the IBM Granite family of LLM’s into the OpenSoruce community that will continue the model of IBM Watsonx commitment to OpenSource and provide OpenSource access to the IBM Granite family. (IBM Granite link). Red Hat made a number of announcements at Red Hat Summit 2024 for AI integration across all of our OpenSource technologies across Podman, RHEL, Anisble, OpenShift and OpenShift AI so watch this space for more.
In Summary
This blog covered the reasons why Watsonx and Watsonx.ai with the built in foundation models are a great addition to ROSA when combining an MLOps platform with DevOps capabilities. The combination can accelerate your developer journey and bring business benefits to your organization.
Follow the Red Hat blog for more announcements about new capabilities as they roll out. The power of Generative AI combined with a fully integrated App Platform powered by OpenSource is going to be a powerful tool for retiring technical debt.
For more information:
저자 소개
Lakshman Easwaran is an Associate Principal Architect at IBM Consulting, specializing in driving application modernization initiatives with a focus on OpenShift Virtualization on IBM Fusion and Wasonx.ai. With extensive experience collaborating with Global Systems Integrator (GSI) partners, Lakshman excels in developing hybrid cloud solutions that meet the diverse needs of modern enterprises.
Anes Kim is a product marketing manager for Red Hat OpenShift cloud services and has been at Red Hat since 2020.
유사한 검색 결과
채널별 검색
오토메이션
기술, 팀, 인프라를 위한 IT 자동화 최신 동향
인공지능
고객이 어디서나 AI 워크로드를 실행할 수 있도록 지원하는 플랫폼 업데이트
오픈 하이브리드 클라우드
하이브리드 클라우드로 더욱 유연한 미래를 구축하는 방법을 알아보세요
보안
환경과 기술 전반에 걸쳐 리스크를 감소하는 방법에 대한 최신 정보
엣지 컴퓨팅
엣지에서의 운영을 단순화하는 플랫폼 업데이트
인프라
세계적으로 인정받은 기업용 Linux 플랫폼에 대한 최신 정보
애플리케이션
복잡한 애플리케이션에 대한 솔루션 더 보기
오리지널 쇼
엔터프라이즈 기술 분야의 제작자와 리더가 전하는 흥미로운 스토리
제품
- Red Hat Enterprise Linux
- Red Hat OpenShift Enterprise
- Red Hat Ansible Automation Platform
- 클라우드 서비스
- 모든 제품 보기
툴
체험, 구매 & 영업
커뮤니케이션
Red Hat 소개
Red Hat은 Linux, 클라우드, 컨테이너, 쿠버네티스 등을 포함한 글로벌 엔터프라이즈 오픈소스 솔루션 공급업체입니다. Red Hat은 코어 데이터센터에서 네트워크 엣지에 이르기까지 다양한 플랫폼과 환경에서 기업의 업무 편의성을 높여 주는 강화된 기능의 솔루션을 제공합니다.