Scalable, resilient, highly performant storage. Today’s businesses need it, particularly for data-intensive workloads like analytics, artificial intelligence (AI), and machine learning (ML). All these workloads can significantly tax their underlying infrastructure, and scalable, high-performance storage lets organizations achieve their goals across multiple workload categories, including:
-
Data at rest (e.g., databases, data warehouses, and data lakes), which requires increased scalability, performance, and resilience.
-
Data on the move (e.g., automated data pipelines), which needs infrastructure that cuts the time needed to get to the right set of data.
-
Data in action (e.g., continuous integration and development [CI/CD], data analytics, and AI/ML), which requires ways to accelerate processes and increase the self-reliance of analysts and developers.
Start with a storage solution
Before a company embraces a storage solution, though, it’s important for that company to understand both the performance potential of that solution, as well as the workload-specific performance characteristics of the chosen infrastructure platform.
Red Hat Ceph Storage is a robust, software-defined storage solution that offers scalability, simplicity, and security features for workloads that include data analytics, media repositories, content streaming, and both OpenStack and OpenShift cloud infrastructures. Unlike many other software-defined storage solutions, Red Hat Ceph Storage supports block, object, and file storage, allowing support for a wide range of workloads and applications.
However, the performance of Red Hat Ceph Storage, like any software-defined storage, can be affected by processors, memory, and networking, as well as by the underlying storage media.
Test performance with storage media
Red Hat and Micron worked closely together to develop and evaluate Red Hat Ceph Storage solutions built with Micron all-flash storage, and Micron recently published reference architectures based on both Micron 9300 MAX NVMe SSDs and Micron 7300 MAX NVMe SSDs. Our testing used storage servers equipped with dual AMD EPYC 7002 series processors.
Storage servers with Micron 9300 MAX NVMe SSDs
The Micron 9300 MAX NVMe SSD provides high performance with low latencies. It offers capacities up to 12.8TB and 32 NVMe namespaces while consistently providing read and write throughput of up to 3.5 GB/s of sequential data.
The reference architecture using Micron 9300 Max NVMe SSDs and Red Hat Ceph Storage consumes six rack units, composed of one Ceph monitor node, four Ceph data nodes, and an Ethernet switch. Capacity per rack unit (RU) is maximized with 10 12.8TB NVMe SSDs per 1RU storage node.
Using this reference architecture as a starting point, administrators can add data nodes, one rack unit and 128TB at a time. Block and object performance using Micron 9300 MAX NVMe SSDs and Red Hat Ceph Storage is detailed in these tables.
I/O profile |
IOPS |
Average latency |
100% read |
3,161,146 |
1.31ms |
70%/30% read/write |
1,325,888 |
Write: 6.2ms Read: 1.82ms |
100% write |
645,655 |
6.44ms |
I/O profile |
Throughput |
Average latency |
100% sequential read |
41.03GiB/s |
29.81ms |
100% random read |
43.77GiB/s |
27.92ms |
100% random write |
19.15GiB/s |
6.44ms |
More detailed information can be found in the Micron blog describing this work, as well as in the full reference architecture utilizing Micron 9300 MAX NVMe SSDs.
Storage servers with Micron 7300 MAX NVMe SSDs
The Micron 7300 MAX NVMe SSD is an option for a lower-cost Ceph Storage solution that still provides strong performance. The Micron 7300 mainstream NVMe SSD family offers capacities of up to 8TB with up to 3GB per second of read throughput and 1.9GB per second of write throughput.
Using the latest version of Red Hat Ceph Storage, the Micron 7300 enables more organizations to gain access to the performance of NVMe SSDs within a smaller budget. Block and object performance achieved in the reference architecture using the Micron 7300 MAX NVMe SSDs and Red Hat Ceph Storage is provided in these tables.
I/O profile |
IOPS |
Average latency |
100% read |
2,970,481 |
1.42ms |
70%/30% read/write |
1,289,009 |
Write: 5.89ms Read: 2.08ms |
100% write |
558,373 |
6.34ms |
I/O profile |
Throughput |
Average latency |
100% sequential read |
41.22GiB/s |
29.67ms |
100% random read |
43.77GiB/s |
27.91ms |
100% random write |
21.8GiB/s |
57.59ms |
More detailed information on this testing can be found in the Micron blog describing this work, as well as the reference architecture utilizing Micron 7300 MAX NVMe SSDs.
Understand the platform impact
The impressive block and object workload performance demonstrated by Red Hat Ceph Storage in these Micron reference architectures has broad implications for accelerating the latest container-based workloads in Red Hat OpenShift Container Platform.
As a broad trend, hybrid cloud platforms like Red Hat OpenShift Container Platform are rapidly replacing vertically integrated frameworks, and general-purpose infrastructure is replacing specialized data-processing infrastructure. To accelerate and inform their insights, data scientists are embracing technologies like Jupyter notebooks, Tensorflow, Pytorch, Apache Spark, and Starburst Enterprise for Presto. In these, containers and Red Hat OpenShift Container Storage play an increasingly vital role.
Red Hat OpenShift Container Storage is software-defined storage for containers—specifically engineered as the data and storage services platform for Red Hat OpenShift. Starting with Red Hat OpenShift Container Storage 4.5, an “external mode” option effectively decouples storage, allowing the Red Hat OpenShift Container Platform cluster to access an external Red Hat Ceph Storage cluster as the storage provider.
A standalone Red Hat Ceph Storage cluster built on Micron accelerated all-flash storage can now provide scalability, resilience, and data performance to multiple Red Hat OpenShift Container Platform clusters, helping to accelerate and scale the container-based applications running there.
Harness the power of Micron and Ceph
All-flash storage from Micron, coupled with Red Hat Ceph Storage, is a compelling technology combination that offers strong block and object performance. With dense and performant storage servers equipped with all-flash storage, organizations can start small and build out Red Hat Ceph Storage clusters one RU (and up to 128TB) at a time.
With Red Hat OpenShift Container Storage external mode support, Red Hat Ceph Storage clusters powered by Micron all-flash storage can now provide resilient, high-performance storage to the latest container-based hybrid cloud applications running in Red Hat OpenShift Container Platform.
Learn more
For more on Micron solutions for Red Hat Ceph Storage, visit red.ht/micron or read any of the following:
-
Micron Accelerated NVMeTM SSD Solution for Red Hat Ceph Storage (solution brief)
-
Micron 9200 MAX NVMe with 5210 QLS SATA SSDS for Red Hat Ceph Storage (blog post)
Reference architectures
About the author
Michael St-Jean is a Technical Alliance executive focused on building joint solutions with partners that accelerate time to value for organizations' strategic technology initiatives. For over two decades, Michael has worked with cross-functional teams helping organizations solve complex business challenges with innovative technology solutions and strategies.
Browse by channel
Automation
The latest on IT automation for tech, teams, and environments
Artificial intelligence
Updates on the platforms that free customers to run AI workloads anywhere
Open hybrid cloud
Explore how we build a more flexible future with hybrid cloud
Security
The latest on how we reduce risks across environments and technologies
Edge computing
Updates on the platforms that simplify operations at the edge
Infrastructure
The latest on the world’s leading enterprise Linux platform
Applications
Inside our solutions to the toughest application challenges
Original shows
Entertaining stories from the makers and leaders in enterprise tech
Products
- Red Hat Enterprise Linux
- Red Hat OpenShift
- Red Hat Ansible Automation Platform
- Cloud services
- See all products
Tools
- Training and certification
- My account
- Customer support
- Developer resources
- Find a partner
- Red Hat Ecosystem Catalog
- Red Hat value calculator
- Documentation
Try, buy, & sell
Communicate
About Red Hat
We’re the world’s leading provider of enterprise open source solutions—including Linux, cloud, container, and Kubernetes. We deliver hardened solutions that make it easier for enterprises to work across platforms and environments, from the core datacenter to the network edge.
Select a language
Red Hat legal and privacy links
- About Red Hat
- Jobs
- Events
- Locations
- Contact Red Hat
- Red Hat Blog
- Diversity, equity, and inclusion
- Cool Stuff Store
- Red Hat Summit