As 5G begins to make its impact felt, the volume of data is going to grow exponentially as tens of thousands of connected devices come online in IoT (internet of things) deployments, particularly in industrial uses.
It’s all in real-time
No longer is data being processed within a traditional data center. It is being created at multiple access points and the latest innovations are now allowing customers to do more with their data, and process and analyze it at the edge and even within the cloud.
We start by exploring the need for ‘data-centered’ to get faster, real-time insights, whether it be on the cloud, on the edge, or in traditional databases. One proven technique uses High Performance Data Analytics (HPDA) to achieve real-time results.
Built around it
Central to managing this data windfall is HPDA, which is the convergence of Big Data and High Performance computing (HPC). Traditional Big Data analytics engines are excellent at storing and managing large amounts of unstructured data that can be mined for trends and insights.
However, the speed and latency requirements of real-time analytics creates significant challenges for traditional Big Data systems.
Finding the fit
The challenge is that for customers running these workloads, traditional scale-out computing is not cost-effective, nor does it provide the performance needed to analyze data in real-time. Customers with common data center platforms typically must make trade-offs between storage, memory and compute performance – and then decide which combination best suits their specific workload needs.
Running these compute intensive workloads often not only requires the performance of HPC, but also demands the level of storage and memory capacity suited for Big Data.
For even greater performance, GPUs (graphiscs processing units) can be leveraged for ultra-fast data processing by loading entire datasets into the GPU memory and leveraging GPU acceleration for extremely fast processing. The added benefit of GPUs enables organizations to be AI-ready. These built in AI capabilities gives customers the ability to easily move beyond HPDA to complex Artificial Intelligence models.
We have all learned this year that the future is unpredictable. We can prepare, but we must innovate – together – to continue adapting to changing workloads and customer demands. Together, we help customers discover the potential and benefits of AI, develop AI applications using AI-optimized hardware and their choice of AI frameworks and deploy rapidly using simplified end-to-end solutions.
– Christopher Cooper, General Manager, Middle East and Africa, Lenovo Data Center Group.