Data Management
August 20, 2026
New NVIDIA GPU acceleration for Apache Spark in Cloudera Data Engineering delivers zero-code performance gains, lower cloud costs, and faster AI-ready data pipelines
SAN JOSE, Calif., Aug. 20, 2026 — Cloudera today announced native GPU acceleration for Apache Spark 4.1 in Cloudera Data Engineering, enabled by the NVIDIA CUDA-X library, cuDF. The NVIDIA cuDF plug-in for Apache Spark will support the just-announced Cloudera Anywhere Cloud, which is designed to enable organizations to accelerate Spark workloads without rewriting PySpark or SQL code. This helps data teams prepare AI-ready data faster while reducing cloud infrastructure costs across hybrid environments.
As organizations expand AI initiatives, the speed of data preparation has become a critical challenge. Large-scale Spark workloads often take hours to complete, delaying analytics and AI applications while driving up cloud compute costs. By embedding GPU acceleration directly into Cloudera Data Engineering, organizations can dramatically reduce processing times using their existing Spark applications, without changing code or operational workflows.
Accelerating Spark for Enterprise AI
Apache Spark powers many of today’s enterprise data pipelines. With native GPU acceleration built into Cloudera Data Engineering, organizations can improve performance while maintaining the security and governance required for production workloads. Leveraging NVIDIA cuDF for Spark workloads, Cloudera will provide up to 4x workload acceleration on NVIDIA GPUs compared to traditional CPU infrastructure, enabling enterprises to drastically shorten data processing cycles.
Together, Cloudera Data Engineering accelerated by NVIDIA CUDA-X libraries will deliver:
- Zero-code GPU acceleration for Apache Spark 4.1 workloads
- Faster ETL and data preparation for analytics and AI
- Lower cloud infrastructure costs through shorter compute runtimes
- Built-in deployment with no manual driver configuration
- Enterprise security and governance through the Cloudera Unified Data Fabric
- Consistent performance across public cloud, private cloud, sovereign cloud, and on-premises environments
Unlike GPU acceleration offerings limited to a single cloud provider, Cloudera extends these capabilities across hybrid environments while preserving consistent governance and operations. Organizations can accelerate Spark workloads wherever their data resides— whether that is on premises, in the clouds, or at the edge— without sacrificing security or flexibility.
Faster Data Pipelines, Lower Infrastructure Costs
Preparing trusted data quickly, and at a reasonable cost, is essential for analytics and AI. Recent data from Cloudera’s The Great Re-Architecture Survey found that the vast majority (84%) of respondents said that AI workloads have caused infrastructure costs to increase. By accelerating Spark processing, organizations can deliver clean, model-ready data faster, helping to reduce infrastructure costs while improving productivity across data engineering, AI, and analytics teams.
“For many organizations, AI isn’t limited by models. It’s limited by how quickly they can turn raw data into trusted, usable insights,” said Leo Brunnick, Chief Product Officer at Cloudera. “Accelerating Spark inside Cloudera Data Engineering helps remove that bottleneck, allowing customers to move from data preparation to analytics and AI faster while keeping governance, security, and operational consistency at the center of their strategy.”
“The fastest path to accelerating AI deployments is the one that aligns with how enterprises already operate today,” said Pat Lee, vice president, Strategic Enterprise Partnerships at NVIDIA. “With NVIDIA AI infrastructure and CUDA-X libraries now native to Cloudera Data Engineering, enterprises can lower costs and dramatically speed up Apache Spark pipelines without changing a single line of PySpark or SQL code, turning business data into a foundation for AI.”
The GPU acceleration capability for Apache Spark will be available in Cloudera Data Engineering as part of the Cloudera Anywhere Cloud announced at EVOLVE Singapore on August 20, 2026. Additional demonstrations and technical sessions will be featured at NVIDIA GTC Berlin and Cloudera EVOLVE New York later this year.
To learn more, visit Cloudera.com or register for upcoming EVOLVE conferences to see how organizations are accelerating data engineering and AI across hybrid environments.
Cloudera is the only hybrid data and AI platform company that large organizations trust to bring AI to their data anywhere it lives. Unlike other providers, Cloudera delivers a consistent cloud experience that converges public clouds, on-prem data centers, sovereign clouds, and the edge, leveraging a proven open-source foundation. As the pioneer in big data, Cloudera empowers businesses to apply AI and assert control over 100% of their data, in all forms, improving security, governance, and real-time and predictive insights. The world’s largest brands across all industries rely on Cloudera to transform decision-making and ultimately boost bottom lines, safeguard against threats, and save lives.
The Big Data Inside Amazon’s New Fire Phone
The new Fire phone that Amazon launched this week looks like your ordinary black smartphone,…
Three Reasons to be Scared of the Internet of Things
We know the Internet of Things forecasts: 50 billion connected devices by 2020. Apparently, there’s…
Wanted: Intelligent Middleware That Simplifies Big Data Analytics
We’ve seen tremendous technological innovation in the data analytics space over the past 10 years….
GPUs Tackle Massive Data of the Hive Mind
LIVE from GTC12 — The flock of birds that weaves seamlessly through the sky, propelled…
Why Hadoop on IBM Power
In the quest to achieve data-driven insight, Hadoop running on Intel X86-based processors has emerged…
Datanami’s Leverage Big Data Summit Wraps Up
Dialog and networking were on the Datanami agenda this week as we kicked off our…
Nobel Laureate David Baker Takes Aim at the Virtual Cell with GenBio AI
What if scientists could test a new drug or make changes to a cell without…
Oakley Capital Bets Big on Graphwise to Solve a Growing AI Problem
European private equity firm Oakley Capital has acquired a majority stake in Graphwise, a knowledge…
AI Agents Are Creating a New Data Problem. Ciklum and ClickHouse Have a Plan
Technology services company Ciklum has formed a strategic partnership with real-time analytics database provider ClickHouse,…
AI Is Forcing Analytics Teams Into a New Role
For years, analytics teams have been responsible for helping organizations understand their data. They built…
DeepSeek Open-Sources the Missing Layer Between AI Models and Agents
AI models are getting better at a rapid pace. They are now able to reason,…
AI Turns Genomic Data Into 16 New Bacteria-Killing Viruses
Scientists are using GenAI and massive stores of genomic data to design new biological systems…
