[SPONSORED POST] NVIDIA® is the leader in accelerated networking solutions and a pioneer in new advancements such as the Data Processing Unit (DPU) which is why PNY is proud to become an NVIDIA networking product partner carrying and supporting NVIDIA’s entire Ethernet and InfiniBand end-to-end product suites. In this article, we highlight four PNY videos available on our YouTube channel that showcase the benefits of each NVIDIA networking product category.
Big Data Meets HPC – Exploiting HPC Technologies for Accelerating Big Data Processing
March 12, 2018 by
DK Panda from Ohio State University gave this talk at the Stanford HPC Conference. “This talk will provide an overview of challenges in accelerating Hadoop, Spark and Memcached on modern HPC clusters. An overview of RDMA-based designs for Hadoop (HDFS, MapReduce, RPC and HBase), Spark, Memcached, Swift, and Kafka using native RDMA support for InfiniBand and RoCE will be presented.”
Accelerating Big Data Processing with Hadoop, Spark and Memcached
February 14, 2015 by
In this video from the 2015 Stanford HPC Conference, DK Panda from Ohio State University presents: Accelerating Big Data Processing with Hadoop, Spark and Memcached.
Performance Optimization of Hadoop Using InfiniBand RDMA
October 11, 2014 by
“The Hadoop framework has become the most popular open-source solution for Big Data processing. Traditionally, Hadoop communication calls are implemented over sockets and do not deliver best performance on modern clusters with high-performance interconnects. This talk will examine opportunities and challenges in optimizing performance of Hadoop with Remote DMA (RDMA) support, as available with InfiniBand, RoCE (RDMA over Converged Enhanced Ethernet) and other modern interconnects.”
DK Panda Presents: Big Data – Hadoop and Memcached
February 7, 2014 by
DK Panda from Ohio State University presented this talk at the Stanford HPC & Exascale Conference. “As InfiniBand is getting used in scientific computing environments, there is a big demand to harness its benefits for enterprise environments for handling big data and analytics. This talk will focus on high-performance and scalable designs of Hadoop using native RDMA support of InfiniBand and RoCE.”
