In this video from the 2014 HPCAC Stanford HPC & Exascale Conference, DK Panda from Ohio State University presents: Big Data: Hadoop and Memcached.
As InfiniBand is getting used in scientific computing environments, there is a big demand to harness its benefits for enterprise environments for handling big data and analytics. This talk will focus on high-performance and scalable designs of Hadoop using native RDMA support of InfiniBand and RoCE. Designs for various components in Hadoop (such as HDFS, MapReduce, RPC, and HBASE) and their benefits based on the RDMA package for Apache Hadoop will be presented. RDMA-based design for scalable Memcached (used in Web 2.0) and the associated benefits will be presented.”
Download the slides (PDF) * See more talks at the Stanford HPC Conference Video Gallery
