Big Data Meets HPC – Exploiting HPC Technologies for Accelerating Big Data Processing

March 12, 2018 by Leave a Comment

DK Panda from Ohio State University gave this talk at the Stanford HPC Conference. “This talk will provide an overview of challenges in accelerating Hadoop, Spark and Memcached on modern HPC clusters. An overview of RDMA-based designs for Hadoop (HDFS, MapReduce, RPC and HBase), Spark, Memcached, Swift, and Kafka using native RDMA support for InfiniBand and RoCE will be presented.”

Filed Under: Big Data, Companies, Events, Featured, Industry Segments, Mellanox, Research / Education, Resources, Video Tagged With: , , , , ,

DK Panda Presents: Big Data – Hadoop and Memcached

February 7, 2014 by Leave a Comment

DK Panda from Ohio State University presented this talk at the Stanford HPC & Exascale Conference. “As InfiniBand is getting used in scientific computing environments, there is a big demand to harness its benefits for enterprise environments for handling big data and analytics. This talk will focus on high-performance and scalable designs of Hadoop using native RDMA support of InfiniBand and RoCE.”

Filed Under: Academic, Big Data Software, Events, Featured, HPC, Industry Segments, Research / Education, Resources, Topics, Video Tagged With: , , , , , ,