This is archive of SparkRDMA project. The new repository with RDMA shuffle acceleration for Apache Spark is here: https://github.com/Nvidia/sparkucx
All-new implementation of SparkRDMA, redesigned from the ground up to further increase scalability, robustness and most importantly - performance.
Among the new features and capabilities introduced in this release:
Attached are pre-built binaries. Please follow the README page for instructions.
This is the first production ready release of SparkRDMA. Release v1.0 went through rigorous testing for performance and functionality, as well as customer-side pre-production testing. This version addresses many bugs, and it is considered the best version yet to be published.
Attached are pre-built binaries. Please follow the README page for instructions.
Pre-release version of SparkRDMA, precursor for version 1.0 that will include a set of fixes and improvements.