Enable MKL Library for Spark ML Applications: Methods and Benchmarks

sorangutan

Spark ML is one of the dominant frameworks for many major machine learning algorithms, such as the Alternating Least Squares (ALS) algorithm for recommendation systems, the Principal Component Analysis algorithm, and the Random Forest algorithm. However, the complexity of configuring it optimally means that frequently, Spark ML is underutilized.. Using native math libraries for Spark ML can help unlock the full potential of Spark ML.

This article discusses how to accelerate model training speed by using native libraries for Spark ML.