Scaling R with Spark

This talk introduces new features in sparklyr that enable real-time data processing, brand new modeling extensions and significant performance improvements.

rstudio::conf 2019 distributed

Scaling R with Spark

January 25, 2019

This talk introduces new features in sparklyr that enable real-time data processing, brand new modeling extensions and significant performance improvements. The sparklyr package provides an interface to Apache Spark to enable data analysis and modeling in large datsets through familiar packages like dplyr and broom.

View Materials

About the speaker

Javier Luraschi
/

Javier is the author of “Mastering Spark with R”, pins, sparklyr, mlflow and torch. He holds a double degree in Math and Software Engineer and decades of industry experience with a focus on data analysis. Javier is currently working on a project of his own; and previously worked in RStudio, Microsoft Research and SAP.