Skip to content

sparklyr

R Interface to Apache Spark

v1.9.3 · Nov 19, 2025 · Apache License 2.0 | file LICENSE

Description

R interface to Apache Spark, a fast and general engine for big data processing, see <https://spark.apache.org/>. This package supports connecting to local and remote Apache Spark clusters, provides a 'dplyr' compatible back-end, and provides an interface to Spark's built-in machine learning algorithms.

Downloads

32.4K

Last 30 days

616th

32.4K

Last 90 days

32.4K

Last year

CRAN Check Status

2 NOTE
12 OK
Show all 14 flavors
Flavor Status
r-devel-linux-x86_64-debian-clang OK
r-devel-linux-x86_64-debian-gcc OK
r-devel-linux-x86_64-fedora-clang OK
r-devel-linux-x86_64-fedora-gcc OK
r-devel-macos-arm64 OK
r-devel-windows-x86_64 OK
r-oldrel-macos-arm64 NOTE
r-oldrel-macos-x86_64 NOTE
r-oldrel-windows-x86_64 OK
r-patched-linux-x86_64 OK
r-release-linux-x86_64 OK
r-release-macos-arm64 OK
r-release-macos-x86_64 OK
r-release-windows-x86_64 OK
Check details (14 non-OK)
OK r-devel-linux-x86_64-debian-clang

*


            
OK r-devel-linux-x86_64-debian-gcc

*


            
OK r-devel-linux-x86_64-fedora-clang

*


            
OK r-devel-linux-x86_64-fedora-gcc

*


            
OK r-devel-macos-arm64

*


            
OK r-devel-windows-x86_64

*


            
NOTE r-oldrel-macos-arm64

installed package size

  installed size is  5.2Mb
  sub-directories of 1Mb or more:
    R      2.1Mb
    java   1.9Mb
NOTE r-oldrel-macos-x86_64

installed package size

  installed size is  5.2Mb
  sub-directories of 1Mb or more:
    R      2.1Mb
    java   1.9Mb
OK r-oldrel-windows-x86_64

*


            
OK r-patched-linux-x86_64

*


            
OK r-release-linux-x86_64

*


            
OK r-release-macos-arm64

*


            
OK r-release-macos-x86_64

*


            
OK r-release-windows-x86_64

*


            

Check History

NOTE 12 OK · 2 NOTE · 0 WARNING · 0 ERROR · 0 FAILURE Mar 9, 2026
NOTE r-oldrel-macos-arm64

installed package size

  installed size is  5.2Mb
  sub-directories of 1Mb or more:
    R      2.1Mb
    java   1.9Mb
NOTE r-oldrel-macos-x86_64

installed package size

  installed size is  5.2Mb
  sub-directories of 1Mb or more:
    R      2.1Mb
    java   1.9Mb

Reverse Dependencies (32)

depends

Dependency Network

Dependencies Reverse dependencies config DBI dbplyr dplyr (>= 1.0.9) generics globals glue httr jsonlite (>= 1.4) openssl purrr rlang rstudioapi tidyr tidyselect +4 more dependencies s3.resourcer apache.sedona bigMICE catalog geospark graphframes pathling pysparklyr rollup rsparkling shinyML spark.sas7bdat sparkavro sparkbq sparkhail +17 more reverse deps sparklyr

Version History

new 1.9.3 Mar 9, 2026