pysparklyr

0.2.2

Provides a 'PySpark' Back-End for the 'sparklyr' Package

0packages depend

25.4Kdownloads / year

0.0%test coverage

13/13checks pass

Overview

About

Maintained by Edgar RuizFirst published 2023-10-0413 releasesCRAN page ↗GitHub ↗

It enables 'sparklyr' to integrate with 'Spark Connect', and 'Databricks Connect' by providing a wrapper over the 'PySpark' 'python' library.

Install

R (CRAN)pak (dev)Ubuntu (r2u)Fedora (COPR)openSUSE (OBS)

install.packages("pysparklyr", repos = "https://cloud.r-project.org/")

Installs the current CRAN release. Prebuilt binaries on Windows and macOS.

if (!requireNamespace("pak", quietly = TRUE))
  install.packages("pak", repos = "https://cloud.r-project.org/")
pak::pak("mlverse/pysparklyr")

Development version from mlverse/pysparklyr. Installs pak first if it is not already available.

Release

# enable cranapt (r2u) if it is not already set up, then install
grep -rqs r2u.stat.illinois.edu /etc/apt/sources.list /etc/apt/sources.list.d/ \
  || curl -fsSL https://raw.githubusercontent.com/eddelbuettel/r2u/master/inst/scripts/add_cranapt_noble.sh | sudo bash
sudo apt install -y r-cran-pysparklyr

Fast Ubuntu binaries via r2u (no compilation). The cranapt setup runs once and is skipped when it is already enabled.

bspm (used by r2u) also needs make: sudo apt install make

# enable the iucar/cran COPR if it is not already present, then install
ls /etc/yum.repos.d/*iucar*cran*.repo >/dev/null 2>&1 \
  || sudo dnf copr enable -y iucar/cran
sudo dnf install -y R-CRAN-pysparklyr

RPMs from the iucar/cran COPR, rebuilt from CRAN.

For install.packages() integration in R, also: sudo dnf install R-CoprManager

# add the autoCRAN OBS repo (Tumbleweed) if it is missing, then install
zypper -q lr | grep -qi autoCRAN \
  || sudo zypper addrepo https://download.opensuse.org/repositories/devel:/languages:/R:/autoCRAN/openSUSE_Tumbleweed/devel:languages:R:autoCRAN.repo
sudo zypper install -y R-pysparklyr

RPMs auto-built from CRAN on openSUSE OBS (Tumbleweed).

Health

CRAN checks

13OK

Slowest check: 3.2 min · r-devel-linux-x86_64-fedora-clang

Code health

Yes

Tests · ratio 0.87

0.0%

Coverage · measured lines

100%

Documentation · exports

Dependencies · direct

Check history

OK2026-07-17
13 OK · 0 NOTE · 0 WARNING · 0 ERROR · 0 FAILURE
WARNING2026-06-09
9 OK · 0 NOTE · 4 WARNING · 0 ERROR · 0 FAILURE
ERROR2026-06-08
8 OK · 0 NOTE · 4 WARNING · 1 ERROR · 0 FAILURE
WARNING2026-03-10
9 OK · 0 NOTE · 5 WARNING · 0 ERROR · 0 FAILURE

Documentation

READMEYes · 95 wordsVignettesNopkgdown siteNoNEWSYes · 100% structuredCode of conductNoContributing guideNo

Examples that run: not tracked
Documented parameters: 100%
Return-value docs: 100%
References docs: 0%

Downloads

25.4K

CRAN downloads in the past year

Rank #3,644 · ~70/day · ~2.1K/mo

Releases R versions

Daily download trend is not available in this view yet.

91230 days

2.9K90 days

25.4K1 year

Compare downloads with other packages →

Also on129 r2u25 autocran

Repository

GitHub ↗ mlverse/pysparklyr

17Stars

9Forks

15Open issues

2Open PRs

12Releases

1,266Commits

9Contributors

databrickspysparkrsparkspark-connect

1,266 commits · Last activity 2026-07-17 · 0% stars, 30d

Stars over time

2025-04-23 · 162026-07-07 · 17

Repository practices

Upstream repositoryBeta

8 development-tooling and community-health practices detected across 5 families in the upstream repository

Checks run against github.com/mlverse/pysparklyr on 2026-07-30.

Continuous integration (1)

GitHub Actions

CRAN release process (2)

cran-comments.mdCRAN-SUBMISSION

Docs source (1)

README.Rmd

Lint, format, editor (3)

AirVS CodeRStudio project

Show all practices

Coverage (1)

Codecov

How this is detected·Detection ruleset v1 (2026-07-18)

Dependencies

Declared dependencies

34 external dependencies (excludes base and recommended)

Depends (1)

R >= 4.1

Imports (22)

arrow cli DBI dbplyr dplyr fs glue httr2 lifecyclemethodsprocessx purrr reticulate rlang rstudioapi sparklyr tidyr tidyselect vctrs uuid withr connectcreds

LinkingTo (0)

none

Suggests (13)

vcr crayon R6 testthat tibble rsconnect rsample workflows tune parsnip dials tailor recipes

Enhances (0)

none

Dependency license breakdown →

Reverse dependencies

0direct

0indirect

Nothing depends on this yet.

Code & Tests

People & History

People (2)

Maintainer (1)

Edgar Ruiz

Author, Maintainer

Authors (1)

Edgar Ruiz

Author, Maintainer

Posit Software, PBC

Funders (1)

Posit Software, PBC

Package Timeline

13 releases. Pick two to compare their code metrics. R releases are shown for context.

0.2.2Latest
2026-07-17 · current release · diff ↗
R
R 4.6.0 released · 2026-04-24
0.2.1
2026-04-21 · diff ↗
0.2.0
2026-01-27 · diff ↗
0.1.9
2025-10-07 · diff ↗
0.1.8
2025-05-19 · diff ↗
R
R 4.5.0 released · 2025-04-11
0.1.7
2025-03-24 · diff ↗
0.1.6
2025-02-14 · diff ↗
0.1.5
2024-06-24 · diff ↗
R
R 4.4.0 released · 2024-04-24
0.1.4
2024-04-16 · diff ↗
0.1.3
2024-01-12 · diff ↗
0.1.2
2023-12-06 · diff ↗
0.1.1
2023-11-10 · diff ↗
0.1.0
2023-10-04

Show 1 earlier events

R
R 4.3.0 released · 2023-04-21

Package metadata

First published: 2023-10-04
Total releases: 13 / 3 yrs
License: MIT + file LICENSE OSI
Minimum R: ≥ 4.1
Download size: 136 KB
Installed size: not tracked yet
With dependencies: not tracked yet

Report a problem with this page →