Charmed Apache Spark (revision 4)

Apr 22nd, 2026

We’re excited to announce a new stable release for Charmed Apache Spark.

This release includes support for Apache Kyuubi, the Apache Spark History Server, Spark Integration Hub, Apache Spark Client Snap, Canonical security maintained OCI images for Apache Spark and a Charmed Apache Spark Terraform Module to deliver a seamless, production-ready and fully open-source datalake experience. Charmed Apache Spark with Apache Kyuubi is available on charmhub.io at the 3.4/stable and 3.5/stable channels.

Charmhub: 3.4/candidate, 3.5/candidate | Docs | Deploy guide | System requirements

Features

This release includes general updates across the solution, as well as changes to individual components.

General

  • [DPE-7941] Add GPU Support. Please refer to the How to use GPU user guide for more information.

  • [PRA-156] Add ARM support (experimental) - the feature will only be available on candidate risks for now. To deploy on ARM architecture, use the juju set-model-constraints command line switch when creating juju models or specify the architecture using the juju --constraints command line switch at deploy time. More information can be found in the Advanced Scheduling user guide

  • [PRA-158] Components upgrade:

    • Apache Spark version: 3.4.4-ubuntu7 and 3.5.7-ubuntu2

    • Apache Kyuubi version: 1.10.3-ubuntu1

    • spark8t python library: 1.3.1

    • nvidia spark-rapids: 25.12.0

  • [PRA-73] Update juju version to 3.6.13+

  • [PRA-145] Validation on multiple K8s supported versions (refer to the requirements documentation for more info)

  • [DPE-8681] Testing and validation for MicroCeph instead of MinIO

  • Migrated from DPE to PRA Jira project

  • General updates of Python dependencies, craft build tools, CI workflows and Github actions

Apache Kyuubi

Apache Spark History Server

  • [PRA-200] Explicit proxy support for S3-compliant storage (#143)

  • [DPE-8481] Add integration with oauth2proxy (#123)

  • Enforce type checking (#146)

Spark Integration Hub

  • [PRA-158] Update OCI resource to latest release (#181)

  • [PRA-200] Explicit proxy support for S3-compliant storage (#171)

  • [PRA-156] Fix broken release check due to multiple platforms (#158)

  • [PRA-152] Serialize asterisk characters when generating resource manifest (#144)

  • [PRA-113] Add a config option to specify custom Apache Spark image (#134)

  • [PRA-30] Add monitored-service-accounts configuration option (#120)

  • [DPE-7840] Share manifest of the K8s resources over the spark service account relation (#99)

  • [PRA-199,PRA-220] Add support for s3 certificates and fix secret deletion (#180)

Apache Spark Client snap

  • [DPE-7923] Suppress AWS Java SDK v1 warning message in snap (#131)

Canonical security maintained OCI Images for Apache Spark

  • [PRA-158] Component bumps (#217)

  • [DPE-7941] Add GPU executor pod template to Charmed Apache Kyuubi image (#165)

  • [PRA-189] Check for environment variable expansion (#221)

  • Download Hive from mirror (#163)

  • Perform disk cleanup at the start of all workflows (#190)

  • Run Trivy scan on 3.5/edge and 3.4/edge (#151) (#171)

Charmed Apache Spark Terraform Module

  • [DPE-7943] Improve stability of UAT and CI tests (#142)

  • [DPE-7722] Enable Reference Architecture (AKS) testing (#136) (#173)

  • [DPE-6777] Demo update based on Charmed Apache Kyuubi GA (#131)

  • [MISC] Pin cos-configuration-k8s to rev65 on YAML bundle (#156)

Bug fixes

This release includes bug fixes grouped by component.

Apache Kyuubi

  • [PRA-243] Kyuubi does not work with S3 TLS

Apache Spark History Server

  • [PRA-140] Block charm in case of missing object storage path (#145)

Canonical security maintained OCI Images for Apache Spark

Charmed Apache Spark Terraform Module

  • [PRA-163] Remove wrong quote (#191)

  • [DPE-8292] Add missing offers in Charmed Apache Spark 3.5 (#144)

  • fix: Pin terraform provider to <1.0.0 (#167)

Breaking changes

This release includes breaking changes grouped by component.

Spark Integration Hub

  • [PRA-73] Restore Juju 3.6.13+ compatibility (#172)

Documentation improvements

The current release also features the following documentation changes:

  • Polish the terminology capitalisation (#188)

  • Add auto-generated metadata description (#186)

  • Fix the docs badge in README (#187)

  • Home page remodeling (#181)

  • Update home page (#163)

  • Clarify how to use self-signed S3 endpoints (#164)

  • Add landing pages (#159)

  • Add cookie consent request (#157)

  • Update the cookie banner design (#193)

  • Update spelling to US English (#196)

  • Add redirects for RTD docs (#160)

  • Update documentation on Security page to reflect new UX (#158)

  • Initial documentation migration to RTD (#148)

  • Add Charmed Apache Kyuubi docs (#134)

Security

The new artifacts have been fixing the following CVEs:

Component

Severity

Fixed

Apache Spark

High

CVE-2021-33813, CVE-2024-13009, CVE-2025-12183, CVE-2025-66566

Medium

CVE-2025-68161

Apache Kyuubi

High

CVE-2025-24970, CVE-2025-55163, CVE-2025-66518

Medium

CVE-2024-47535, CVE-2025-25193, CVE-2025-58057, CVE-2025-67735, CVE-2025-68161, CVE-2026-1002

Compatibility

The following table summarize the compatibility matrix of the solution:

Component

Hardware architecture

Channel

Artefact

Revision

Minimum Juju version

Recommended Juju version

Apache Spark History Server

AMD64

3/stable

Charmed Apache Spark Image (Apache Spark version: 3.5.7-ubuntu2)

98

v.3.6.13+

v.3.6.14

ARM64

3/candidate

Charmed Apache Spark Image (Apache Spark version: 3.5.7-ubuntu2)

97

v.3.6.13+

v.3.6.14

Spark Integration Hub

AMD64

3/stable

Integration Hub Image (11)

123

v.3.6.13+

v.3.6.14

ARM64

3/candidate

Integration Hub Image (11)

124

v.3.6.13+

v.3.6.14

Apache Kyuubi

AMD64

3.4/stable

Charmed Apache Kyuubi Image (Apache Spark version: 3.4.4-ubuntu7, Apache Kyuubi version: 1.10.3-ubuntu1)

162

v.3.6.13+

v.3.6.14

ARM64

3.4/candidate

Charmed Apache Kyuubi Image (Apache Spark version: 3.4.4-ubuntu7, Apache Kyuubi version: 1.10.3-ubuntu1)

161

v.3.6.13+

v.3.6.14

AMD64

3.5/stable

Charmed Apache Kyuubi Image (Apache Spark version: 3.5.7-ubuntu2, Apache Kyuubi version: 1.10.3-ubuntu1)

160

v.3.6.13+

v.3.6.14

ARM64

3.5/candidate

Charmed Apache Kyuubi Image (Apache Spark version: 3.5.7-ubuntu2, Apache Kyuubi version: 1.10.3-ubuntu1)

159

v.3.6.13+

v.3.6.14

Apache Spark Client Snap

AMD64

3.4/stable

Apache Spark version: 3.4.4-ubuntu7

100

N/A

N/A

ARM64

3.4/candidate

Apache Spark version: 3.4.4-ubuntu7

102

N/A

N/A

AMD64

3.5/stable

Apache Spark version: 3.5.7-ubuntu2

101

N/A

N/A

ARM64

3.5/candidate

Apache Spark version: 3.5.7-ubuntu2

99

N/A

N/A

Charmed Apache Spark Base Image

AMD64

3.4-22.04_stable

Charmed Apache Spark Image Apache Spark version: 3.4.4-ubuntu7

100

N/A

N/A

ARM64

3.4-22.04_candidate

Charmed Apache Spark Image Apache Spark version: 3.4.4-ubuntu7

102

N/A

N/A

AMD64

3.5-22.04_stable

Charmed Apache Spark Image Apache Spark version: 3.5.7-ubuntu2

101

N/A

N/A

ARM64

3.5-22.04_candidate

Charmed Apache Spark Image Apache Spark version: 3.5.7-ubuntu2

99

N/A

N/A

Charmed Apache Spark GPU Image

AMD64

3.4-22.04_stable

Charmed Apache Spark Image Apache Spark version: 3.4.4-ubuntu7

100

N/A

N/A

ARM64

3.4-22.04_candidate

Charmed Apache Spark Image Apache Spark version: 3.4.4-ubuntu7

102

N/A

N/A

AMD64

3.5-22.04_stable

Charmed Apache Spark Image Apache Spark version: 3.5.7-ubuntu2

101

N/A

N/A

ARM64

3.5-22.04_candidate

Charmed Apache Spark Image Apache Spark version: 3.5.7-ubuntu2

99

N/A

N/A

Note

Juju controller versions from 3.9.10 to 3.6.12 are affected by a regression in Juju that has been fixed in 3.6.13 that will not claim management over resources when tag appropriately. Support for Juju 3.6.13+ has been addressed by this issue to now forcefully label resources managed by integration hub with app.kubernetes.io/managed-by=spark8t.

Note

When using Juju controller versions greater or equal to 3.6.13, make sure you use a charm revision above 107 for spark-integration-hub-k8s. On Juju controller versions lower or equal to 3.6.9, use charm revisions below 107.

Note

Model destruction for controllers above 3.6.18+ may sometimes freeze (see Juju issue #22105). In these cases, we recommend destroying the resources manually.

Acknowledgements

We are extremely grateful to the Apache Spark and Apache Kyuubi communities for their continuous work, involvement and engagement with open-source to make technologies that process data at scale available to the broader audience.