Charmed Apache Spark documentation

Charmed Apache Spark solution is a set of Canonical supported artefacts (including charms, rocks and snaps) that makes operating Apache Spark workloads on Kubernetes seamless, secure and production-ready.

Charmed Apache Spark solution includes the:

  • Charmed operators to deploy and manage Apache Spark-related components, such as Apache Kyuubi and Spark History Server, using Juju

  • OCI Images that benefit from security patching and bug fixing support to run Apache Spark securely

  • Client tools, either in the form of a snap or python package to simplify the user experience of running Apache Spark on K8s

For an overview of all components in the solution, see the Components overview page.

Apache Spark is a free, open-source software project by the Apache Software Foundation.

The solution helps ops teams and administrators automate Apache Spark operations from Day 0 to Day 2 with additional capabilities, such as: user management, encryption, password rotation, easy-to-use application integration, and monitoring.

In this documentation

Tutorial
Learn how to use Charmed Apache Spark with our step-by-step guidance. Get started from step one.

How-to guides
Practical instructions for key tasks, like deploy, manage service accounts, monitor metrics, process streams, use GPU.

Reference
Technical information, for example: release notes, system requirements, and contact information.

Explanation
Explore and grow your understanding of key topics, such as: security, cryptography, solution components, configuration, and monitoring.

Project and community

Charmed Apache Spark is a distribution of Apache Spark. It’s an open-source project that welcomes community contributions, suggestions, fixes and constructive feedback.

Apache®, Apache Spark, Spark®, and the Apache Spark logo are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries.

License and trademarks

Apache®, Apache Spark, Spark™, Apache Kyuubi, Kyuubi™, and their respective logos are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries.

The Charmed Apache Spark solution is free software, distributed under the Apache Software License, version 2.0. See LICENSE for more information.