How-To guides

The following guides cover key processes and common tasks for Charmed Apache Spark. If you are missing a particular how-to guide, feel free to leave us feedback via the Give feedback button above, or contact us directly.

Deployment

See guides on how to prepare a K8s environment and deploy Charmed Apache Spark and Charmed Apache Kyuubi:

• Set up K8s environment

• Spark deployment guide

• Kyuubi deployment guide

Manage service account

See guides how to manage service account with different tools:

• Using Spark Integration Hub

• Using Python

• Using Spark-client

Charmed Apache Kyuubi guides

We have a series of guides for using Charmed Apache Kyuubi with Charmed Apache Spark:

• Encryption and password

• External connections

• External metastore

• Integrate with apps

• Backups

• Upgrades

Monitoring

Monitoring Charmed Apache Spark is typically done with the Canonical Observability Stack. See our Monitoring guide.

Spark History Server

We have guides for using Spark History Server with Charmed Apache Spark:

• Authentication and authorisation

• Expose web GUI

Security

We have a guide for using self-signed certificates.

See also: our security overview page.

Other guides

Advanced features of Charmed Apache Spark include:

• Use K8s pods

• Streaming jobs

• Use GPU