Configuration - Spark 2.4.0 Documentation - Apache Spark

• Download
• Libraries
  • SQL and DataFrames
  • Spark Connect
  • Spark Streaming
  • pandas on Spark
  • MLlib (machine learning)
  • GraphX (graph)
  • Third-Party Projects
• Documentation
  • Latest Release
  • Older Versions and Other Resources
  • Frequently Asked Questions
• Examples
• Community
  • Mailing Lists & Resources
  • Contributing to Spark
  • Improvement Proposals (SPIP)
  • Issue Tracker
  • Powered By
  • Project Committers
  • Project History
• Developers
  • Useful Developer Tools
  • Versioning Policy
  • Release Process
  • Security
• GitHub
  • spark
  • spark-connect-go
  • spark-connect-swift
  • spark-docker
  • spark-kubernetes-operator
  • spark-website

• Apache Software Foundation
  • Apache Homepage
  • License
  • Sponsorship
  • Thanks
  • Event

Oops!

Sorry, but the page you were trying to view does not exist.

It looks like this was the result of either:

• a mistyped address
• an out-of-date link

We periodically archive old End-Of-Support docs here which sometimes take you here from Google search, Bing, e.t.c, as search engine indices might not sync timely. You can go to the latest Spark documentation to find the information you need.

If there is still a problem for you to get, please head over to the Apache Spark dev mailing list or user mailing list for help.

Latest News

• Spark 4.1.0 released (Dec 16, 2025)
• Preview release of Spark 4.1.0 (Nov 19, 2025)
• Preview release of Spark 4.1.0 (Oct 29, 2025)
• Preview release of Spark 4.1.0 (Sep 28, 2025)

Archive

Download Spark

Built-in Libraries:

• SQL and DataFrames
• Spark Streaming
• MLlib (machine learning)
• GraphX (graph)

Third-Party Projects