0001 .. pyspark documentation master file, created by
0002 sphinx-quickstart on Thu Aug 28 15:17:47 2014.
0003 You can adapt this file completely to your liking, but it should at least
0004 contain the root `toctree` directive.
0005
0006 Welcome to Spark Python API Docs!
0007 ===================================
0008
0009 Contents:
0010
0011 .. toctree::
0012 :maxdepth: 2
0013
0014 pyspark
0015 pyspark.sql
0016 pyspark.streaming
0017 pyspark.ml
0018 pyspark.mllib
0019 pyspark.resource
0020
0021
0022 Core classes:
0023 ---------------
0024
0025 :class:`pyspark.SparkContext`
0026
0027 Main entry point for Spark functionality.
0028
0029 :class:`pyspark.RDD`
0030
0031 A Resilient Distributed Dataset (RDD), the basic abstraction in Spark.
0032
0033 :class:`pyspark.streaming.StreamingContext`
0034
0035 Main entry point for Spark Streaming functionality.
0036
0037 :class:`pyspark.streaming.DStream`
0038
0039 A Discretized Stream (DStream), the basic abstraction in Spark Streaming.
0040
0041 :class:`pyspark.sql.SparkSession`
0042
0043 Main entry point for DataFrame and SQL functionality.
0044
0045 :class:`pyspark.sql.DataFrame`
0046
0047 A distributed collection of data grouped into named columns.
0048
0049
0050 Indices and tables
0051 ==================
0052
0053 * :ref:`search`
