CalendarIntervalType
types
CanonicalRandomVertexCut
PartitionStrategy
CatalystScan
sources
Categorical
FeatureType
CategoricalSplit
tree
ChiSqSelector
feature feature
ChiSqSelectorModel
feature feature
ChiSqTestResult
test
Classification
Algo
ClassificationModel
classification classification
Classifier
classification
CoGroupFunction
function
CoGroupedRDD
rdd
Column
sql
ColumnName
sql
Combiner
bagel
ComplexFutureAction
spark
CompressionCodec
io
Conf
SVDPlusPlus
ConnectedComponents
lib
ConnectionFactory
JdbcRDD
ConstantInputDStream
dstream
Continuous
FeatureType
ContinuousSplit
tree
CoordinateMatrix
distributed
CountVectorizer
feature
CountVectorizerModel
feature
CreatableRelationProvider
sources
CrossValidator
tuning
CrossValidatorModel
tuning
cache
JavaDoubleRDD JavaPairRDD JavaRDD Graph EdgeRDDImpl GraphImpl VertexRDDImpl BlockMatrix RDD DataFrame Dataset JavaDStream JavaPairDStream DStream
cacheManager
SparkEnv SQLContext
cacheTable
SQLContext
cachedLeafStatuses
HadoopFsRelation
calculate
Entropy Gini Impurity Variance
call
CoGroupFunction DoubleFlatMapFunction DoubleFunction FilterFunction FlatMapFunction FlatMapFunction2 FlatMapGroupsFunction ForeachFunction ForeachPartitionFunction Function Function0 Function2 Function3 Function4 MapFunction MapGroupsFunction MapPartitionsFunction PairFlatMapFunction PairFunction ReduceFunction VoidFunction VoidFunction2 UDF1 UDF10 UDF11 UDF12 UDF13 UDF14 UDF15 UDF16 UDF17 UDF18 UDF19 UDF2 UDF20 UDF21 UDF22 UDF3 UDF4 UDF5 UDF6 UDF7 UDF8 UDF9
callSite
RDDInfo
callUDF
functions
callUdf
functions
canEqual
ExecutorInfo MutablePair
canHandle
JdbcDialect
cancel
ComplexFutureAction FutureAction SimpleFutureAction
cancelAllJobs
SparkContext JavaSparkContext
cancelJobGroup
SparkContext JavaSparkContext
cartesian
JavaRDDLike RDD
caseSensitive
StopWordsRemover
cast
Column
catalog
SQLContext HiveContext
categoricalFeaturesInfo
Strategy
categories
Split
categoryMaps
VectorIndexerModel
cbrt
functions
ceil
functions Decimal
changePrecision
Decimal
checkpoint
JavaRDDLike Graph EdgeRDDImpl GraphImpl VertexRDDImpl HadoopRDD RDD StreamingContext JavaDStreamLike JavaStreamingContext DStream
checkpointFile
SparkContext JavaSparkContext
checkpointInterval
Strategy
chiSqTest
Statistics
child
Not
className
ExceptionFailure
classTag
JavaDoubleRDD JavaPairRDD JavaRDD JavaRDDLike JavaDStream JavaDStreamLike JavaInputDStream JavaPairDStream JavaReceiverInputDStream
classification
ml mllib
classpathEntries
EnvironmentListener
clean
WriteAheadLog
clear
Params ExecutionListenerManager
clearActive
SQLContext
clearCache
SQLContext
clearCallSite
SparkContext JavaSparkContext
clearDependencies
CoGroupedRDD RDD ShuffledRDD UnionRDD
clearFiles
SparkContext JavaSparkContext
clearJars
SparkContext JavaSparkContext
clearJobGroup
SparkContext JavaSparkContext
clearThreshold
LogisticRegressionModel SVMModel
clone
SparkConf Decimal StorageLevel BernoulliCellSampler BernoulliSampler PoissonSampler RandomSampler
cloneComplement
BernoulliCellSampler
close
JavaSparkContext PortableDataStream DeserializationStream SerializationStream OutputWriter TimeTrackingOutputStream JavaStreamingContext WriteAheadLog
closeLogWriter
JobLogger
closureSerializer
SparkEnv
clsTag
Encoder
cluster
Assignment scheduler
clusterCenters
KMeansModel BisectingKMeansModel KMeansModel StreamingKMeansModel
clusterWeights
StreamingKMeansModel
clustering
ml mllib
coalesce
JavaDoubleRDD JavaPairRDD JavaRDD RDD DataFrame Dataset functions
coefficientStandardErrors
LinearRegressionSummary
coefficients
LogisticRegressionModel AFTSurvivalRegressionModel LinearRegressionModel
cogroup
JavaPairRDD PairRDDFunctions GroupedDataset JavaPairDStream PairDStreamFunctions
col
DataFrame functions
colPtrs
SparseMatrix
colStats
Statistics
collect
JavaRDDLike EdgeRDDImpl RDD DataFrame Dataset
collectAsList
DataFrame Dataset
collectAsMap
JavaPairRDD PairRDDFunctions
collectAsync
JavaRDDLike AsyncRDDActions
collectEdges
GraphOps
collectNeighborIds
GraphOps
collectNeighbors
GraphOps
collectPartitions
JavaRDDLike
collectToPython
DataFrame
collect_list
functions
collect_set
functions
colsPerBlock
BlockMatrix
column
functions
columnSimilarities
IndexedRowMatrix RowMatrix
columns
DataFrame
combineByKey
JavaPairRDD PairRDDFunctions JavaPairDStream PairDStreamFunctions
combineByKeyWithClassTag
PairRDDFunctions
combineCombinersByKey
Aggregator
combineValuesByKey
Aggregator
commitTask
SparkHadoopMapRedUtil
compare
Decimal RDDInfo
completed
ApplicationAttemptInfo
completedJobs
JobProgressListener
completedStages
JobProgressListener
completedTasks
ExecutorSummary
completionTime
StageInfo JobData
compressed
Vector
compressedInputStream
CompressionCodec LZ4CompressionCodec LZFCompressionCodec SnappyCompressionCodec
compressedOutputStream
CompressionCodec LZ4CompressionCodec LZFCompressionCodec SnappyCompressionCodec
compute
EdgeRDD VertexRDD Gradient HingeGradient L1Updater LeastSquaresGradient LogisticGradient SimpleUpdater SquaredL2Updater Updater CoGroupedRDD HadoopRDD JdbcRDD NewHadoopRDD PartitionPruningRDD RDD ShuffledRDD UnionRDD JavaDStream JavaPairDStream ConstantInputDStream DStream ReceiverInputDStream
computeColumnSummaryStatistics
RowMatrix
computeCost
KMeansModel BisectingKMeansModel KMeansModel
computeCovariance
RowMatrix
computeError
Loss
computeGramianMatrix
IndexedRowMatrix RowMatrix
computeInitialPredictionAndError
GradientBoostedTreesModel
computePreferredLocations
InputFormatInfo
computePrincipalComponents
RowMatrix
computeSVD
IndexedRowMatrix RowMatrix
concat
functions
concat_ws
functions
conf
SparkEnv SQLContext HiveContext
confidence
Rule BoundedDouble
configuration
tree InputFormatInfo
configure
HiveContext
confusionMatrix
MulticlassMetrics
connectedComponents
GraphOps
consequent
Rule
contains
SparkConf ParamMap Column Metadata
containsBlock
StorageStatus
containsNull
ArrayType
context
InterruptibleIterator JavaRDDLike MLReader MLWriter RDD JavaDStreamLike DStream
conv
functions
convertCTAS
HiveContext
convertMetastoreParquet
HiveContext
convertMetastoreParquetWithSchemaMerging
HiveContext
convertToCanonicalEdges
GraphOps
copy
Estimator Model Pipeline PipelineModel PipelineStage Predictor Transformer UnaryTransformer DecisionTreeClassificationModel DecisionTreeClassifier GBTClassificationModel GBTClassifier LogisticRegression LogisticRegressionModel MultilayerPerceptronClassificationModel MultilayerPerceptronClassifier NaiveBayes NaiveBayesModel OneVsRest OneVsRestModel RandomForestClassificationModel RandomForestClassifier DistributedLDAModel KMeans KMeansModel LDA LocalLDAModel BinaryClassificationEvaluator Evaluator MulticlassClassificationEvaluator RegressionEvaluator Binarizer Bucketizer ChiSqSelector ChiSqSelectorModel CountVectorizer CountVectorizerModel HashingTF IDF IDFModel IndexToString Interaction MinMaxScaler MinMaxScalerModel OneHotEncoder PCA PCAModel PolynomialExpansion QuantileDiscretizer RFormula RFormulaModel RegexTokenizer SQLTransformer StandardScaler StandardScalerModel StopWordsRemover StringIndexer StringIndexerModel Tokenizer VectorAssembler VectorIndexer VectorIndexerModel VectorSlicer Word2Vec Word2VecModel ParamMap Params ALS ALSModel AFTSurvivalRegression AFTSurvivalRegressionModel DecisionTreeRegressionModel DecisionTreeRegressor GBTRegressionModel GBTRegressor IsotonicRegression IsotonicRegressionModel LinearRegression LinearRegressionModel RandomForestRegressionModel RandomForestRegressor CrossValidator CrossValidatorModel TrainValidationSplit TrainValidationSplitModel DenseMatrix DenseVector Matrix SparseMatrix SparseVector Vector ExponentialGenerator GammaGenerator LogNormalGenerator PoissonGenerator RandomDataGenerator StandardNormalGenerator UniformGenerator WeibullGenerator Strategy Row StatCounter
copyValues
Params
coresGranted
ApplicationInfo
coresPerExecutor
ApplicationInfo
corr
Statistics DataFrameStatFunctions functions
cos
functions
cosh
functions
count
JavaRDDLike EdgeRDDImpl VertexRDDImpl MultivariateOnlineSummarizer MultivariateStatisticalSummary RDD DataFrame Dataset GroupedData GroupedDataset functions JavaDStreamLike DStream OffsetRange StatCounter
countApprox
JavaRDDLike RDD
countApproxDistinct
JavaRDDLike RDD
countApproxDistinctByKey
JavaPairRDD PairRDDFunctions
countAsync
JavaRDDLike AsyncRDDActions
countByKey
JavaPairRDD PairRDDFunctions
countByKeyApprox
JavaPairRDD PairRDDFunctions
countByValue
JavaRDDLike RDD JavaDStreamLike DStream
countByValueAndWindow
JavaDStreamLike DStream
countByValueApprox
JavaRDDLike RDD
countByWindow
JavaDStreamLike DStream
countDistinct
functions
countTowardsTaskFailures
ExecutorLostFailure TaskCommitDenied TaskFailedReason
cov
DataFrameStatFunctions
crc32
functions
create
JdbcRDD PartitionPruningRDD JavaStreamingContextFactory Broker OffsetRange RateEstimator
createAggregator
Aggregator
createCombiner
Aggregator Combiner DefaultCombiner
createDataFrame
SQLContext
createDataset
SQLContext
createDirectStream
KafkaUtils
createExternalTable
SQLContext
createJDBCTable
DataFrame
createLogDir
JobLogger
createLogWriter
JobLogger
createModel
LogisticRegressionWithLBFGS LogisticRegressionWithSGD SVMWithSGD GeneralizedLinearAlgorithm LassoWithSGD LinearRegressionWithSGD RidgeRegressionWithSGD
createPollingStream
FlumeUtils
createRDD
KafkaUtils
createRDDWithLocalProperties
DStream
createRelation
DefaultSource CreatableRelationProvider HadoopFsRelationProvider RelationProvider SchemaRelationProvider
createStream
FlumeUtils KafkaUtils KinesisUtils MQTTUtils TwitterUtils ZeroMQUtils
createTransformFunc
UnaryTransformer DCT ElementwiseProduct NGram Normalizer PolynomialExpansion RegexTokenizer Tokenizer
crosstab
DataFrameStatFunctions
cube
DataFrame
cumeDist
functions
cume_dist
functions
currentAttemptId
SparkStageInfo
current_date
functions
current_timestamp
functions