JDBCRelation

JDBCRelation is a BaseRelation and InsertableRelation with support for PrunedFilteredScan.

JDBCRelation is created when:

JDBCRelation presents itself with the name of the table and the number of partitions (if given).

JDBCRelation([table]) [numPartitions=[number]]
spark sql JDBCRelation webui query details.png
Figure 1. JDBCRelation in web UI (Details for Query)
scala> df.explain
== Physical Plan ==
*Scan JDBCRelation(projects) [numPartitions=1] [id#0,name#1,website#2] ReadSchema: struct<id:int,name:string,website:string>

JDBCRelation as BaseRelation

JDBCRelation is a BaseRelation which represents a collection of tuples with a schema.

Table 1. JDBCRelation as BaseRelation
Method Description

needConversion

Disabled (i.e. false)

schema

StructType

sqlContext

SQLContext from SparkSession

unhandledFilters

FIXME

JDBCRelation as PrunedFilteredScan

JDBCRelation is a PrunedFilteredScan.

Table 2. JDBCRelation as PrunedFilteredScan
Method Description

buildScan

FIXME

JDBCRelation as InsertableRelation

JDBCRelation is a InsertableRelation.

Table 3. JDBCRelation as InsertableRelation
Method Description

insert

FIXME

columnPartition Method

Caution
 FIXME Is this still in use?

Creating JDBCRelation Instance

JDBCRelation takes the following when created:

results matching ""

    No results matching ""