scala> Seq(1).toDS.explain(extended = true)
== Parsed Logical Plan ==
LocalRelation [value#1]
== Analyzed Logical Plan ==
value: int
LocalRelation [value#1]
== Optimized Logical Plan ==
LocalRelation [value#1]
== Physical Plan ==
LocalTableScan [value#1]
LocalTableScanExec Physical Operator
LocalTableScanExec
is a leaf SparkPlan
node with no children
and producedAttributes
being outputSet
.
LocalTableScanExec
is a result of applying BasicOperators strategy to LocalRelation and MemoryPlan logical query plans.
name | description |
---|---|
numOutputRows |
the number of output rows |
When executed (as doExecute
), LocalTableScanExec
creates an RDD
of InternalRow
s.
Figure 1. LocalTableScanExec in SQL tab in web UI