Converts $"col name" into a Column.
Converts $"col name" into a Column.
2.0.0
Creates a Dataset from a local Seq.
Creates a Dataset from a local Seq.
1.6.0
1.6.1
1.6.0
2.0.0
2.0.0
2.0.0
2.0.0
2.0.0
2.0.0
2.0.0
1.6.1
1.6.0
2.2.0
1.6.1
1.6.0
1.6.1
1.6.0
1.6.1
1.6.0
2.2.0
1.6.1
1.6.0
2.3.0
1.6.1
1.6.0
2.2.0
2.2.0
Notice that we serialize Set
to Catalyst array.
Notice that we serialize Set
to Catalyst array. The set property is only kept when
manipulating the domain objects. The serialization format doesn't keep the set property.
When we have a Catalyst array which contains duplicated elements and convert it to
Dataset[Set[T]]
by using the encoder, the elements will be de-duplicated.
2.3.0
1.6.1
1.6.0
1.6.1
1.6.0
2.2.0
Creates a Dataset from an RDD.
Creates a Dataset from an RDD.
1.6.0
An implicit conversion that turns a Scala Symbol
into a Column.
An implicit conversion that turns a Scala Symbol
into a Column.
1.3.0
1.6.1
1.6.1
1.6.1
1.6.1
1.6.1
1.6.1
1.6.1
1.6.1
1.6.1
:: Experimental :: (Scala-specific) Implicit methods available in Scala for converting common Scala objects into
DataFrame
s.1.3.0