Spark Implicit $ for DataFrame

15,514

If you see the following link

class SQLContext.implicits$.StringToColumn

Converts $"col name" into an Column.

Here is the link for latest version.

Share:
15,514
nobody
Author by

nobody

Updated on June 11, 2022

Comments

  • nobody
    nobody almost 2 years

    Where in the sqlContext.implicits._ does it define the $"string" to represent a dataframe call to the parent dataframe's column? Specifically I was confused on seeing something like the following:

    import sqlContext.implicits._
    df.where($"type".isin("type1","type2") and $"status".isin("completed","inprogress"))