[Spark] scala DataFrame 생성하기 for 예제

scala에서 dataframe을 생성하는 코드

코드

	import spark.implicits._
	val df1 = Seq(("kwdId_1", 0.1, 0.2, 0.0), ("kwdId_2", 0.1, 0.2, 0.5), ("kwdId_3", 0.1, 0.2, 1.0 )).toDF("nccKeywordId", "col1", "col2", "col3")
	val df2 = Seq(("kwdId_2", 1.0), ("kwdId_3", 0.5), ("kwdId_4", 0.0)).toDF("newNccKeywordId", "col1")

view raw spark_df_example.scala hosted with ❤ by GitHub

• 참고
  • https://sparkbyexamples.com/spark/different-ways-to-create-a-spark-dataframe/