Skip to content
Advertisement

Compare schema of dataframe with schema of other dataframe

I have schema from two dataset read from hdfs path and it is defined below:

val df = spark.read.parquet("/path")

df.printSchema()

JavaScript

Advertisement

Answer

Since your schema file seems like a CSV :

JavaScript

use isSchemaMatching for further logic

User contributions licensed under: CC BY-SA
1 People found this is helpful
Advertisement