F.trim(F.substring(F.col(“value”), 13 ... do not need to define a Schema and then pass it into a separate load statement as you can use pyspark.sql.functions to parse data into new columns with desire...
F.trim(F.substring(F.col(“value”), 13 ... do not need to define a Schema and then pass it into a separate load statement as you can use pyspark.sql.functions to parse data into new columns with desire...