[scala] loop & data = data ++ data

val path = "s3://data/seunggabi/orc"
val extension = path.substring(path.lastIndexOf("/") + 1)

var data = Seq(
    ("asdf", "asdf")
)
for(a <- 1 to 13) {
    data = data ++ data
}

for(a <- 1 to 100) {
    val df = spark.createDataFrame(data).toDF("a", "b")

    df
        .repartition(1)
        .write
        .format(extension)
        .mode(SaveMode.Append)
        .save(path)
}

https://www.tutorialspoint.com/scala/scala_for_loop.htm

Scala - for Loops

https://alvinalexander.com/scala/how-to-append-prepend-items-vector-seq-in-scala/

Scala: How to append and prepend items to Vector and Seq | alvinalexander.com

https://stackoverflow.com/questions/27033823/how-to-overwrite-the-output-directory-in-spark

How to overwrite the output directory in spark

https://sparkbyexamples.com/apache-hive/spark-unable-to-instantiate-sparksession-with-hive-support-because-hive-classes-are-not-found/

Solved: Unable to instantiate SparkSession with Hive support because Hive classes are not found - Spark By {Examples}