[sbt] sbt-assembly (fat jar)

# project/plugins.sbt
addSbtPlugin("com.eed3si9n" % "sbt-assembly" % "2.1.1")

# build.sbt
assemblyMergeStrategy in assembly := {
  case PathList("META-INF", xs @ _*) => MergeStrategy.discard
  case x => MergeStrategy.first
}

sbt clean compile assembly

jar tf asdf.jar

https://stackoverflow.com/questions/28459333/how-to-build-an-uber-jar-fat-jar-using-sbt-within-intellij-idea

How to build an Uber JAR (Fat JAR) using SBT within IntelliJ IDEA?

https://andres.jaimes.net/scala/how-to-create-a-fat-jar/

How to create a self-contained jar file (fat jar) using sbt

https://stackoverflow.com/questions/32859316/include-dependencies-in-jar-using-sbt-package

Include Dependencies in JAR using SBT package

https://www.baeldung.com/jar-file-get-class-names

 

---

INFO metastore: Trying to connect to metastore with URI thrift://ip-172-31-39-192.ap-south-1.compute.internal:9083
WARN Hive: Failed to access metastore. This class should not accessed in runtime.
org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
    at org.apache.hadoop.hive.ql.metadata.Hive.getAllDatabases(Hive.java:1236)

 

libraryDependencies += "org.apache.spark" %% "spark-sql" % "2.4.5" % "provided"

https://stackoverflow.com/questions/63439816/aws-emr-spark-use-glue-as-hive-metastore

Aws Emr Spark use glue as hive metastore?