You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Should we stop the sparksession?
when I submit the command in yarn, spark-submit --class com.yotpo.metorikku.Metorikku --master yarn --deploy-mode client ~/metorikku/metorikku.jar -c examples/movies.yaml
metorikku app has finished the job but still wait to close the sparksession with a loop, log shows as follow,
when I stop the sparkSession, the above problem solved session.sparkSession.stop()
The text was updated successfully, but these errors were encountered:
metorikku/src/main/scala/com/yotpo/metorikku/Metorikku.scala
Line 29 in 6c6c6e6
Should we stop the sparksession?
when I submit the command in yarn,
spark-submit --class com.yotpo.metorikku.Metorikku --master yarn --deploy-mode client ~/metorikku/metorikku.jar -c examples/movies.yaml
metorikku app has finished the job but still wait to close the sparksession with a loop, log shows as follow,
when I stop the sparkSession, the above problem solved
session.sparkSession.stop()
The text was updated successfully, but these errors were encountered: