Hi, when I execute sql like that: "select * from onlineDevice where deviceId not in (select deviceId from historyDevice)") I found the task spend a lot of time(over 40 min),I stopped the task but I can't found the reason from spark history UI. the historyDevice and onlineDevice only contain about 3 millions of records
spark-submit : --master yarn --deploy-mode client --driver-memory 8G --num-executors 2 --executor-memory 9G --executor-cores 6