What Nick said was correct. What I should also state is that I am using python spark variant in this case not the scala.
I am looking to use the guid prefix of part-0 to prevent a race condition by using a s3 waiter for the part to appear, but to achieve this, I need to know the guid value in advance. Thank you all again for your help. Regards, George -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ --------------------------------------------------------------------- To unsubscribe e-mail: dev-unsubscr...@spark.apache.org