The fromRow method is removed in spark3.0. And the new API is :
val encoder = RowEncoder(schema)
val row = encoder.createDeserializer().apply(internalRow)
Thanks,
Jia Ke
From: Wenchen Fan
Sent: Friday, November 27, 2020 9:32 PM
To: Jason Jun
Cc: Spark dev list
Subject: Re: How to convert Inter
runtime statistic for further optimization not table stats.
So it seems the effect of table stats may be small to this benchmark tests.
Thanks.
Regards,
Jia Ke
From: Amogh Margoor
Sent: Friday, February 14, 2020 5:02 AM
To: Wenchen Fan
Cc: Jia, Ke A ; dev@spark.apache.org
Subject: Re: Adapti
Hi all,
We have completed the Spark 3.0 Adaptive Query Execution(AQE) performance tests
in 3TB TPC-DS on 5 node Cascade Lake cluster. 2 queries bring about more than
1.5x performance and 37 queries bring more than 1.1x performance with AQE.
There is no query has significant performance degradat
Hi Ben and Felix,
This is Jia Ke from Intel Big Data Team. And I'm also interested in this. Would
you please add me to the invite, thanks a lot.
Best regards,
Jia Ke
From: Qi,He
Sent: Thursday, December 05, 2019 11:12 AM
To: Saisai Shao
Cc: Liu,Linhong ; Aniket Mokashi ;
Felix Cheung ; Ben Sid
