You can look it up:
https://github.com/apache/spark/blob/branch-3.2/pom.xml#L916
3.7.0-M11

On Thu, Feb 3, 2022 at 1:57 PM Amit Sharma <resolve...@gmail.com> wrote:

> Hello, everyone. I am migrating my spark stream to spark version 3.1. I
> also upgraded  json version  as below
>
> libraryDependencies += "org.json4s" %% "json4s-native" % "3.7.0-M5"
>
>
> While running the job I getting an error for the below code where I am
> serializing the given inputs.
>
> implicit val formats = 
> Serialization.formats(ShortTypeHints(List(classOf[ForecastResponse], 
> classOf[OverlayRequest],
>   classOf[FTEResponseFromSpark], classOf[QuotaResponse], 
> classOf[CloneResponse]
>
> )))
>
>
> Exception in thread "streaming-job-executor-4" java.lang.NoSuchMethodError: 
> org.json4s.ShortTypeHints$.apply$default$2()Ljava/lang/String;
>
> It seems to me jar issue, not sure which version of json4s-native should I 
> use with spark 3.1.
>
>

Reply via email to