Livy interpreter Scala code string interpolation

2017-11-03 Thread Tan, Jialiang
Hi, When writing Spark Scala code in zeppelin with Livy interpreter, string interpolation does not seem to work. For example: val devices = sc.objectFile[(VertexId, DeviceAttr)]( s"s3a://${bucket}/${datasetS3Prefix}/${tableName} /dt=${end_dt}/tid=${tid}/${datasetS3Suffix}") I think the dollar

Re: Livy interpreter Scala code string interpolation

2017-11-03 Thread Mohit Jaggi
I run into similar issues with shell scripts that use ${var}. Can we use a different magic notation for Z, one that has a lower chance of colliding with shell scripts and Scala code? This will be hard to do due to the variety of interpreters supported. Perhaps this can be made configurable? On Fri

Re: Livy interpreter Scala code string interpolation

2017-11-03 Thread Jeff Zhang
Yes, this is due to the dynamic forms of zeppelin. Mohit Jaggi 于2017年11月4日周六 上午2:28写道: > I run into similar issues with shell scripts that use ${var}. Can we use a > different magic notation for Z, one that has a lower chance of colliding > with shell scripts and Scala code? This will be hard to

Re: Livy interpreter Scala code string interpolation

2017-11-03 Thread Tan, Jialiang
But somehow Spark interpreter works without this problem. Why is that the case if the problem is on Zeppelin UI side? From: Jeff Zhang Reply-To: "users@zeppelin.apache.org" Date: Friday, November 3, 2017 at 4:48 PM To: "users@zeppelin.apache.org" Subject: Re: Livy interpreter Scala code string

Re: Livy interpreter Scala code string interpolation

2017-11-03 Thread Jeff Zhang
Oops, this is a bug of livy interpreter, Could you help create a ticket ? Thanks Tan, Jialiang 于2017年11月4日周六 上午7:50写道: > But somehow Spark interpreter works without this problem. Why is that the > case if the problem is on Zeppelin UI side? > > > > *From: *Jeff Zhang > *Reply-To: *"users@zeppel

Re: Livy interpreter Scala code string interpolation

2017-11-03 Thread Mohit Jaggi
So for spark interpreter does ${x} create a dynamic textbox or is interpreted as string interpolation? Or is it context-sensitive and knows about s""? On Fri, Nov 3, 2017 at 4:59 PM, Jeff Zhang wrote: > Oops, this is a bug of livy interpreter, Could you help create a ticket ? > Thanks > > >

Re: Livy interpreter Scala code string interpolation

2017-11-03 Thread Tan, Jialiang
I think for Spark interpreter it can properly process the string interpolation without any problems caused by dynamic form. From: Mohit Jaggi Reply-To: "users@zeppelin.apache.org" Date: Friday, November 3, 2017 at 5:20 PM To: "users@zeppelin.apache.org" Subject: Re: Livy interpreter Scala code

Re: Livy interpreter Scala code string interpolation

2017-11-03 Thread Jeff Zhang
Spark only enable dynamic form for sql interpreter, while livy enable it for interpreters. This is the bug of livy interpreter. Tan, Jialiang 于2017年11月4日周六 上午8:22写道: > I think for Spark interpreter it can properly process the string > interpolation without any problems caused by dynamic form. >