Cannot find checkstyle.xml

2017-02-08 Thread Jakub Dubovsky
Hello there,

I am trying to build spark locally so I can test something to help resolve this
ticket .

git checkout v2.1.0
./build/mvn -Phadoop-2.6 -Phive -Phive-thriftserver -Pyarn
-Dhadoop.version=2.6.0-cdh5.7.1 -DskipTests -e clean install

This starts the build successfully. Then I changed one source file and a
version in pom.xml (exact diff). After this change when I run the same
build command as above I get failure:

Could not find resource 'dev/checkstyle.xml'

whole build log ;>>

How this one commit change can cause this error? checkstyle.xml is still
there. I run maven from project root in both cases. What should I change to
build this?

Thanks for your help

Jakub


FINAL REMINDER: CFP for ApacheCon closes February 11th

2017-02-08 Thread Rich Bowen
Dear Apache Enthusiast,

This is your FINAL reminder that the Call for Papers (CFP) for ApacheCon
Miami is closing this weekend - February 11th. This is your final
opportunity to submit a talk for consideration at this event.

This year, we are running several mini conferences in conjunction with
the main event, so if you're submitting for one of those events, please
pay attention to the instructions below.

Apache: Big Data
* Event information:
http://events.linuxfoundation.org/events/apache-big-data-north-america
* CFP:
http://events.linuxfoundation.org/events/apache-big-data-north-america/program/cfp

Apache: IoT (Internet of Things)
* Event Information: http://us.apacheiot.org/
* CFP -
http://events.linuxfoundation.org/events/apachecon-north-america/program/cfp
(Indicate 'IoT' in the Target Audience field)

CloudStack Collaboration Conference
* Event information: http://us.cloudstackcollab.org/
* CFP -
http://events.linuxfoundation.org/events/apachecon-north-america/program/cfp
(Indicate 'CloudStack' in the Target Audience field)

FlexJS Summit
* Event information - http://us.apacheflexjs.org/
* CFP -
http://events.linuxfoundation.org/events/apachecon-north-america/program/cfp
(Indicate 'Flex' in the Target Audience field)

TomcatCon
* Event information - https://tomcat.apache.org/conference.html
* CFP -
http://events.linuxfoundation.org/events/apachecon-north-america/program/cfp
(Indicate 'Tomcat' in the Target Audience field)

All other topics and projects
* Event information -
http://events.linuxfoundation.org/events/apachecon-north-america/program/about
* CFP -
http://events.linuxfoundation.org/events/apachecon-north-america/program/cfp

Admission to any of these events also grants you access to all of the
others.

Thanks, and we look forward to seeing you in Miami!

-- 
Rich Bowen
VP Conferences, Apache Software Foundation
rbo...@apache.org
Twitter: @apachecon



(You are receiving this email because you are subscribed to a dev@ or
users@ list of some Apache Software Foundation project. If you do not
wish to receive email from these lists any more, you must follow that
list's unsubscription procedure. View the headers of this message for
unsubscription instructions.)

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org



Re: Cannot find checkstyle.xml

2017-02-08 Thread Jakub Dubovsky
Sorry, correct links set in text below.

Hello there,
>
> I am trying to build spark locally so I can test something to help resolve 
> this
> ticket .
>
> git checkout v2.1.0
> ./build/mvn -Phadoop-2.6 -Phive -Phive-thriftserver -Pyarn
> -Dhadoop.version=2.6.0-cdh5.7.1 -DskipTests -e clean install
>
> This starts the build successfully. Then I changed one source file and a
> version in pom.xml (exact diff
> ).
> After this change when I run the same build command as above I get failure:
>
> Could not find resource 'dev/checkstyle.xml'
>
> whole build log
> 
>
> How this one commit change can cause this error? checkstyle.xml is still
> there. I run maven from project root in both cases. What should I change to
> build this?
>
> Thanks for your help
>
> Jakub
>
>


Re: Cannot find checkstyle.xml

2017-02-08 Thread Jakub Dubovsky
Sorry, correct links set in text below.


Hello there,

I am trying to build spark locally so I can test something to help resolve this
ticket .

git checkout v2.1.0
./build/mvn -Phadoop-2.6 -Phive -Phive-thriftserver -Pyarn
-Dhadoop.version=2.6.0-cdh5.7.1 -DskipTests -e clean install

This starts the build successfully. Then I changed one source file and a
version in pom.xml (exact diff
). After
this change when I run the same build command as above I get failure:

Could not find resource 'dev/checkstyle.xml'

whole build log


How this one commit change can cause this error? checkstyle.xml is still
there. I run maven from project root in both cases. What should I change to
build this?

Thanks for your help

Jakub


Structured Streaming. S3 To Google BigQuery

2017-02-08 Thread Sam Elamin
Hi All

Thank you all for the amazing support! I have written a BigQuery connector
for structured streaming that you can find here


I just tweeted 
about it and would really appreciated it if you retweeted when you get a
chance

The more people know about it and use it the more feedback I can get to
make the connector better!

Ofcourse PRs and feedback are always welcome :)

Thanks again!

Regards
Sam


when is doGenCode called?

2017-02-08 Thread Koert Kuipers
hello all,
i am trying to add an Expression to catalyst.

my Expression compiles fine and has:

override def eval(input: InternalRow): Any = ...

override def doGenCode(ctx: CodegenContext, ev: ExprCode): ExprCode = ...

it also seems to run fine. but i only ever see eval get called. how do i
tell spark to use doGenCode instead of eval?

thanks! koert