Apply for contributor permission

2019-05-08 Thread Rui Li
Hi team,

Could someone add me as a contributor? My JIRA username is lirui.
Thanks!

-- 
Best regards!
Rui Li


[jira] [Created] (FLINK-12443) Replace InternalType with LogicalType in blink runner

2019-05-08 Thread Jingsong Lee (JIRA)
Jingsong Lee created FLINK-12443:


 Summary: Replace InternalType with LogicalType in blink runner
 Key: FLINK-12443
 URL: https://issues.apache.org/jira/browse/FLINK-12443
 Project: Flink
  Issue Type: Sub-task
  Components: Table SQL / Planner
Reporter: Jingsong Lee
Assignee: Jingsong Lee


LogicalType can cover all InternalType, and its function is more perfect.

With isNullable, we can do null check optimizer in code generator.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (FLINK-12444) Large number of broken links in chinese docs

2019-05-08 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-12444:


 Summary: Large number of broken links in chinese docs
 Key: FLINK-12444
 URL: https://issues.apache.org/jira/browse/FLINK-12444
 Project: Flink
  Issue Type: Bug
  Components: Documentation
Affects Versions: 1.9.0
Reporter: Chesnay Schepler


{code}
[2019-05-07 11:35:10] ERROR `/zh/dev/stream/side_output.html' not found.
[2019-05-07 11:35:11] ERROR `/dev/table/(/dev/table/sourceSinks.html' not found.
[2019-05-07 11:35:15] ERROR `/zh/release-notes/flink-1.8.html' not found.
[2019-05-07 11:35:15] ERROR `/zh/release-notes/flink-1.7.html' not found.
[2019-05-07 11:35:15] ERROR `/zh/release-notes/flink-1.6.html' not found.
[2019-05-07 11:35:15] ERROR `/zh/release-notes/flink-1.5.html' not found.
[2019-05-07 11:35:15] ERROR `/zh/fig/levels_of_abstraction.svg' not found.
[2019-05-07 11:35:15] ERROR `/zh/dev/table_api.html' not found.
[2019-05-07 11:35:15] ERROR `/zh/fig/program_dataflow.svg' not found.
[2019-05-07 11:35:15] ERROR `/zh/fig/parallel_dataflow.svg' not found.
[2019-05-07 11:35:15] ERROR `/zh/fig/windows.svg' not found.
[2019-05-07 11:35:15] ERROR `/zh/fig/event_ingestion_processing_time.svg' not 
found.
[2019-05-07 11:35:15] ERROR `/zh/fig/state_partitioning.svg' not found.
[2019-05-07 11:35:15] ERROR `/zh/fig/tasks_chains.svg' not found.
[2019-05-07 11:35:15] ERROR `/zh/fig/processes.svg' not found.
[2019-05-07 11:35:15] ERROR `/zh/fig/tasks_slots.svg' not found.
[2019-05-07 11:35:15] ERROR `/zh/fig/slot_sharing.svg' not found.
[2019-05-07 11:35:15] ERROR `/zh/fig/checkpoints.svg' not found.
[2019-05-07 11:35:15] ERROR `/zh/dev/linking_with_flink.html' not found.
[2019-05-07 11:35:15] ERROR `/zh/dev/linking.html' not found.
[2019-05-07 11:35:15] ERROR 
`/zh/apis/streaming/event_timestamps_watermarks.html' not found.
[2019-05-07 11:35:15] ERROR 
`/zh/apis/streaming/event_timestamp_extractors.html' not found.
[2019-05-07 11:35:15] ERROR `/zh/apis/streaming/event_time.html' not found.
[2019-05-07 11:35:15] ERROR `/zh/dev/table/(/dev/table/sourceSinks.html' not 
found.
[2019-05-07 11:35:15] ERROR `/zh/fig/checkpoint_tuning.svg' not found.
[2019-05-07 11:35:15] ERROR `/zh/fig/local_recovery.png' not found.
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (FLINK-12445) YARNSessionCapacitySchedulerITCase#testVCoresAreSetCorrectlyAndJobManagerHostnameAreShownInWebInterfaceAndDynamicPropertiesAndYarnApplicationNameAndTaskManagerSlots does

2019-05-08 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-12445:


 Summary: 
YARNSessionCapacitySchedulerITCase#testVCoresAreSetCorrectlyAndJobManagerHostnameAreShownInWebInterfaceAndDynamicPropertiesAndYarnApplicationNameAndTaskManagerSlots
 does not stop application on failure
 Key: FLINK-12445
 URL: https://issues.apache.org/jira/browse/FLINK-12445
 Project: Flink
  Issue Type: Bug
  Components: Deployment / YARN, Tests
Affects Versions: 1.9.0
Reporter: Chesnay Schepler
Assignee: Chesnay Schepler
 Fix For: 1.9.0


https://travis-ci.org/apache/flink/jobs/529632257



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (FLINK-12446) Add documentation how to enable openSSL

2019-05-08 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-12446:
---

 Summary: Add documentation how to enable openSSL
 Key: FLINK-12446
 URL: https://issues.apache.org/jira/browse/FLINK-12446
 Project: Flink
  Issue Type: Sub-task
  Components: Documentation, Runtime / Network
Affects Versions: 1.9.0
Reporter: Nico Kruber
Assignee: Nico Kruber


Since we won't include openSSL support by default, we should describe the (two) 
way of enabling this for Flink.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[VOTE] Release flink-shaded 7.0, release candidate 1

2019-05-08 Thread jincheng sun
Hi everyone,

Please review and vote on the release candidate #1 for the version 7.0, as
follows:

[ ] +1, Approve the release
[ ] -1, Do not approve the release (please provide specific comments)

The complete staging area is available for your review, which includes:
* JIRA release notes [1],
* the official Apache source release to be deployed to dist.apache.org [2],
which are signed with the key with fingerprint 8FEA1EE9 [3],
* all artifacts to be deployed to the Maven Central Repository [4],
* source code tag "release-7.0-rc1" [5],
* website pull request listing the new release [6].

The vote will be open for at least 72 hours. It is adopted by majority
approval, with at least 3 PMC affirmative votes.

NOTE:
After I finished RC1, we found that
https://issues.apache.org/jira/browse/FLINK-11580, Chesnay Schepler, Nico
and Me had reached an agreement. It was better to put FLINK-11580 in
flink-shaded-7.0.
But in order to find out other problems earlier, we vote on RC1 first. If
FLINK-11580 is completed in a week, I will be very willing to prepare RC2.
If it takes a long time, we will release FLINK-11580 again later. Please
let me know what do you think?

Thanks,
Jincheng

[1]
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12345226&styleName=Html&projectId=12315522&Create=Create&atl_token=A5KQ-2QAV-T4JA-FDED%7C8ba061049bec0c5a72dc0191c47bb53a73b82cb4%7Clin
[2] https://dist.apache.org/repos/dist/dev/flink/flink-shaded-7.0-rc1/
[3] https://dist.apache.org/repos/dist/release/flink/KEYS
[4] https://repository.apache.org/content/repositories/orgapacheflink-1217
[5] https://github.com/apache/flink-shaded/tree/release-7.0-rc1
[6] https://github.com/apache/flink-web/pull/209


[jira] [Created] (FLINK-12447) Bump required Maven version to 3.1.1 (from 3.0.3)

2019-05-08 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-12447:
--

 Summary: Bump required Maven version to 3.1.1 (from 3.0.3)
 Key: FLINK-12447
 URL: https://issues.apache.org/jira/browse/FLINK-12447
 Project: Flink
  Issue Type: Task
  Components: Build System
Reporter: Robert Metzger
Assignee: Robert Metzger


See 
https://lists.apache.org/thread.html/57dec7c338eb95247b7a05ded371f4a78420a964045ea9557d501c3f@%3Cdev.flink.apache.org%3E
 

The frontend-maven-plugin requires at least Maven 3.1.0.
I propose to bump the required Maven version to 3.1.1.




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (FLINK-12448) FlinkKafkaProducer late closure after class loader

2019-05-08 Thread Chris Slotterback (JIRA)
Chris Slotterback created FLINK-12448:
-

 Summary: FlinkKafkaProducer late closure after class loader
 Key: FLINK-12448
 URL: https://issues.apache.org/jira/browse/FLINK-12448
 Project: Flink
  Issue Type: Bug
  Components: Connectors / Kafka
Affects Versions: 1.7.2
Reporter: Chris Slotterback


During job failure/restart, FlinkKafkaProducer configured with 
Semantic.EXACTLY_ONCE fails to disconnect properly do to a NoClassDefFoundError:
{noformat}
java.lang.NoClassDefFoundError: org/apache/kafka/clients/NetworkClient$1

at 
org.apache.kafka.clients.NetworkClient.processDisconnection(NetworkClient.java:658)

at 
org.apache.kafka.clients.NetworkClient.handleDisconnections(NetworkClient.java:805)

at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:520)

at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:226)

at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:163)

at java.lang.Thread.run(Thread.java:748){noformat}
 

This begins a restart loop where the job never recovers properly. This is 
reproducible only with EXACTLY_ONCE semantic, AT_LEAST_ONCE properly 
disconnects and restarts without error.

This issue is described in FLINK-10455, but has been since marked as Fixed, but 
still reproducible.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (FLINK-12449) [Bitwise Functions] Add BIT_AND, BIT_OR functions supported in Table API and SQL

2019-05-08 Thread Zhanchun Zhang (JIRA)
Zhanchun Zhang created FLINK-12449:
--

 Summary: [Bitwise Functions] Add BIT_AND,  BIT_OR functions 
supported in Table API and SQL
 Key: FLINK-12449
 URL: https://issues.apache.org/jira/browse/FLINK-12449
 Project: Flink
  Issue Type: Sub-task
  Components: Table SQL / API
Reporter: Zhanchun Zhang
Assignee: Zhanchun Zhang


Bitwise AND.

eg. SELECT BIT_AND(29,15), returns 13 

Bitwise OR

eg. SELECT BIT_OR(29 ,15), returns 31




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (FLINK-12450) [Bitwise Functions] Add BIT_LSHIFT, BIT_RSHIFT functions supported in Table API and SQL

2019-05-08 Thread Zhanchun Zhang (JIRA)
Zhanchun Zhang created FLINK-12450:
--

 Summary: [Bitwise Functions] Add BIT_LSHIFT, BIT_RSHIFT functions 
supported in Table API and SQL
 Key: FLINK-12450
 URL: https://issues.apache.org/jira/browse/FLINK-12450
 Project: Flink
  Issue Type: Sub-task
Reporter: Zhanchun Zhang
Assignee: Zhanchun Zhang


BIT_LSHIFT, Shifts a long number to the left

BIT_RSHIFT, Shifts a long number to the right



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (FLINK-12451) [Bitwise Functions] Add BIT_XOR function supported in Table API and SQL

2019-05-08 Thread Zhanchun Zhang (JIRA)
Zhanchun Zhang created FLINK-12451:
--

 Summary: [Bitwise Functions] Add BIT_XOR function supported in 
Table API and SQL
 Key: FLINK-12451
 URL: https://issues.apache.org/jira/browse/FLINK-12451
 Project: Flink
  Issue Type: Sub-task
Reporter: Zhanchun Zhang
Assignee: Zhanchun Zhang


Bitwise XOR, returns an unsigned 64-bit integer.

eg:
SELECT 1 ^ 1; returns 0

SELECT 1 ^ 0; returns 1

SELECT 11 ^ 3; returns 8



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (FLINK-12452) alterTable() should ensure existing base table and the new one are of the same type

2019-05-08 Thread Bowen Li (JIRA)
Bowen Li created FLINK-12452:


 Summary: alterTable() should ensure existing base table and the 
new one are of the same type
 Key: FLINK-12452
 URL: https://issues.apache.org/jira/browse/FLINK-12452
 Project: Flink
  Issue Type: Sub-task
  Components: Connectors / Hive, Table SQL / API
Reporter: Bowen Li
Assignee: Bowen Li
 Fix For: 1.9.0


Currently all catalogs does check if existing base table and the new one are of 
the same type in alterTable(). We should add the check to all catalogs



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (FLINK-12453) StreamExecGlobalGroupAggregate construct wrong args for AggsHandlerCodeGenerator

2019-05-08 Thread Jingsong Lee (JIRA)
Jingsong Lee created FLINK-12453:


 Summary: StreamExecGlobalGroupAggregate construct wrong args for 
AggsHandlerCodeGenerator
 Key: FLINK-12453
 URL: https://issues.apache.org/jira/browse/FLINK-12453
 Project: Flink
  Issue Type: Bug
  Components: Table SQL / Planner
Reporter: Jingsong Lee
Assignee: Jark Wu


In generateAggsHandler: 

val generator = new AggsHandlerCodeGenerator(
  CodeGeneratorContext(config),
  relBuilder,
  FlinkTypeFactory.toInternalRowType(inputRowType).getFieldTypes,
  needRetract = false,
  config.getNullCheck,
  inputFieldCopy)

but AggsHandlerCodeGenerator args is:

class AggsHandlerCodeGenerator(
  ctx: CodeGeneratorContext,
  relBuilder: RelBuilder,
  inputFieldTypes: Seq[InternalType],
  needRetract: Boolean,
  copyInputField: Boolean,
  needAccumulate: Boolean = true)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (FLINK-12454) Add custom check options for lint-python.sh

2019-05-08 Thread sunjincheng (JIRA)
sunjincheng created FLINK-12454:
---

 Summary: Add custom check options for lint-python.sh
 Key: FLINK-12454
 URL: https://issues.apache.org/jira/browse/FLINK-12454
 Project: Flink
  Issue Type: Sub-task
  Components: API / Python
Affects Versions: 1.9.0
Reporter: sunjincheng
Assignee: sunjincheng


At present, int-python.sh has Python compatibility checks and code style 
checks. By default, all checks will be executed by default. In the development 
stage, only one check may be required in some case. Therefore, in this JIRA, 
the specified check item parameters are added for lint-python.sh.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (FLINK-12455) Move the package of pyflink to flink-dist

2019-05-08 Thread Dian Fu (JIRA)
Dian Fu created FLINK-12455:
---

 Summary: Move the package of pyflink to flink-dist
 Key: FLINK-12455
 URL: https://issues.apache.org/jira/browse/FLINK-12455
 Project: Flink
  Issue Type: Sub-task
  Components: API / Python
Reporter: Dian Fu
Assignee: Dian Fu


Currently, there is a pom.xml under module flink-python which is responsible 
for the package of pyflink. The package logic should be moved to flink-dist and 
then we can remove the pom.xml under flink-python and make flink-python a pure 
python module.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (FLINK-12456) Wrong CharType convertion in type_utils.py

2019-05-08 Thread Jingsong Lee (JIRA)
Jingsong Lee created FLINK-12456:


 Summary: Wrong CharType convertion in type_utils.py
 Key: FLINK-12456
 URL: https://issues.apache.org/jira/browse/FLINK-12456
 Project: Flink
  Issue Type: Bug
Reporter: Jingsong Lee


In types.py: define CharType as SQL CHAR, but SQL CHAR is a Java String instead 
of Java Character.

In type_utils.py, 

org.apache.flink.api.common.typeinfo.Types.CHAR map to DataTypes.CHAR, it is 
wrong. Types.CHAR is Java Character.

I suggest that consider removing Char's support first.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (FLINK-12457) Remove char support in blink

2019-05-08 Thread Jingsong Lee (JIRA)
Jingsong Lee created FLINK-12457:


 Summary: Remove char support in blink
 Key: FLINK-12457
 URL: https://issues.apache.org/jira/browse/FLINK-12457
 Project: Flink
  Issue Type: Improvement
  Components: Table SQL / Planner
Reporter: Jingsong Lee
Assignee: Jingsong Lee


Sql types don't support java char. CharType(InternalType) in blink and CharType 
of the new type system are very confusing, we should remove the current support 
for Java char in blink.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)