[GitHub] [incubator-doris] wuyunfeng opened a new issue #1525: Expose data pruned-filter-scan ability for Integrating Spark and Doris

wuyunfeng opened a new issue #1525: Expose data pruned-filter-scan ability for Integrating Spark and Doris URL: https://github.com/apache/incubator-doris/issues/1525 ### Background 1. Recently years, Machine Learning intensively are integrated to computing system such as Spark MLib fo

[GitHub] [incubator-doris] imay commented on a change in pull request #1515: Add storage rowwise iterator

imay commented on a change in pull request #1515: Add storage rowwise iterator URL: https://github.com/apache/incubator-doris/pull/1515#discussion_r305700627 ## File path: be/src/olap/generic_iterators.cpp ## @@ -0,0 +1,346 @@ +// Licensed to the Apache Software Foundation

[GitHub] [incubator-doris] imay commented on a change in pull request #1515: Add storage rowwise iterator

imay commented on a change in pull request #1515: Add storage rowwise iterator URL: https://github.com/apache/incubator-doris/pull/1515#discussion_r305700583 ## File path: be/src/olap/generic_iterators.cpp ## @@ -0,0 +1,346 @@ +// Licensed to the Apache Software Foundation

[GitHub] [incubator-doris] imay commented on a change in pull request #1515: Add storage rowwise iterator

imay commented on a change in pull request #1515: Add storage rowwise iterator URL: https://github.com/apache/incubator-doris/pull/1515#discussion_r305701273 ## File path: be/src/olap/row_block2.h ## @@ -0,0 +1,113 @@ +// Licensed to the Apache Software Foundation (ASF) und

[GitHub] [incubator-doris] imay commented on a change in pull request #1515: Add storage rowwise iterator

imay commented on a change in pull request #1515: Add storage rowwise iterator URL: https://github.com/apache/incubator-doris/pull/1515#discussion_r305702566 ## File path: be/src/olap/generic_iterators.cpp ## @@ -0,0 +1,346 @@ +// Licensed to the Apache Software Foundation

[GitHub] [incubator-doris] imay commented on a change in pull request #1505: Add timediff function

imay commented on a change in pull request #1505: Add timediff function URL: https://github.com/apache/incubator-doris/pull/1505#discussion_r305703865 ## File path: be/src/exprs/literal.cpp ## @@ -87,6 +87,11 @@ Literal::Literal(const TExprNode& node) : _value.date

[GitHub] [incubator-doris] imay commented on a change in pull request #1505: Add timediff function

imay commented on a change in pull request #1505: Add timediff function URL: https://github.com/apache/incubator-doris/pull/1505#discussion_r305705377 ## File path: be/src/runtime/result_writer.cpp ## @@ -104,6 +104,39 @@ Status ResultWriter::add_one_row(TupleRow* row) {

[GitHub] [incubator-doris] imay commented on a change in pull request #1505: Add timediff function

imay commented on a change in pull request #1505: Add timediff function URL: https://github.com/apache/incubator-doris/pull/1505#discussion_r305705198 ## File path: be/src/runtime/raw_value.cpp ## @@ -267,6 +267,7 @@ void RawValue::write(const void* value, void* dst, const

[GitHub] [incubator-doris] imay commented on a change in pull request #1505: Add timediff function

imay commented on a change in pull request #1505: Add timediff function URL: https://github.com/apache/incubator-doris/pull/1505#discussion_r305704769 ## File path: be/src/exprs/time_operators.h ## @@ -0,0 +1,48 @@ +// Licensed to the Apache Software Foundation (ASF) under

[GitHub] [incubator-doris] imay commented on a change in pull request #1505: Add timediff function

imay commented on a change in pull request #1505: Add timediff function URL: https://github.com/apache/incubator-doris/pull/1505#discussion_r305705811 ## File path: fe/src/main/java/org/apache/doris/catalog/Function.java ## @@ -480,6 +481,7 @@ public static String getUdfTyp

[GitHub] [incubator-doris] imay commented on a change in pull request #1505: Add timediff function

imay commented on a change in pull request #1505: Add timediff function URL: https://github.com/apache/incubator-doris/pull/1505#discussion_r305707087 ## File path: fe/src/main/java/org/apache/doris/catalog/PrimitiveType.java ## @@ -480,6 +486,7 @@ public static boolean isI

[GitHub] [incubator-doris] wuyunfeng opened a new pull request #1526: Add spark-doris-connector overview

wuyunfeng opened a new pull request #1526: Add spark-doris-connector overview URL: https://github.com/apache/incubator-doris/pull/1526 spark-doris-connector architecture overview This is an automated message from the Apache Gi

[GitHub] [incubator-doris] wuyunfeng commented on issue #1526: Add spark-doris-connector overview

wuyunfeng commented on issue #1526: Add spark-doris-connector overview URL: https://github.com/apache/incubator-doris/pull/1526#issuecomment-513680135 [architecture](https://github.com/apache/incubator-doris/issues/1525) This

[GitHub] [incubator-doris] wuyunfeng opened a new pull request #1527: Expose data pruned-filter-scan ability

wuyunfeng opened a new pull request #1527: Expose data pruned-filter-scan ability URL: https://github.com/apache/incubator-doris/pull/1527 This PR is related with [Spark-Doris-Connector](https://github.com/apache/incubator-doris/issues/1525). The First Step is Expose data pruned-fi

[GitHub] [incubator-doris] kangpinghuang commented on a change in pull request #1409: Add dict page

kangpinghuang commented on a change in pull request #1409: Add dict page URL: https://github.com/apache/incubator-doris/pull/1409#discussion_r305778667 ## File path: be/src/olap/rowset/segment_v2/binary_dict_page.cpp ## @@ -0,0 +1,231 @@ +// Licensed to the Apache Software

[GitHub] [incubator-doris] kangpinghuang commented on a change in pull request #1409: Add dict page

kangpinghuang commented on a change in pull request #1409: Add dict page URL: https://github.com/apache/incubator-doris/pull/1409#discussion_r305779712 ## File path: be/src/olap/rowset/segment_v2/binary_dict_page.cpp ## @@ -0,0 +1,231 @@ +// Licensed to the Apache Software

[GitHub] [incubator-doris] kangpinghuang commented on a change in pull request #1409: Add dict page

kangpinghuang commented on a change in pull request #1409: Add dict page URL: https://github.com/apache/incubator-doris/pull/1409#discussion_r305781309 ## File path: be/src/olap/rowset/segment_v2/binary_dict_page.cpp ## @@ -0,0 +1,231 @@ +// Licensed to the Apache Software

[GitHub] [incubator-doris] wuyunfeng closed pull request #1527: Expose data pruned-filter-scan ability

wuyunfeng closed pull request #1527: Expose data pruned-filter-scan ability URL: https://github.com/apache/incubator-doris/pull/1527 This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [incubator-doris] wuyunfeng opened a new pull request #1527: Expose data pruned-filter-scan ability

wuyunfeng opened a new pull request #1527: Expose data pruned-filter-scan ability URL: https://github.com/apache/incubator-doris/pull/1527 This PR is related with [Spark-Doris-Connector](https://github.com/apache/incubator-doris/issues/1525). The First Step is Expose data pruned-fi

[GitHub] [incubator-doris] morningman opened a new pull request #1528: Fix bug that user with LOAD_PRIV can see load job by SHOW LOAD stmt

morningman opened a new pull request #1528: Fix bug that user with LOAD_PRIV can see load job by SHOW LOAD stmt URL: https://github.com/apache/incubator-doris/pull/1528 User should has LOAD_PRIV to use SHOW LOAD stmt, not SHOW_PRIV. -

Expose data pruned-filter-scan ability for Integrating Spark and Doris

Hi, all Doris Commiter Recently I will create a pull request for Expose data pruned-filter-scan ability for Integrating Spark and Doris. Please propose this proposal, thanks. The First Step is Expose data pruned-filter-scan ability, then implement the Spark-Doris-Connector on Spark side. bel

[GitHub] [incubator-doris] imay closed pull request #1413: Add short key index builder, decoder, iterator

imay closed pull request #1413: Add short key index builder, decoder, iterator URL: https://github.com/apache/incubator-doris/pull/1413 This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [incubator-doris] imay merged pull request #1528: Fix bug that user with LOAD_PRIV can see load job by SHOW LOAD stmt

imay merged pull request #1528: Fix bug that user with LOAD_PRIV can see load job by SHOW LOAD stmt URL: https://github.com/apache/incubator-doris/pull/1528 This is an automated message from the Apache Git Service. To respon

[GitHub] [incubator-doris] imay opened a new pull request #1529: Refactor agg

imay opened a new pull request #1529: Refactor agg URL: https://github.com/apache/incubator-doris/pull/1529 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [incubator-doris] gaodayue commented on a change in pull request #1409: Add dict page

gaodayue commented on a change in pull request #1409: Add dict page URL: https://github.com/apache/incubator-doris/pull/1409#discussion_r306099633 ## File path: be/src/olap/rowset/segment_v2/bitshuffle_page.h ## @@ -170,11 +148,11 @@ class BitshufflePageBuilder : public Pag

[GitHub] [incubator-doris] yiguolei commented on a change in pull request #1497: Add ALTER_TABLET task in be

yiguolei commented on a change in pull request #1497: Add ALTER_TABLET task in be URL: https://github.com/apache/incubator-doris/pull/1497#discussion_r306106519 ## File path: be/src/olap/schema_change.cpp ## @@ -1121,6 +1121,207 @@ bool SchemaChangeWithSorting::_external_s

[GitHub] [incubator-doris] yiguolei commented on a change in pull request #1497: Add ALTER_TABLET task in be

yiguolei commented on a change in pull request #1497: Add ALTER_TABLET task in be URL: https://github.com/apache/incubator-doris/pull/1497#discussion_r306107406 ## File path: be/src/olap/schema_change.cpp ## @@ -1121,6 +1121,207 @@ bool SchemaChangeWithSorting::_external_s

[GitHub] [incubator-doris] yiguolei commented on a change in pull request #1497: Add ALTER_TABLET task in be

yiguolei commented on a change in pull request #1497: Add ALTER_TABLET task in be URL: https://github.com/apache/incubator-doris/pull/1497#discussion_r306107360 ## File path: be/src/olap/schema_change.cpp ## @@ -1121,6 +1121,207 @@ bool SchemaChangeWithSorting::_external_s

[GitHub] [incubator-doris] yiguolei commented on a change in pull request #1497: Add ALTER_TABLET task in be

yiguolei commented on a change in pull request #1497: Add ALTER_TABLET task in be URL: https://github.com/apache/incubator-doris/pull/1497#discussion_r306107791 ## File path: be/src/olap/schema_change.cpp ## @@ -1121,6 +1121,207 @@ bool SchemaChangeWithSorting::_external_s

[GitHub] [incubator-doris] imay merged pull request #1505: Add timediff function

imay merged pull request #1505: Add timediff function URL: https://github.com/apache/incubator-doris/pull/1505 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [incubator-doris] morningman opened a new pull request #1530: Add more logs and metrics to trace the broker load process

morningman opened a new pull request #1530: Add more logs and metrics to trace the broker load process URL: https://github.com/apache/incubator-doris/pull/1530 1. The Operator wants to known when the job being scheduled as PENDING and LOADING. And how long it takes to finish these sub st