This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch master
in repository
https://gitbox.apache.org/repos/asf/incubator-doris-spark-connector.git.
discard afb45af [Bug-Fix][Spark-Doris-Connector] resolve the problem of
writing Chinese garbled characters (#6)
discard f7f995a [community](license) Add license file for dependencies (#5)
omit 1e6c5a8 unprotected (#4)
omit ff7f389 [community] move GitBox mail to commits@doris (#3)
omit 8fdc9f4 [fix](spark connector) fix spark connector unsupport STRING
type. (#2)
omit b549f07 [init] add missing files (#1)
omit daffbaa [init] init commit
new 176d2af Add spark-doris-connector extension (#2228)
new 51e8ee6 Fix document bugs in spark-doris-connector (#2275)
new b53dc00 Fix bug when spark on doris run long time (#2485)
new 5d3f637 Fix npe in spark-doris-connector when query is complex (#2503)
new 817c819 Spark return error to users when spark on doris query failed
(#2531)
new 921a2ca Convert from arrow to rowbatch (#2723)
new 576a133 Update arrow's version to 0.15.1 and shaded it in
spark-doris-connector (#2769)
new 628cf75 Support param exec_mem_limit for spark-doris-connctor (#2775)
new d3eebd4 Remove unused KUDU codes (#3175)
new cd46034 [Spark] Support convert Arrow data to RowBatch
asynchronously in Spark-Doris-Connector (#3186)
new 0634c64 [License] Add License to codes (#3272)
new d129998 [Spark on Doris] Shade and provide the thrift lib in
spark-doris-connector (#3631)
new ad9eff5 [Spark on Doris] fix the encode of varchar when
convertArrowToRowBatch (#5202)
new 3479e9a [Bug] Spark doris connector http v2 authentication fails, and
HTTP v2 interface returns json nesting problem (#5366)
new c1585ee Fix file licences (#5414)
new 293bd8f [Spark-Doris-Connector][Bug-Fix] Resolve deserialize
exception when Spark Doris Connector in aync deserialize mode (#5336)
new d121e12 [Bug] Modify spark, flink doris connector to send request to
FE, fix the problem of POST method, it should be the same as the method when
sending the request (#5788)
new e73f796 [Feature] Support spark connector sink data to Doris (#6256)
new 3168584 [Doc] flink/spark connector: add sources/javadoc plugins
(#6435)
new 27381fe [Improve]The connector supports spark 3.0, flink 1.13 (#6449)
new 9191e5b Spark 2.x and 3.x version compilation instructions (#6503)
new acf8869 [Feature] support spark connector sink stream data to doris
(#6761)
new 39e8483 [Feature] support spark connector sink data using sql (#6796)
new 7d1fa42 [Dependency] Upgrade thirdparty libs (#6766)
new 18d3ade Fix spark connector build error (#6948)
new dc9203a [Optimize] Spark connector supports multiple spark
versions:2.1.x/2.3.x/2.4.x/3.x (#6956)
new d8ad175 [Feature] Spark connector supports to specify fields to write
(#6973)
new 00589ff [Revert] Revert RestService.java (#6994)
new 27b72a7 [HTTP][API] Add backends info API for spark/flink connector
(#6984)
new be2cded [Build]Compile and output the jar file, add Spark, Flink
version and Scala version (#7051)
new 6cd3915 [Compile] Fix spark-connector compile problem (#7048)
new 031aac0 [SparkConnector] Add thrift dir for spark connector (#7074)
new 30530a9 [Feature] Support Flink and Spark connector support String
type (#7075)
new 95d494c [License] Add License header for missing files (#7130)
new c528252 [Improvement](spark-connector) Add 'sink.batch.size' and
'sink.max-retries' options in spark-connector (#7281)
new b799643 [chore][community](github) Remove travis and add github
action (#7380)
new 115ae27 [improvement](spark-connector)(flink-connector) Modify the
max num of batch written by Spark/Flink connector each time. (#7485)
new 37383c7 [refactor] Standardize the writing of pom files, prepare for
deployment to maven (#7477)
new ee6969a [refactor] update parent pom version and optimize build
scripts (#7548)
new 5a6b28f [chore][docs] add deploy spark/flink connectors to maven
release repo docs (#7616)
new 040b959 [improvement](spark-connector) Stream load http exception
handling (#7514)
new ecc7633 [refactor](spark-connector) delete useless maven dependencies
and some code variable definition issues (#7655)
new 24c633c [improvement](spark-connector) Throw an exception when the
data push fails and there are too many retries (#7531)
new 19542ef Flink / Spark connector compilation problem (#7725)
new b8ccc3c [chore][fix][doc](fe-plugin)(mysqldump) fix build auditlog
plugin error (#7804)
new 8558180 [fix](httpv2) make http v2 and v1 interface compatible (#7848)
new ce7d406 [init] init commit
new 0923ced [init] do some init work
new c5bf0b2 [fix](spark connector) fix spark connector unsupport STRING
type. (#2)
new dffb307 [Bug-Fix][Spark-Doris-Connector] resolve the problem of
writing Chinese garbled characters (#6)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (afb45af)
\
N -- N -- N refs/heads/master (dffb307)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 50 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.asf.yaml | 40 --
.github/workflows/build-extension.yml | 12 -
.gitignore | 3 -
...or-dependencies.txt => LICENSE-dependencies.txt | 0
LICENSE-flink-connector-dependencies.txt | 27 -
README.md | 8 +-
flink-doris-connector/build.sh | 66 ---
flink-doris-connector/pom.xml | 446 --------------
.../apache/doris/flink/backend/BackendClient.java | 220 -------
.../doris/flink/cfg/ConfigurationOptions.java | 65 ---
.../doris/flink/cfg/DorisConnectionOptions.java | 80 ---
.../doris/flink/cfg/DorisExecutionOptions.java | 128 ----
.../org/apache/doris/flink/cfg/DorisOptions.java | 103 ----
.../apache/doris/flink/cfg/DorisReadOptions.java | 190 ------
.../java/org/apache/doris/flink/cfg/DorisSink.java | 112 ----
.../apache/doris/flink/cfg/DorisStreamOptions.java | 74 ---
.../doris/flink/cfg/GenericDorisSinkFunction.java | 70 ---
.../flink/datastream/DorisSourceFunction.java | 113 ----
.../DorisDeserializationSchema.java | 25 -
.../SimpleListDeserializationSchema.java | 33 --
.../flink/exception/ConnectedFailedException.java | 28 -
.../doris/flink/exception/DorisException.java | 42 --
.../flink/exception/DorisInternalException.java | 29 -
.../flink/exception/IllegalArgumentException.java | 28 -
.../exception/ShouldNeverHappenException.java | 21 -
.../doris/flink/exception/StreamLoadException.java | 42 --
.../doris/flink/rest/PartitionDefinition.java | 150 -----
.../org/apache/doris/flink/rest/RestService.java | 641 ---------------------
.../org/apache/doris/flink/rest/SchemaUtils.java | 39 --
.../apache/doris/flink/rest/models/Backend.java | 42 --
.../apache/doris/flink/rest/models/BackendRow.java | 68 ---
.../apache/doris/flink/rest/models/BackendV2.java | 74 ---
.../org/apache/doris/flink/rest/models/Field.java | 121 ----
.../apache/doris/flink/rest/models/QueryPlan.java | 70 ---
.../doris/flink/rest/models/RespContent.java | 100 ----
.../org/apache/doris/flink/rest/models/Schema.java | 105 ----
.../org/apache/doris/flink/rest/models/Tablet.java | 80 ---
.../apache/doris/flink/serialization/Routing.java | 70 ---
.../apache/doris/flink/serialization/RowBatch.java | 309 ----------
.../flink/table/DorisDynamicOutputFormat.java | 405 -------------
.../flink/table/DorisDynamicTableFactory.java | 270 ---------
.../doris/flink/table/DorisDynamicTableSink.java | 80 ---
.../doris/flink/table/DorisDynamicTableSource.java | 101 ----
.../doris/flink/table/DorisRowDataInputFormat.java | 227 --------
.../apache/doris/flink/table/DorisStreamLoad.java | 189 ------
.../doris/flink/table/DorisTableInputSplit.java | 46 --
.../org/apache/doris/flink/util/ErrorMessages.java | 27 -
.../java/org/apache/doris/flink/util/IOUtils.java | 49 --
.../org.apache.flink.table.factories.Factory | 18 -
.../src/main/resources/log4j.properties | 23 -
.../doris/flink/datastream/ScalaValueReader.scala | 222 -------
.../main/thrift/doris/DorisExternalService.thrift | 122 ----
.../src/main/thrift/doris/Status.thrift | 66 ---
.../src/main/thrift/doris/Types.thrift | 376 ------------
.../doris/flink/DorisOutPutFormatExample.java | 84 ---
.../org/apache/doris/flink/DorisSinkExample.java | 58 --
.../apache/doris/flink/DorisSourceDataStream.java | 46 --
.../org/apache/doris/flink/DorisSourceExample.java | 64 --
.../apache/doris/flink/DorisSourceSinkExample.java | 64 --
.../apache/doris/flink/DorisStreamSinkExample.java | 236 --------
.../doris/flink/serialization/TestRowBatch.java | 439 --------------
61 files changed, 1 insertion(+), 7085 deletions(-)
delete mode 100644 .asf.yaml
rename LICENSE-spark-connector-dependencies.txt => LICENSE-dependencies.txt
(100%)
delete mode 100644 LICENSE-flink-connector-dependencies.txt
delete mode 100644 flink-doris-connector/build.sh
delete mode 100644 flink-doris-connector/pom.xml
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/backend/BackendClient.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/cfg/ConfigurationOptions.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/cfg/DorisConnectionOptions.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/cfg/DorisExecutionOptions.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/cfg/DorisOptions.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/cfg/DorisReadOptions.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/cfg/DorisSink.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/cfg/DorisStreamOptions.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/cfg/GenericDorisSinkFunction.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/datastream/DorisSourceFunction.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/deserialization/DorisDeserializationSchema.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/deserialization/SimpleListDeserializationSchema.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/exception/ConnectedFailedException.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/exception/DorisException.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/exception/DorisInternalException.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/exception/IllegalArgumentException.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/exception/ShouldNeverHappenException.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/exception/StreamLoadException.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/rest/PartitionDefinition.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/rest/RestService.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/rest/SchemaUtils.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/rest/models/Backend.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/rest/models/BackendRow.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/rest/models/BackendV2.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/rest/models/Field.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/rest/models/QueryPlan.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/rest/models/RespContent.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/rest/models/Schema.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/rest/models/Tablet.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/serialization/Routing.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/serialization/RowBatch.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/table/DorisDynamicOutputFormat.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/table/DorisDynamicTableFactory.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/table/DorisDynamicTableSink.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/table/DorisDynamicTableSource.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/table/DorisRowDataInputFormat.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/table/DorisStreamLoad.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/table/DorisTableInputSplit.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/util/ErrorMessages.java
delete mode 100644
flink-doris-connector/src/main/java/org/apache/doris/flink/util/IOUtils.java
delete mode 100644
flink-doris-connector/src/main/resources/META-INF/services/org.apache.flink.table.factories.Factory
delete mode 100644 flink-doris-connector/src/main/resources/log4j.properties
delete mode 100644
flink-doris-connector/src/main/scala/org/apache/doris/flink/datastream/ScalaValueReader.scala
delete mode 100644
flink-doris-connector/src/main/thrift/doris/DorisExternalService.thrift
delete mode 100644 flink-doris-connector/src/main/thrift/doris/Status.thrift
delete mode 100644 flink-doris-connector/src/main/thrift/doris/Types.thrift
delete mode 100644
flink-doris-connector/src/test/java/org/apache/doris/flink/DorisOutPutFormatExample.java
delete mode 100644
flink-doris-connector/src/test/java/org/apache/doris/flink/DorisSinkExample.java
delete mode 100644
flink-doris-connector/src/test/java/org/apache/doris/flink/DorisSourceDataStream.java
delete mode 100644
flink-doris-connector/src/test/java/org/apache/doris/flink/DorisSourceExample.java
delete mode 100644
flink-doris-connector/src/test/java/org/apache/doris/flink/DorisSourceSinkExample.java
delete mode 100644
flink-doris-connector/src/test/java/org/apache/doris/flink/DorisStreamSinkExample.java
delete mode 100644
flink-doris-connector/src/test/java/org/apache/doris/flink/serialization/TestRowBatch.java
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
