2020-06-18 09:16:18 UTC - Charvak Patel: @Charvak Patel has joined the channel ---- 2020-06-18 09:17:31 UTC - Charvak Patel: This does need some fixes, I tried to run benchmark and failed. Many version fixes to make sure it runs with new terraform plus Pulsar version also needs a bump ---- 2020-06-18 09:17:33 UTC - Charvak Patel: <https://github.com/openmessaging/openmessaging-benchmark> ---- 2020-06-18 09:19:16 UTC - Charvak Patel: you can check this pr <https://github.com/pandio-com/openmessaging-benchmark/pull/1>, This does put infra in the place but my clients were stuck after topic creation +1 : David Kjerrumgaard, Sijie Guo ---- 2020-06-18 15:00:36 UTC - Mihir Rane: @Mihir Rane has joined the channel ---- 2020-06-18 15:22:56 UTC - Kate Kinnear: @Kate Kinnear has joined the channel ---- 2020-06-18 16:55:26 UTC - Matteo Merli: Please submit this PR to the `openmessaging/openmessaging-benchmark` repo ---- 2020-06-18 17:29:32 UTC - Yezen: @Yezen has joined the channel ---- 2020-06-18 17:33:24 UTC - Kalyn Coose: @Kalyn Coose has joined the channel ---- 2020-06-18 17:34:10 UTC - Muljadi: @Muljadi has joined the channel ---- 2020-06-18 18:17:52 UTC - Madhu A: @Madhu A has joined the channel ---- 2020-06-18 21:01:02 UTC - Prashanth Tirupachur Vasanthakrishnan: Trying to build Pulsar-2.6.0 from the repo using the <https://hub.docker.com/r/apachepulsar/pulsar-build|apachepulsar/pulsar-build:latest> image. The build goes through successfully but, few tests are failing:
---- 2020-06-18 21:01:02 UTC - Prashanth Tirupachur Vasanthakrishnan: ```Output from executing "mvn test" [INFO] Reactor Summary for Pulsar 2.6.0: [INFO] [INFO] Pulsar Build Tools ................................. SUCCESS [ 1.742 s] [INFO] Pulsar ............................................. SUCCESS [ 1.720 s] [INFO] Pulsar Test Mocks .................................. SUCCESS [ 2.935 s] [INFO] Pulsar Transaction :: Parent ....................... SUCCESS [ 0.045 s] [INFO] Pulsar Transaction :: Common ....................... SUCCESS [ 8.541 s] [INFO] Pulsar Client :: API ............................... SUCCESS [ 4.097 s] [INFO] Pulsar Common ...................................... SUCCESS [01:15 min] [INFO] Pulsar Metadata .................................... SUCCESS [ 9.412 s] [INFO] Managed Ledger ..................................... SUCCESS [01:13 min] [INFO] Apache Pulsar :: Tiered Storage :: Parent .......... SUCCESS [ 0.035 s] [INFO] Apache Pulsar :: Tiered Storage :: JCloud .......... FAILURE [02:37 min] [INFO] Apache Pulsar :: Tiered Storage :: File System ..... SUCCESS [ 16.814 s] [INFO] Pulsar ZooKeeper Utils ............................. SUCCESS [ 17.023 s] [INFO] pulsar-broker-common ............................... SUCCESS [ 12.852 s] [INFO] Apache Pulsar :: Bouncy Castle :: Parent ........... SUCCESS [ 0.037 s] [INFO] Apache Pulsar :: Bouncy Castle :: BC ............... SUCCESS [ 1.513 s] [INFO] Apache Pulsar :: Bouncy Castle :: BC Shaded ........ SUCCESS [ 1.236 s] [INFO] pulsar-client-messagecrypto-bc ..................... SUCCESS [ 1.227 s] [INFO] Pulsar Functions :: Parent ......................... SUCCESS [ 0.025 s] [INFO] Pulsar Functions :: Proto .......................... SUCCESS [ 2.845 s] [INFO] Pulsar Client Java ................................. SUCCESS [ 23.341 s] [INFO] Pulsar Discovery Service WAR ....................... FAILURE [ 13.182 s] [INFO] Pulsar WebSocket ................................... FAILURE [ 9.018 s] [INFO] Pulsar Client Admin Original ....................... SUCCESS [ 5.322 s] [INFO] Pulsar Functions :: API ............................ SUCCESS [ 4.349 s] [INFO] Pulsar IO :: Parent ................................ SUCCESS [ 0.027 s] [INFO] Pulsar IO :: IO .................................... SUCCESS [ 3.933 s] [INFO] Pulsar Functions :: Utils .......................... SUCCESS [ 13.390 s] [INFO] Pulsar Functions :: Secrets ........................ SUCCESS [ 3.361 s] [INFO] Pulsar Functions :: Instance ....................... SUCCESS [ 14.366 s] [INFO] Pulsar Functions :: Runtime ........................ SUCCESS [ 16.956 s] [INFO] Pulsar IO :: Cassandra ............................. SUCCESS [ 1.864 s] [INFO] Pulsar IO :: IO Common ............................. SUCCESS [ 4.399 s] [INFO] Pulsar IO :: Twitter ............................... SUCCESS [ 6.103 s] [INFO] Pulsar Functions :: Worker ......................... SUCCESS [ 34.737 s] [INFO] Pulsar Functions :: Local Runner original .......... SUCCESS [ 2.145 s] [INFO] Pulsar Functions :: API Examples ................... SUCCESS [ 1.199 s] [INFO] Pulsar IO :: Data Generator ........................ SUCCESS [ 1.447 s] [INFO] Pulsar Transaction :: Coordinator .................. SUCCESS [ 4.230 s] [INFO] Pulsar Broker ...................................... FAILURE [10:46 min] [INFO] Pulsar Shaded Broker ............................... SUCCESS [ 11.663 s] [INFO] Pulsar Client Java ................................. FAILURE [ 2.747 s] [INFO] Pulsar Client 1.x Compatibility Base ............... SUCCESS [ 0.045 s] [INFO] Pulsar Client 2.x Shaded API ....................... SUCCESS [ 1.972 s] [INFO] Pulsar Client 1.x Compatibility API ................ SUCCESS [ 1.796 s] [INFO] Pulsar Client Admin ................................ SUCCESS [ 2.529 s] [INFO] Pulsar Client Tools ................................ SUCCESS [ 18.234 s] [INFO] Pulsar Client Tools Test ........................... SUCCESS [02:14 min] [INFO] Pulsar Client All .................................. FAILURE [ 1.458 s] [INFO] Pulsar Proxy ....................................... FAILURE [ 16.425 s] [INFO] Pulsar Storm adapter ............................... SUCCESS [ 6.309 s] [INFO] Pulsar Flink Connectors (Deprecated) ............... SUCCESS [ 27.776 s] [INFO] Spark Streaming Pulsar Receivers ................... SUCCESS [ 4.178 s] [INFO] Pulsar Test Client ................................. SUCCESS [ 2.494 s] [INFO] pulsar-broker-auth-athenz .......................... SUCCESS [ 7.350 s] [INFO] pulsar-client-auth-athenz .......................... SUCCESS [ 5.950 s] [INFO] Pulsar Kafka compatibility ......................... SUCCESS [ 0.036 s] [INFO] Pulsar Kafka compatibility :: API (original) ....... SUCCESS [ 9.327 s] [INFO] Pulsar Kafka compatibility 0.8 :: API (original) ... FAILURE [ 14.307 s] [INFO] Pulsar Kafka compatibility 0.9 :: API (original) ... SUCCESS [ 8.598 s] [INFO] Pulsar Kafka compatibility :: API .................. SUCCESS [ 1.702 s] [INFO] Pulsar Kafka compatibility 0.8 :: API .............. SUCCESS [ 2.150 s] [INFO] Pulsar Kafka compatibility 0.9 :: API .............. SUCCESS [ 1.525 s] [INFO] Pulsar Kafka compatibility :: Tests ................ SUCCESS [ 1.770 s] [INFO] Pulsar Kafka-0.8 compatibility :: Tests ............ SUCCESS [ 1.867 s] [INFO] Pulsar Kafka compatibility 0.9 :: Tests ............ SUCCESS [ 1.662 s] [INFO] pulsar-zookeeper ................................... SUCCESS [ 4.829 s] [INFO] Pulsar Log4j2 Appender ............................. SUCCESS [01:05 min] [INFO] Pulsar SQL :: Parent ............................... SUCCESS [ 0.090 s] [INFO] Pulsar SQL :: Pulsar Presto Connector Packaging .... SUCCESS [01:24 min] [INFO] Pulsar SQL :: Pulsar Presto Connector .............. SUCCESS [ 3.052 s] [INFO] Pulsar SQL :: Pulsar Presto Distribution ........... SUCCESS [ 4.717 s] [INFO] Apache Pulsar :: Docker Images ..................... SUCCESS [ 0.035 s] [INFO] Apache Pulsar :: Docker Images :: Pulsar Dashboard . SUCCESS [ 0.029 s] [INFO] pulsar-client-auth-sasl ............................ SUCCESS [ 2.375 s] [INFO] pulsar-broker-auth-sasl ............................ FAILURE [ 13.214 s] [INFO] Pulsar Functions :: Runtime All .................... SUCCESS [ 1.432 s] [INFO] Pulsar Functions :: Local Runner Shaded ............ SUCCESS [ 2.120 s] [INFO] Pulsar IO :: Batch ................................. SUCCESS [ 6.243 s] [INFO] Pulsar IO :: Batch Discovery Triggerers ............ SUCCESS [ 1.238 s] [INFO] Pulsar IO :: Batch Data Generator .................. SUCCESS [ 2.157 s] [INFO] Pulsar IO :: Canal ................................. SUCCESS [ 1.836 s] [INFO] Pulsar IO :: ElasticSearch ......................... SUCCESS [ 6.325 s] [INFO] Pulsar IO :: Hdfs2 ................................. SUCCESS [ 9.138 s] [INFO] Pulsar IO :: Hdfs3 ................................. SUCCESS [ 7.026 s] [INFO] Pulsar IO :: Jdbc .................................. SUCCESS [ 0.032 s] [INFO] Pulsar IO :: Jdbc :: Core .......................... SUCCESS [ 1.309 s] [INFO] Pulsar IO :: Jdbc :: ClickHouse .................... SUCCESS [ 1.632 s] [INFO] Pulsar IO :: Jdbc :: Mariadb ....................... SUCCESS [ 1.313 s] [INFO] Pulsar IO :: Jdbc :: Postgres ...................... SUCCESS [ 1.287 s] [INFO] Pulsar IO :: Jdbc :: Sqlite ........................ SUCCESS [ 6.901 s] [INFO] Pulsar IO :: Kafka ................................. SUCCESS [ 4.567 s] [INFO] Pulsar IO :: IO AWS ................................ SUCCESS [ 2.794 s] [INFO] Pulsar IO :: Kinesis ............................... SUCCESS [ 7.164 s] [INFO] Pulsar IO :: RabbitMQ .............................. SUCCESS [ 13.609 s] [INFO] Pulsar IO :: Docs .................................. SUCCESS [ 5.249 s] [INFO] Pulsar IO :: Aerospike ............................. SUCCESS [ 1.506 s] [INFO] Apache Pulsar :: Kafka Connect Avro Converter shaded SUCCESS [ 1.855 s] [INFO] Pulsar IO :: Kafka Connect Adaptor ................. FAILURE [ 10.162 s] [INFO] Pulsar IO :: Debezium .............................. SUCCESS [ 0.032 s] [INFO] Pulsar IO :: Debezium :: Core ...................... FAILURE [ 8.650 s] [INFO] Pulsar IO :: Debezium :: mysql ..................... SUCCESS [ 2.038 s] [INFO] Pulsar IO :: Debezium :: postgres .................. SUCCESS [ 2.188 s] [INFO] Pulsar IO :: Debezium :: mongodb ................... SUCCESS [ 2.622 s] [INFO] Pulsar IO :: File .................................. SUCCESS [01:25 min] [INFO] Pulsar IO :: Netty ................................. SUCCESS [ 7.745 s] [INFO] Pulsar IO :: Hbase ................................. SUCCESS [ 6.434 s] [INFO] Pulsar IO :: MongoDB ............................... SUCCESS [ 12.612 s] [INFO] Pulsar IO :: Flume ................................. SUCCESS [ 24.209 s] [INFO] Pulsar IO :: Redis ................................. SUCCESS [ 8.469 s] [INFO] Pulsar IO :: Solr .................................. SUCCESS [ 10.565 s] [INFO] Pulsar IO :: InfluxDB .............................. SUCCESS [ 9.025 s] [INFO] Pulsar IO :: DynamoDB .............................. SUCCESS [ 4.970 s] [INFO] Pulsar Examples :: Parent .......................... SUCCESS [ 0.051 s] [INFO] Pulsar Examples :: Flink ........................... SUCCESS [ 23.072 s] [INFO] Pulsar Examples :: Spark ........................... SUCCESS [ 8.434 s] [INFO] Apache Pulsar :: Bouncy Castle :: BC-FIPS .......... SUCCESS [ 1.369 s] [INFO] Pulsar Bouncy Castle FIPS Test ..................... SUCCESS [ 27.500 s] [INFO] Pulsar Bouncy Castle FIPS Nar Test ................. SUCCESS [ 26.216 s] [INFO] Pulsar :: Distribution ............................. SUCCESS [ 0.021 s] [INFO] Pulsar :: Distribution :: Server ................... SUCCESS [ 3.152 s] [INFO] Pulsar :: Distribution :: IO ....................... SUCCESS [ 2.849 s] [INFO] Pulsar :: Distribution :: Offloader ................ SUCCESS [ 0.484 s] [INFO] Apache Pulsar :: Docker Images :: Pulsar Latest Version SUCCESS [ 3.129 s] [INFO] Apache Pulsar :: Docker Images :: Grafana .......... SUCCESS [ 0.017 s] [INFO] Apache Pulsar :: Docker Images :: Pulsar Latest Version (Include All Components) SUCCESS [ 0.112 s] [INFO] Apache Pulsar :: Docker Images :: Pulsar Standalone SUCCESS [ 0.018 s] [INFO] Apache Pulsar :: Tests ............................. SUCCESS [ 0.021 s] [INFO] Apache Pulsar :: Tests :: Docker Images ............ SUCCESS [ 0.017 s] [INFO] Apache Pulsar :: Tests :: Docker Images :: Java Test Functions SUCCESS [ 1.381 s] [INFO] Apache Pulsar :: Tests :: Docker Images :: Latest Version Testing SUCCESS [ 0.019 s] [INFO] Apache Pulsar :: Tests :: Integration .............. SUCCESS [ 9.525 s] [INFO] Apache Pulsar :: Tests :: Pulsar Kafka Compat Client Tests SUCCESS [ 1.890 s] [INFO] Pulsar Storm adapter Tests ......................... FAILURE [ 11.262 s] [INFO] Spark Streaming Pulsar Receivers Tests ............. SUCCESS [ 4.189 s] [INFO] Apache Pulsar :: Tests :: Backwards Client Compatibility 2.0.0-rc1-incubating SUCCESS [ 1.377 s] [INFO] Apache Pulsar :: Tests :: Backwards Client Compatibility 2.0.1-incubating SUCCESS [ 1.276 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 34:38 min [INFO] Finished at: 2020-06-18T16:01:45Z [INFO] ------------------------------------------------------------------------``` ---- 2020-06-18 21:01:02 UTC - Prashanth Tirupachur Vasanthakrishnan: Followed the steps from the repo for the build process: 1. `mvn install -DskipTests` 2. `mvn test` Wanted to check-in regarding the failures. Are any of them expected to fail? or am I doing something wrong? ---- 2020-06-18 21:03:53 UTC - David Lanouette: That output is from the `mvn install`, or the `mvn test`? ---- 2020-06-18 21:05:18 UTC - Prashanth Tirupachur Vasanthakrishnan: Thank you, it’s from `mvn test` . Updated the previous message. +1 : David Lanouette ---- 2020-06-18 21:07:11 UTC - Matteo Merli: Tests are supposed to pass in every environment. On CI these are tested in one enviroment.. if there are failures, please open issues with all the logs for the specific tests (also check for existing issues that might already be there) ---- 2020-06-18 21:17:58 UTC - Prashanth Tirupachur Vasanthakrishnan: Thanks for the confirmation. This was on Ubuntu-16:04 and the CI uses Ubuntu-18.04.4 Will give that a try and open the issues. ---- 2020-06-18 22:54:17 UTC - David Lanouette: One more question. What version of the jdk were you running? The build fails on newer jdk’s due to deprecations of some libraries (xml parsing is a big one) ---- 2020-06-18 23:27:37 UTC - Prashanth Tirupachur Vasanthakrishnan: • `openjdk version "1.8.0_232"` • `Apache Maven 3.6.1` ---- 2020-06-19 03:29:51 UTC - Simon Crosby: @Simon Crosby has joined the channel ---- 2020-06-19 03:35:07 UTC - Devin G. Bost: For the record, I was never saying that Pulsar is only good and Kafka/Confluent is only bad. I simply stated that they had false statements in their article. ---- 2020-06-19 05:03:10 UTC - Patrik Kleindl: That was in reference to some of the other reactions, sorry if that sounded targeted at you. ----
