2020-05-26 16:02:38 UTC - Matthew Follegot: @Matthew Follegot has joined the channel ---- 2020-05-26 17:03:52 UTC - Matthew Follegot: hi there! I just merged the latest from `master` on a feature branch and when I run `mvn test` I get some failed tests, here is some sample output: ```[INFO] Reactor Summary for Pulsar 2.6.0-SNAPSHOT: [INFO] [INFO] Pulsar Build Tools ................................. SUCCESS [ 0.718 s] [INFO] Pulsar ............................................. SUCCESS [ 1.099 s] [INFO] Pulsar Test Mocks .................................. SUCCESS [ 2.609 s] [INFO] Pulsar Transaction :: Parent ....................... SUCCESS [ 0.212 s] [INFO] Pulsar Transaction :: Common ....................... SUCCESS [ 3.526 s] [INFO] Pulsar Client :: API ............................... SUCCESS [ 3.297 s] [INFO] Pulsar Common ...................................... SUCCESS [ 22.054 s] [INFO] Pulsar Metadata .................................... SUCCESS [ 4.829 s] [INFO] Managed Ledger ..................................... SUCCESS [01:11 min] [INFO] Apache Pulsar :: Tiered Storage :: Parent .......... SUCCESS [ 0.193 s] [INFO] Apache Pulsar :: Tiered Storage :: JCloud .......... FAILURE [ 8.513 s] [INFO] Apache Pulsar :: Tiered Storage :: File System ..... SKIPPED``` I'm just wondering if this expected behavior or not? Will CI tests fail because of this? ---- 2020-05-26 17:58:12 UTC - Sijie Guo: there are some flaky tests in the master. ---- 2020-05-26 17:58:50 UTC - Sijie Guo: the community is still working on improving the tests. ---- 2020-05-26 18:13:56 UTC - Matthew Follegot: Thank you for your response Sijie. Is there a list of must-pass tests for the future when one is opening a PR? ---- 2020-05-26 18:53:32 UTC - Sijie Guo: All tests should pass. We run github actions for pull requests to ensure any changes can only be merged after passing the tests. ---- 2020-05-26 18:53:54 UTC - Sijie Guo: It has been a bit annoying since there are flaky tests. ---- 2020-05-26 18:54:09 UTC - Sijie Guo: But usually if you re-run the tests, it will pass. ---- 2020-05-26 18:55:25 UTC - Matthew Follegot: Odd, they've been persistently failing for me (since yesterday), probably reran `mvn test` about 5 times now ---- 2020-05-26 18:56:54 UTC - Sijie Guo: What are the failed tests? ---- 2020-05-26 18:58:41 UTC - Matthew Follegot: ```[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:3.0.0-M3:test (default-test) on project tiered-storage-jcloud: There are test failures.``` ---- 2020-05-26 18:58:47 UTC - Matthew Follegot: ```[ERROR] Failures: [ERROR] org.apache.bookkeeper.mledger.offload.jcloud.BlobStoreBackedInputStreamTest.start(org.apache.bookkeeper.mledger.offload.jcloud.BlobStoreBackedInputStreamTest) [ERROR] Run 1: BlobStoreBackedInputStreamTest>BlobStoreTestBase.start:72 » $Computation com.g...``` ---- 2020-05-26 18:59:05 UTC - Matthew Follegot: ```[ERROR] org.apache.bookkeeper.mledger.offload.jcloud.impl.BlobStoreManagedLedgerOffloaderTest.start(org.apache.bookkeeper.mledger.offload.jcloud.impl.BlobStoreManagedLedgerOffloaderTest) [ERROR] Run 1: BlobStoreManagedLedgerOffloaderTest>BlobStoreTestBase.start:72 » $Computation ...``` ---- 2020-05-26 19:08:16 UTC - Mukilesh: @Mukilesh has joined the channel ----