> > artifact descriptor for > org.apache.hadoop:hadoop-build-tools:jar:3.3.9-SNAPSHOT: Could not transfer > artifact org.apache.hadoop:hadoop-build-tools:pom:3.3.9-SNAPSHOT from/to > maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for > repositories: [apache.snapshots (http://repository.apache.org/snapshots, > default, snapshots)]
It seems to be failing for* hadoop-build-tools *which is a "*plugin*" [1] and we seems to have defined snapshot repo for distributionManagement & normal artifacts [2] The definition of tags we have in POM *distributionManagement* -> Distribution information for a project that enables deployment of the site and artifacts to remote web servers and repositories respectively *repositories* -> The lists of the remote repositories for discovering dependencies and extensions. This is what we don't have: *pluginRepositories* -> The lists of the remote repositories for discovering plugins for builds and reports. Some more stuff is here : [3] it said: repositories: "*apache.snapshots*", not sure how this works, it isn't defined in the Super-POM[4] also, maybe with repositories also there is some inheritance, if some other dependency has it defined it would fetch from there. Found this doc: [5], sounds a bit similar -->thoughts from just digging here & there, may be wrong -Ayush [1] https://github.com/apache/ozone/blob/7bfa04e7cf1d4427baa9c25b80973c0a48f3e4f8/pom.xml#L1849-L1863 [2] https://github.com/apache/ozone/blob/7bfa04e7cf1d4427baa9c25b80973c0a48f3e4f8/pom.xml#L31-L50 [3] https://maven.apache.org/pom.html#plugin-repositories [4] https://maven.apache.org/ref/3.9.1/maven-model-builder/super-pom.html [5] https://www.morling.dev/blog/maven-what-are-you-waiting-for/ On Thu, 8 Jun 2023 at 23:48, Wei-Chiu Chuang <weic...@apache.org> wrote: > Yes I am aware of that and so I was confused because we do have snapshot > repository defined in Ozone's pom.xml. > > https://github.com/apache/ozone/blame/master/pom.xml#L86 > > Does it define where Ozone upload the snapshots rather than defining where > to download dependency snapshots? I'll check this out. Thanks > > On Thu, Jun 8, 2023 at 10:43 AM Siyao Meng <si...@apache.org> wrote: > > > Hi Wei-Chiu, > > > > It says the snapshot maven repo is blocked from your logs: > > > > Blocked mirror for > > > repositories: [apache.snapshots ( > http://repository.apache.org/snapshots, > > > default, snapshots)] -> [Help 1] > > > > > > > I believe It is caused by using insecure http:// maven repo by > default: > > https://stackoverflow.com/a/67835542 > > > > To fix this, try adding this chunk to Ozone's root pom.xml: > > > > > > > https://github.com/apache/ratis/blob/90fd0625ff16b4a967ad94010080be59aef2049c/pom.xml#L94-L99 > > > > Ref: RATIS-820 <https://github.com/apache/ratis/pull/53> > > > > Also I can see hadoop-build-tools SNAPSHOT jars here: > > > > > > > https://repository.apache.org/content/groups/snapshots/org/apache/hadoop/hadoop-build-tools/3.3.9-SNAPSHOT/ > > > > Cheers, > > Siyao > > > > On Jun 8, 2023 at 10:09:22 AM, Wei-Chiu Chuang <weic...@apache.org> > wrote: > > > > > Hi developers, > > > > > > Is there a way to update the hadoop dependency to a SNAPSHOT version? I > > > have a draft PR that relies on a new Hadoop feature > > > > > > > > > https://github.com/apache/ozone/pull/4825/files#diff-9c5fb3d1b7e3b0f54bc5c4182965c4fe1f9023d449017cece3005d3f90e8e4d8 > > > So instead of hadoop 3.3.5, i have it configured to 3.3.9-SNAPSHOT. > > > > > > > > > But it kept complaining it's unable to find it > > > Error: Failed to execute goal > > > org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process > > > (default) on project ozone-main: Execution default of goal > > > org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process > > failed: > > > Plugin org.apache.maven.plugins:maven-remote-resources-plugin:1.5 or > one > > of > > > its dependencies could not be resolved: Failed to collect dependencies > at > > > org.apache.maven.plugins:maven-remote-resources-plugin:jar:1.5 -> > > > org.apache.hadoop:hadoop-build-tools:jar:3.3.9-SNAPSHOT: Failed to read > > > artifact descriptor for > > > org.apache.hadoop:hadoop-build-tools:jar:3.3.9-SNAPSHOT: Could not > > transfer > > > artifact org.apache.hadoop:hadoop-build-tools:pom:3.3.9-SNAPSHOT > from/to > > > maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for > > > repositories: [apache.snapshots ( > http://repository.apache.org/snapshots, > > > default, snapshots)] -> [Help 1] > > > > > > How does Ozone consume Ratis dependency? AFAIK we consume Ratis > SNAPSHOT > > > versions, so why am i not getting the same error from Ratis? > > > > > > Looking for pointers, > > > Thank you, > > > Weichiu > > > > > >
