[GitHub] [ignite-3] SammyVimes opened a new pull request #5: IGINTE-13562 Unified configuration initial prototype
SammyVimes opened a new pull request #5: URL: https://github.com/apache/ignite-3/pull/5 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: 2.9.1 release scope and dates
Hello! I have also added this PR to nightly runs. Regards, -- Ilya Kasnacheev ср, 2 дек. 2020 г. в 18:34, Yaroslav Molochkov : > Ilya, Vladimir hello! > > I've added them all. > > Nightly run should be triggered on my PR (#8508) instead of 2.9.1 branch, > if it's not added directly, of course. > > > Guys, I think that's enough issues for a minor release, I will proceed with > the final testing and building the RC. > > On Wed, Dec 2, 2020 at 3:10 PM Ilya Kasnacheev > wrote: > > > Hello once more! > > > > It would also be nice to include > > https://issues.apache.org/jira/browse/IGNITE-13770 since it is a nasty > > user-visible NPE in public API. > > > > Pls cherry-pick or greenlight me if it's not too late. > > > > Regards. > > -- > > Ilya Kasnacheev > > > > > > ср, 2 дек. 2020 г. в 14:14, Ilya Kasnacheev : > > > > > Hello again! > > > > > > Yaroslav, I have noticed that > > > https://issues.apache.org/jira/browse/IGNITE-13388 has slipped > > > through the cracks and was not committed to master properly. > > > > > > I have committed it to master now, can you please cherry-pick it and > add > > > to scope of 2.9.1 if it's not too late? It's an important packaging > > bugfix. > > > > > > I can cherry-pick it myself if you give a green light. > > > > > > Regards, > > > -- > > > Ilya Kasnacheev > > > > > > > > > ср, 2 дек. 2020 г. в 13:09, Ilya Kasnacheev >: > > > > > >> Hello! > > >> > > >> I have scheduled a Run All (Nightly) build for ignite-2.9.1. > > >> > > >> I propose to also add > > https://issues.apache.org/jira/browse/IGNITE-13572 > > >> to scope since it seems to be both impactful and easy to fix. > > >> > > >> Regards, > > >> -- > > >> Ilya Kasnacheev > > >> > > >> > > >> ср, 2 дек. 2020 г. в 13:06, Steshin Vladimir : > > >> > > >>> Yaroslav, Hi. > > >>> > > >>> I propose [1] and [2] to pick up into 2.9.1. > > >>> > > >>> > > >>> [1] is important. It fixes unexpected node failure slipped away from > > the > > >>> Java test. Belatedly found in integration ducktape tests. > > >>> > > >>> > > >>> [2] just disables soLinger in TcpDiscvoerySPI by default. Suggested > in > > >>> 2.10. But the documentation correction has already appeared in the > > >>> documentation [3]. > > >>> > > >>> > > >>> [1] https://issues.apache.org/jira/browse/IGNITE-13705 > > >>> (edb736dcd8d1d57c875ce7de2b2b2b786d1f8d51) > > >>> > > >>> [2] https://issues.apache.org/jira/browse/IGNITE-13643 > > >>> (cb7448eecf1ae05c2062e24d9c342d8ae9d92149) > > >>> > > >>> [3] > > >>> > > >>> > > > https://ignite.apache.org/docs/latest/clustering/network-configuration#discovery > > >>> > > >>> > > >>> 02.12.2020 12:19, Yaroslav Molochkov пишет: > > >>> > Ivan, > > >>> > > > >>> > thanks, added to the list due to the severity of the issue. > > >>> > > > >>> > On Wed, Dec 2, 2020 at 12:13 PM Ivan Daschinsky < > ivanda...@gmail.com > > > > > >>> wrote: > > >>> > > > >>> >> Yaroslav, lets add another bug fix > > >>> >> https://issues.apache.org/jira/browse/IGNITE-13572 > > >>> >> It's quite small fix, but bug is quite severe. > > >>> >> > > >>> >> ср, 2 дек. 2020 г. в 10:48, Yaroslav Molochkov < > > molochko...@gmail.com > > >>> >: > > >>> >> > > >>> >>> Guys, > > >>> >>> > > >>> >>> can anyone grant me necessary permissions to create a wiki page > > with > > >>> >>> release info, please? > > >>> >>> > > >>> >>> On Tue, Dec 1, 2020 at 12:58 PM Yaroslav Molochkov < > > >>> >> molochko...@gmail.com> > > >>> >>> wrote: > > >>> >>> > > >>> Hi! > > >>> I see it's merged into 2.9.1 branch and master. > > >>> > > >>> I guess that's it for the issues, I will run nightly tests again > > >>> just > > >>> >> to > > >>> be sure that everything is okay and we will proceed. > > >>> > > >>> On Mon, Nov 30, 2020 at 7:31 PM Zhenya Stanilovsky > > >>> wrote: > > >>> > > >>> > hello ! > > >>> > seems it [1] need to be included too, if it`s not too late, of > > >>> course. > > >>> > May be you can bump reviewer somehow?) > > >>> > > > >>> > [1] https://issues.apache.org/jira/browse/IGNITE-13765 > > >>> > > > >>> >> Ivan, it's added, thanks for pointing that out > > >>> >> > > >>> >> On Mon, Nov 30, 2020 at 5:44 PM Ivan Daschinsky < > > >>> >> ivanda...@gmail.com > > >>> > wrote: > > >>> >>> Yaroslav, could you explain why you decided to remove from > > scope > > >>> >>> https://issues.apache.org/jira/browse/IGNITE-13699 ? > > >>> >>> This ticket also incorporate few fixes for metrics. Currently > > >>> >> metrics > > >>> > is a > > >>> >>> little bit broken (JoinedCount shows invalid results for > > example) > > >>> >>> > > >>> >>> > > >>> >>> пн, 30 нояб. 2020 г. в 17:26, Yaroslav Molochkov < > > >>> > molochko...@gmail.com >: > > >>> Igniters, hello! > > >>> > > >>> First of all, sorry that the release process is taking so > > long. > > >>> > > >>> Secondly, the release build seems
Fwd: 2.9.1 release scope and dates
Yaroslan, helle again. Just realized that [1] depends on [4]. [4] is a fix of a reverted from 2.9 ticket. [1] https://issues.apache.org/jira/browse/IGNITE-13705 (edb736dcd8d1d57c875ce7de2b2b2b786d1f8d51) [4] https://issues.apache.org/jira/browse/IGNITE-13465 (3db17612d7c433ddfbb404f92eebca6dd2f4fefe) Перенаправленное сообщение Тема: Re: 2.9.1 release scope and dates Дата: Wed, 2 Dec 2020 13:06:42 +0300 От: Steshin Vladimir Кому: dev@ignite.apache.org Yaroslav, Hi. I propose [1] and [2] to pick up into 2.9.1. [1] is important. It fixes unexpected node failure slipped away from the Java test. Belatedly found in integration ducktape tests. [2] just disables soLinger in TcpDiscvoerySPI by default. Suggested in 2.10. But the documentation correction has already appeared in the documentation [3]. [1] https://issues.apache.org/jira/browse/IGNITE-13705 (edb736dcd8d1d57c875ce7de2b2b2b786d1f8d51) [2] https://issues.apache.org/jira/browse/IGNITE-13643 (cb7448eecf1ae05c2062e24d9c342d8ae9d92149) [3] https://ignite.apache.org/docs/latest/clustering/network-configuration#discovery 02.12.2020 12:19, Yaroslav Molochkov пишет: Ivan, thanks, added to the list due to the severity of the issue. On Wed, Dec 2, 2020 at 12:13 PM Ivan Daschinsky wrote: Yaroslav, lets add another bug fix https://issues.apache.org/jira/browse/IGNITE-13572 It's quite small fix, but bug is quite severe. ср, 2 дек. 2020 г. в 10:48, Yaroslav Molochkov: Guys, can anyone grant me necessary permissions to create a wiki page with release info, please? On Tue, Dec 1, 2020 at 12:58 PM Yaroslav Molochkov < molochko...@gmail.com> wrote: Hi! I see it's merged into 2.9.1 branch and master. I guess that's it for the issues, I will run nightly tests again just to be sure that everything is okay and we will proceed. On Mon, Nov 30, 2020 at 7:31 PM Zhenya Stanilovsky wrote: hello ! seems it [1] need to be included too, if it`s not too late, of course. May be you can bump reviewer somehow?) [1]https://issues.apache.org/jira/browse/IGNITE-13765 Ivan, it's added, thanks for pointing that out On Mon, Nov 30, 2020 at 5:44 PM Ivan Daschinsky < ivanda...@gmail.com wrote: Yaroslav, could you explain why you decided to remove from scope https://issues.apache.org/jira/browse/IGNITE-13699 ? This ticket also incorporate few fixes for metrics. Currently metrics is a little bit broken (JoinedCount shows invalid results for example) пн, 30 нояб. 2020 г. в 17:26, Yaroslav Molochkov < molochko...@gmail.com >: Igniters, hello! First of all, sorry that the release process is taking so long. Secondly, the release build seems stable and no blockers were introduced within that list < https://issues.apache.org/jira/browse/IGNITE-11312?jql=project%20%3D%20IGNITE%20AND%20fixVersion%20%3D%202.9.1%20and%20status%20%3D%20Resolved (at least on RunAll compared to 2.9) I've also prepared release notes: Ignite Core: * Added support to graceful shutdown for ZookeeperDiscoverySpi * Added System view for binary metadata * Added System view for metastorage items * Added RebalancingPartitionsTotal metrics * Improved checkpoint concurrent behaviour * Fixed critical system error when unregister a JMX bean * Fixed IgniteCache#isClosed() returns false on server node even if the cache had been closed before * Fixed inability to eagerly remove expired cache entries * Fixed partial index rebuild issue in case indexed cache contains different datatypes * Fixed local metastorage system view error if unmarshallable values present * Fixed deadlock between grid-timeout-worker and a thread opening a communication connection * Fixed deadlock in IgniteServiceProcessor * Fixed issue when rebalance future might hang in no final state though all partitions are owned * Fixed issue when scan query fails with an assertion error: Unexpected row key * Fixed issue with archiving and enabled wal compaction setting on server restart * Fixed NPE during Cassandra Store initialization with PRIMITIVE strategy * Fixed synchronization problems when different classloaders are used for deployment of same class * Fixed exception on SQL caches when client reconnect * Fixed deadlock on multiple cache delete * Fixed NPE in IgniteServiceProcessor when destroying a cache * Fixed issue when DurableBackgroundTask can abandon incomplete task * Fixed issue related to cache interceptor deserialization on client nodes * Fixed issue when control.sh doesn't start if JMX port was set * Fixed issue when ZookeeperDiscoverySpiMBeanImpl#getCoordinator can return invalid node as coordinator * Fixed issue when valid blocking section in GridNioWorker and GridNioClientWorker leads to false positive blocking thread detection * Fixed several logging issues * Fixed issue when exchange worker, waiting for new task from queue, considered as blocked * Fixed incorrect topology snapshot logger output about coordi
[jira] [Created] (IGNITE-13808) Control.sh validate_indexes throws CorruptedTreeException and fails server node during check
Ivan Bessonov created IGNITE-13808: -- Summary: Control.sh validate_indexes throws CorruptedTreeException and fails server node during check Key: IGNITE-13808 URL: https://issues.apache.org/jira/browse/IGNITE-13808 Project: Ignite Issue Type: Bug Reporter: Ivan Bessonov Assignee: Ivan Bessonov CorruptedTreeException during validate index command calls Failure handler and stops server node: {code:java} [21:44:26,257][WARNING][pool-5-thread-2][ValidateIndexesClosure] Current progress of ValidateIndexesClosure: checked integrity of 1 index partitions of 14 cache groups [21:44:26,852][SEVERE][pool-5-thread-16][] Critical system error detected. Will be handled accordingly to configured handler [hnd=StopNodeOrHaltFailureHandler [tryStop=false, timeout=0, super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=FailureContext [type=CRITICAL_ERROR, err=class o.a.i.i.processors.cache.persistence.tree.CorruptedTreeException: B+Tree is corrupted [pages(groupId, pageId)=[], msg=Runtime failure on bounds: [lower=null, upper=null class org.apache.ignite.internal.processors.cache.persistence.tree.CorruptedTreeException: B+Tree is corrupted [pages(groupId, pageId)=[], msg=Runtime failure on bounds: [lower=null, upper=null]] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.corruptedTreeException(BPlusTree.java:5126) at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.find(BPlusTree.java:1029) at org.apache.ignite.internal.processors.query.h2.database.H2TreeIndex.find(H2TreeIndex.java:243) at org.apache.ignite.internal.visor.verify.ValidateIndexesClosure.processIndex(ValidateIndexesClosure.java:651) at org.apache.ignite.internal.visor.verify.ValidateIndexesClosure.access$200(ValidateIndexesClosure.java:93) at org.apache.ignite.internal.visor.verify.ValidateIndexesClosure$4.call(ValidateIndexesClosure.java:631) at org.apache.ignite.internal.visor.verify.ValidateIndexesClosure$4.call(ValidateIndexesClosure.java:629) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTreeRuntimeException: org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTreeRuntimeException: java.lang.IllegalStateException: Item not found: 11 at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.findLowerUnbounded(BPlusTree.java:987) at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.find(BPlusTree.java:1014) ... 9 more Caused by: org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTreeRuntimeException: java.lang.IllegalStateException: Item not found: 11 at org.apache.ignite.internal.processors.cache.persistence.CacheDataRowAdapter.initFromLink(CacheDataRowAdapter.java:203) at org.apache.ignite.internal.processors.cache.persistence.CacheDataRowAdapter.initFromLink(CacheDataRowAdapter.java:104) at org.apache.ignite.internal.processors.query.h2.database.H2RowFactory.getRow(H2RowFactory.java:61) at org.apache.ignite.internal.processors.query.h2.database.H2Tree.createRowFromLink(H2Tree.java:246) at org.apache.ignite.internal.processors.query.h2.database.io.H2ExtrasLeafIO.getLookupRow(H2ExtrasLeafIO.java:126) at org.apache.ignite.internal.processors.query.h2.database.io.H2ExtrasLeafIO.getLookupRow(H2ExtrasLeafIO.java:36) at org.apache.ignite.internal.processors.query.h2.database.H2Tree.getRow(H2Tree.java:264) at org.apache.ignite.internal.processors.query.h2.database.H2Tree.getRow(H2Tree.java:56) at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$ForwardCursor.fillFromBuffer(BPlusTree.java:4808) at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$ForwardCursor.init(BPlusTree.java:4710) at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$ForwardCursor.access$5000(BPlusTree.java:4646) at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.findLowerUnbounded(BPlusTree.java:976) ... 10 more Caused by: java.lang.IllegalStateException: Item not found: 11 at org.apache.ignite.internal.processors.cache.persistence.tree.io.AbstractDataPageIO.findIndirectItemIndex(AbstractDataPageIO.java:341) at org.apache.ignite.internal.processors.cache.persistence.tree.io.AbstractDataPageIO.getDataOffset(Abstra
[jira] [Created] (IGNITE-13809) Add SpringCache support for thin client
Ilya Shishkov created IGNITE-13809: -- Summary: Add SpringCache support for thin client Key: IGNITE-13809 URL: https://issues.apache.org/jira/browse/IGNITE-13809 Project: Ignite Issue Type: New Feature Components: spring, thin client Affects Versions: 2.10 Reporter: Ilya Shishkov It would be perfect, if we add this feature, because now it is supported only for client nodes, but not for thin clients. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [ignite-3] ibessonov commented on a change in pull request #5: IGNITE-13562 Unified configuration initial prototype
ibessonov commented on a change in pull request #5: URL: https://github.com/apache/ignite-3/pull/5#discussion_r535139224 ## File path: modules/config-sample/pom.xml ## @@ -0,0 +1,86 @@ + + + + + +http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; + xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd";> +4.0.0 + +org.apache.ignite +ignite-configuration-sample +3.0-SNAPSHOT +http://ignite.apache.org + + +1.8 +1.8 + + + + +log4j +log4j +1.2.17 +test + + + +com.typesafe +config +1.4.1 + + + +org.apache.ignite +ignite-configuration +${project.version} + + +junit +junit +4.13 +test + + + + + + +org.apache.maven.plugins +maven-compiler-plugin +3.8.1 + + + org.apache.ignite.configuration.processor.internal.Processor Review comment: Is there a chance of putting this into meta-inf of processor module? ## File path: modules/config-sample/pom.xml ## @@ -0,0 +1,86 @@ + + + + + +http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; + xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd";> +4.0.0 + +org.apache.ignite +ignite-configuration-sample +3.0-SNAPSHOT +http://ignite.apache.org + + +1.8 +1.8 + + + + +log4j +log4j +1.2.17 +test + + + +com.typesafe Review comment: It would be cool to sort dependencies, test dependencies will be clearly separated then. ## File path: modules/configuration-annotation-processor/src/main/java/org/apache/ignite/configuration/processor/internal/Processor.java ## @@ -0,0 +1,692 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + +package org.apache.ignite.configuration.processor.internal; + +import java.io.IOException; +import java.lang.invoke.MethodHandle; +import java.lang.invoke.MethodHandles; +import java.lang.invoke.MethodType; +import java.util.ArrayList; +import java.util.Collections; +import java.util.Deque; +import java.util.HashMap; +import java.util.HashSet; +import java.util.LinkedList; +import java.util.List; +import java.util.Map; +import java.util.Set; +import java.util.stream.Collectors; +import java.util.stream.IntStream; +import javax.annotation.processing.AbstractProcessor; +import javax.annotation.processing.Filer; +import javax.annotation.processing.ProcessingEnvironment; +import javax.annotation.processing.RoundEnvironment; +import javax.lang.model.SourceVersion; +import javax.lang.model.element.Element; +import javax.lang.model.element.ElementKind; +import javax.lang.model.element.Modifier; +import javax.lang.model.element.PackageElement; +import javax.lang.model.element.TypeElement; +import javax.lang.model.element.VariableElement; +import javax.lang.model.util.Elements; +import com.squareup.javapoet.ClassName; +import com.squareup.javapoet.CodeBlock; +import com.squareup.javapoet.FieldSpec; +import com.squareup.javapoet.JavaFile; +import com.squareup.javapoet.MethodSpec; +import com.squareup.javapoet.ParameterizedTypeName; +import com.squareup.javapoet.TypeName; +import com.squareup.javapoet.TypeSpec; +import com.squareup.javapoet.WildcardTypeName; +import org.apache.ignite.configuration.internal.Configurator; +import org.apache.ignite.configuration.internal.DynamicConfiguration; +import org.apache.ignite.configuration.internal.NamedListConfiguration; +import org.apache.ignite.configuration.internal.annotation.Config; +import org.apache.ignite.configuration.internal.annotation.ConfigValue; +import org.apache.ignite.configuration.internal.annotation.NamedConfigValue; +import org.apache.ignite.configuration.internal.a
[GitHub] [ignite-3] SammyVimes commented on a change in pull request #5: IGNITE-13562 Unified configuration initial prototype
SammyVimes commented on a change in pull request #5: URL: https://github.com/apache/ignite-3/pull/5#discussion_r535244939 ## File path: modules/config-sample/pom.xml ## @@ -0,0 +1,86 @@ + + + + + +http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; + xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd";> +4.0.0 + +org.apache.ignite +ignite-configuration-sample +3.0-SNAPSHOT +http://ignite.apache.org + + +1.8 +1.8 + + + + +log4j +log4j +1.2.17 +test + + + +com.typesafe +config +1.4.1 + + + +org.apache.ignite +ignite-configuration +${project.version} + + +junit +junit +4.13 +test + + + + + + +org.apache.maven.plugins +maven-compiler-plugin +3.8.1 + + + org.apache.ignite.configuration.processor.internal.Processor Review comment: Done This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [ignite-3] SammyVimes commented on a change in pull request #5: IGNITE-13562 Unified configuration initial prototype
SammyVimes commented on a change in pull request #5: URL: https://github.com/apache/ignite-3/pull/5#discussion_r535247519 ## File path: modules/configuration-annotation-processor/pom.xml ## @@ -0,0 +1,94 @@ + + + + + +http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; + xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd";> +4.0.0 + +org.apache.ignite +ignite-configuration-annotation-processor +3.0-SNAPSHOT +http://ignite.apache.org + + +1.8 Review comment: Done (but I hope we'll move to Gradle) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [ignite-3] SammyVimes commented on a change in pull request #5: IGNITE-13562 Unified configuration initial prototype
SammyVimes commented on a change in pull request #5: URL: https://github.com/apache/ignite-3/pull/5#discussion_r535248128 ## File path: modules/config-sample/src/main/java/org/apache/ignite/configuration/internal/AutoAdjustConfigurationSchema.java ## @@ -0,0 +1,43 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + +package org.apache.ignite.configuration.internal; Review comment: Sure, this module is just a demo This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [ignite-3] SammyVimes commented on a change in pull request #5: IGNITE-13562 Unified configuration initial prototype
SammyVimes commented on a change in pull request #5: URL: https://github.com/apache/ignite-3/pull/5#discussion_r535251190 ## File path: modules/configuration-annotation-processor/pom.xml ## @@ -0,0 +1,94 @@ + + + + + +http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; + xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd";> +4.0.0 + +org.apache.ignite +ignite-configuration-annotation-processor +3.0-SNAPSHOT +http://ignite.apache.org + + +1.8 +1.8 + + + + +log4j +log4j +1.2.17 +test + + + +com.squareup +javapoet +1.13.0 + + + +org.apache.ignite +ignite-configuration +${project.version} + + + +org.mockito +mockito-core +3.4.6 +test + + + +com.google.testing.compile +compile-testing +0.19 +test + + + +org.junit.jupiter +junit-jupiter-engine +5.6.2 +test + + + +fr.inria.gforge.spoon +spoon-core Review comment: I'm not an expert either, but as I understand MIT license is permissive and compatible with the Apache license. Also, we won't be distributing Spoon as it's only a test dependency. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [ignite-3] AMashenkov commented on a change in pull request #5: IGNITE-13562 Unified configuration initial prototype
AMashenkov commented on a change in pull request #5: URL: https://github.com/apache/ignite-3/pull/5#discussion_r535264583 ## File path: modules/config-sample/pom.xml ## @@ -0,0 +1,86 @@ + + + + + +http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; + xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd";> +4.0.0 + +org.apache.ignite +ignite-configuration-sample +3.0-SNAPSHOT +http://ignite.apache.org + + +1.8 +1.8 + + + + +log4j +log4j +1.2.17 +test + + + +com.typesafe +config +1.4.1 + + + +org.apache.ignite +ignite-configuration +${project.version} + + +junit +junit +4.13 Review comment: We are going to switch to JUnit 5. Let's use property for versions, to be sure we use the same dependency version everywhere while possible. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [ignite-3] AMashenkov commented on a change in pull request #5: IGNITE-13562 Unified configuration initial prototype
AMashenkov commented on a change in pull request #5: URL: https://github.com/apache/ignite-3/pull/5#discussion_r535268251 ## File path: modules/configuration-annotation-processor/src/main/java/org/apache/ignite/configuration/processor/internal/Processor.java ## @@ -0,0 +1,692 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + +package org.apache.ignite.configuration.processor.internal; Review comment: Does it make sense to change package to **org.apache.ignite.internal.configuration.processor** for better filtering as some code checks may use different policies for public and internal API. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [ignite-3] AMashenkov commented on a change in pull request #5: IGNITE-13562 Unified configuration initial prototype
AMashenkov commented on a change in pull request #5: URL: https://github.com/apache/ignite-3/pull/5#discussion_r535268251 ## File path: modules/configuration-annotation-processor/src/main/java/org/apache/ignite/configuration/processor/internal/Processor.java ## @@ -0,0 +1,692 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + +package org.apache.ignite.configuration.processor.internal; Review comment: Does it make sense to change package to **org.apache.ignite.internal.configuration.processor** for better filtering? Some code checks may use different policies for public and internal API. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Joining the community
Hi everyone! My name is Nikita Safonov, I am a professional technical writer. Since I am familiar with in-memory processing technology and deeply interested in its emerging nature, I would be glad to contribute to the community. I kindly request to grant me access to the Apache Ignite JIRA. My JIRA ID is: nsafonov Best regards, Nikita
[GitHub] [ignite-3] SammyVimes commented on a change in pull request #5: IGNITE-13562 Unified configuration initial prototype
SammyVimes commented on a change in pull request #5: URL: https://github.com/apache/ignite-3/pull/5#discussion_r535350963 ## File path: modules/configuration-annotation-processor/src/main/java/org/apache/ignite/configuration/processor/internal/validation/ValidationGenerator.java ## @@ -0,0 +1,111 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + +package org.apache.ignite.configuration.processor.internal.validation; + +import java.util.ArrayList; +import java.util.Arrays; +import java.util.List; +import java.util.stream.Collectors; +import javax.lang.model.element.VariableElement; +import javax.lang.model.type.MirroredTypesException; +import javax.lang.model.type.TypeMirror; +import javax.validation.constraints.Max; +import javax.validation.constraints.Min; +import javax.validation.constraints.NotNull; +import com.squareup.javapoet.CodeBlock; +import org.apache.ignite.configuration.internal.DynamicConfiguration; +import org.apache.ignite.configuration.internal.annotation.Validate; +import org.apache.ignite.configuration.internal.validation.MaxValidator; +import org.apache.ignite.configuration.internal.validation.MinValidator; +import org.apache.ignite.configuration.internal.validation.NotNullValidator; + +/** + * Class that handles validation generation. + */ +public class ValidationGenerator { +/** Private constructor. */ +private ValidationGenerator() { +} + +/** + * Generate validation block. + * + * @param variableElement Configuration field. + * @return Code block for field validation. + */ +public static CodeBlock generateValidators(VariableElement variableElement) { +List validators = new ArrayList<>(); +final Min minAnnotation = variableElement.getAnnotation(Min.class); +if (minAnnotation != null) { +final long minValue = minAnnotation.value(); +final String message = minAnnotation.message(); +final CodeBlock build = CodeBlock.builder().add("new $T<$T>($L, $S)", MinValidator.class, DynamicConfiguration.class, minValue, message).build(); +validators.add(build); +} + +final Max maxAnnotation = variableElement.getAnnotation(Max.class); +if (maxAnnotation != null) { +final long maxValue = maxAnnotation.value(); +final String message = maxAnnotation.message(); +final CodeBlock build = CodeBlock.builder().add("new $T<$T>($L, $S)", MaxValidator.class, DynamicConfiguration.class, maxValue, message).build(); +validators.add(build); +} + +final NotNull notNull = variableElement.getAnnotation(NotNull.class); +if (notNull != null) { +final String message = notNull.message(); +final CodeBlock build = CodeBlock.builder().add("new $T<$T>($S)", NotNullValidator.class, DynamicConfiguration.class, message).build(); +validators.add(build); +} + +List validateAnnotations = new ArrayList<>(); + +final Validate.List validateAnnotationsList = variableElement.getAnnotation(Validate.List.class); + +if (validateAnnotationsList != null) { + validateAnnotations.addAll(Arrays.asList(validateAnnotationsList.value())); +} + +final Validate validateAnnotationSingle = variableElement.getAnnotation(Validate.class); + +if (validateAnnotationSingle != null) { +validateAnnotations.add(validateAnnotationSingle); +} + +validateAnnotations.forEach(validateAnnotation -> { +List values = null; +try { +validateAnnotation.value(); +} catch (MirroredTypesException e) { +values = e.getTypeMirrors(); Review comment: Done This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [ignite-3] SammyVimes commented on a change in pull request #5: IGNITE-13562 Unified configuration initial prototype
SammyVimes commented on a change in pull request #5: URL: https://github.com/apache/ignite-3/pull/5#discussion_r535360071 ## File path: modules/configuration-annotation-processor/src/test/resources/org/apache/ignite/configuration/processor/internal/TestConfigurationSchema.java ## @@ -0,0 +1,22 @@ +package org.apache.ignite.configuration.processor.internal; + +import org.apache.ignite.configuration.internal.annotation.Config; +import org.apache.ignite.configuration.internal.annotation.Value; + +@Config(value = "test", root = true) +public class TestConfigurationSchema { +@Value +private String value1; + +@Value +private long primitiveLong; + +@Value +private Long boxedLong; + +@Value +private int primitiveInt; + +@Value +private Integer boxedInt; +} Review comment: This is a test java file in resources, I'm not sure if it should follow our style guides as we only need in the test's runtime. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [ignite-3] SammyVimes commented on a change in pull request #5: IGNITE-13562 Unified configuration initial prototype
SammyVimes commented on a change in pull request #5: URL: https://github.com/apache/ignite-3/pull/5#discussion_r535360759 ## File path: modules/configuration/src/main/java/org/apache/ignite/configuration/internal/Configurator.java ## @@ -0,0 +1,105 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + +package org.apache.ignite.configuration.internal; + +import java.io.Serializable; +import java.util.ArrayList; +import java.util.Collections; +import java.util.HashMap; +import java.util.List; +import java.util.Map; +import java.util.function.Function; +import org.apache.ignite.configuration.internal.property.DynamicProperty; +import org.apache.ignite.configuration.internal.property.Modifier; +import org.apache.ignite.configuration.internal.property.PropertyListener; +import org.apache.ignite.configuration.internal.selector.Selector; +import org.apache.ignite.configuration.internal.validation.FieldValidator; +import org.apache.ignite.configuration.internal.validation.MemberKey; + +public class Configurator> { + +private final ConfigurationStorage storage; + +private final T root; + +private final Map>>> fieldValidators = new HashMap<>(); + +public Configurator(ConfigurationStorage storage, Function, T> rootBuilder) { +this.storage = storage; +this.root = rootBuilder.apply(this); +this.init(); +} + +private void init() { +List props = new ArrayList<>(); + +props.forEach(property -> { Review comment: Whoops, correct This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [ignite-3] SammyVimes commented on a change in pull request #5: IGNITE-13562 Unified configuration initial prototype
SammyVimes commented on a change in pull request #5: URL: https://github.com/apache/ignite-3/pull/5#discussion_r535400429 ## File path: modules/configuration/src/main/java/org/apache/ignite/configuration/internal/DynamicConfiguration.java ## @@ -0,0 +1,147 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + +package org.apache.ignite.configuration.internal; + +import java.io.Serializable; +import java.util.HashMap; +import java.util.List; +import java.util.Map; +import org.apache.ignite.configuration.internal.property.DynamicProperty; +import org.apache.ignite.configuration.internal.property.Modifier; +import org.apache.ignite.configuration.internal.selector.BaseSelectors; +import org.apache.ignite.configuration.internal.validation.FieldValidator; + +/** + * This class represents configuration root or node. + */ +public abstract class DynamicConfiguration implements Modifier { +/** Fully qualified name of the configuration. */ +protected final String qualifiedName; + +/** Configuration key. */ +protected final String key; + +/** Configuration prefix. */ +protected final String prefix; + +/** Configuration members (leafs and nodes). */ +protected final Map> members = new HashMap<>(); + +/** Root configuration node. */ +protected final DynamicConfiguration root; + +/** {@code true} if this is a member of {@link NamedListConfiguration}. */ +protected final boolean isNamed; + +/** Configurator that this configuration is attached to. */ +protected final Configurator> configurator; + +/** + * Constructor. + * @param prefix Configuration prefix. + * @param key Configuration key. + * @param isNamed Is this a part of named configuration. + * @param configurator Configurator that this object is attached to. + * @param root Root configuration. + */ +protected DynamicConfiguration( +String prefix, +String key, +boolean isNamed, +Configurator> configurator, +DynamicConfiguration root +) { +this.prefix = prefix; +this.isNamed = isNamed; +this.configurator = configurator; + +this.key = key; +if (root == null) +this.qualifiedName = key; +else { +if (isNamed) +qualifiedName = String.format("%s[%s]", prefix, key); Review comment: Actually, we can't move past this formatting, as we need to differ static part of the name and dynamic This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [ignite-3] SammyVimes commented on a change in pull request #5: IGNITE-13562 Unified configuration initial prototype
SammyVimes commented on a change in pull request #5: URL: https://github.com/apache/ignite-3/pull/5#discussion_r535404023 ## File path: modules/configuration/src/main/java/org/apache/ignite/configuration/internal/annotation/Config.java ## @@ -0,0 +1,69 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + +package org.apache.ignite.configuration.internal.annotation; + +import java.lang.annotation.Documented; +import java.lang.annotation.Retention; +import java.lang.annotation.Target; +import org.apache.ignite.configuration.internal.DynamicConfiguration; + +import static java.lang.annotation.ElementType.TYPE; +import static java.lang.annotation.RetentionPolicy.SOURCE; + +/** + * This annotation, if applied to a class, marks it as a configuration schema. + * Annotation processor generates a couple of classes for each configuration schema: Review comment: You're right This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [ignite-3] SammyVimes commented on a change in pull request #5: IGNITE-13562 Unified configuration initial prototype
SammyVimes commented on a change in pull request #5: URL: https://github.com/apache/ignite-3/pull/5#discussion_r535405567 ## File path: modules/configuration/src/main/java/org/apache/ignite/configuration/internal/annotation/Validate.java ## @@ -0,0 +1,77 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + +package org.apache.ignite.configuration.internal.annotation; + +import java.lang.annotation.Documented; +import java.lang.annotation.Repeatable; +import java.lang.annotation.Retention; +import java.lang.annotation.Target; +import org.apache.ignite.configuration.internal.validation.FieldValidator; + +import static java.lang.annotation.ElementType.FIELD; +import static java.lang.annotation.RetentionPolicy.SOURCE; + +/** + * This annotation applies custom validation to configuration field, for example: + * + * public class ConfSchema { + * {@literal @}Validate(SomeCustomValidator.class) + * private String value; + * } + * + * + * If you need multiple custom validations: + * + * public class ConfSchema { + * {@literal @}Validate.List({ Review comment: Yeah, right, I actually use the correct way to repeat annotations in the example, just forgot about the doc This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [ignite-3] SammyVimes commented on a change in pull request #5: IGNITE-13562 Unified configuration initial prototype
SammyVimes commented on a change in pull request #5: URL: https://github.com/apache/ignite-3/pull/5#discussion_r535407691 ## File path: modules/configuration/src/main/java/org/apache/ignite/configuration/internal/property/NamedList.java ## @@ -0,0 +1,51 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + +package org.apache.ignite.configuration.internal.property; + +import java.util.Map; + +/** + * This class holds named configurations in VIEW object. + */ +public class NamedList { +/** Named values. */ +private final Map values; + +/** + * Constructor. + * @param values Named values. + */ +public NamedList(Map values) { +this.values = values; +} + +/** + * Get named values. + * @return Named values. + */ +public Map getValues() { +return values; +} + +/** {@inheritDoc} */ +@Override public String toString() { +return "NamedList{" + Review comment: We actually don't need that at all, I'm just going to remove it This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [ignite-3] SammyVimes commented on a change in pull request #5: IGNITE-13562 Unified configuration initial prototype
SammyVimes commented on a change in pull request #5: URL: https://github.com/apache/ignite-3/pull/5#discussion_r535408185 ## File path: modules/configuration/src/main/java/org/apache/ignite/configuration/internal/selector/BaseSelectors.java ## @@ -0,0 +1,125 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + +package org.apache.ignite.configuration.internal.selector; + +import java.lang.invoke.MethodHandle; +import java.util.ArrayList; +import java.util.HashMap; +import java.util.List; +import java.util.Map; +import java.util.stream.Collectors; +import org.apache.ignite.configuration.internal.DynamicConfiguration; +import org.apache.ignite.configuration.internal.property.Modifier; + +/** + * Base selector holder. + */ +public class BaseSelectors { +/** Map from string representation of selector to {@link SelectorHolder}. */ +private static final Map selectors = new HashMap<>(); + +/** + * Get selector from selectors map by key. + * + * Valid formats for selector key: + * + * root.inner.option.field in case of static config field + * root.inner.named[name].field in case of dynamic (named) config field + * + * + * @param name Selector name. + * @return Selector. + */ +public static , B extends Modifier, C, D, E> Selector find(String name) { +String[] splitten = name.split("\\."); Review comment: `true` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [ignite-3] SammyVimes commented on a change in pull request #5: IGNITE-13562 Unified configuration initial prototype
SammyVimes commented on a change in pull request #5: URL: https://github.com/apache/ignite-3/pull/5#discussion_r535411746 ## File path: modules/configuration/src/main/java/org/apache/ignite/configuration/internal/selector/BaseSelectors.java ## @@ -0,0 +1,125 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + +package org.apache.ignite.configuration.internal.selector; + +import java.lang.invoke.MethodHandle; +import java.util.ArrayList; +import java.util.HashMap; +import java.util.List; +import java.util.Map; +import java.util.stream.Collectors; +import org.apache.ignite.configuration.internal.DynamicConfiguration; +import org.apache.ignite.configuration.internal.property.Modifier; + +/** + * Base selector holder. + */ +public class BaseSelectors { +/** Map from string representation of selector to {@link SelectorHolder}. */ +private static final Map selectors = new HashMap<>(); + +/** + * Get selector from selectors map by key. + * + * Valid formats for selector key: + * + * root.inner.option.field in case of static config field + * root.inner.named[name].field in case of dynamic (named) config field + * + * + * @param name Selector name. + * @return Selector. + */ +public static , B extends Modifier, C, D, E> Selector find(String name) { Review comment: I personally used it to find selectors in the CLI tool demo. I'm not sure if we can make it private though This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [ignite-3] SammyVimes commented on a change in pull request #5: IGNITE-13562 Unified configuration initial prototype
SammyVimes commented on a change in pull request #5: URL: https://github.com/apache/ignite-3/pull/5#discussion_r535413713 ## File path: modules/configuration/src/main/java/org/apache/ignite/configuration/internal/selector/BaseSelectors.java ## @@ -0,0 +1,125 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + +package org.apache.ignite.configuration.internal.selector; + +import java.lang.invoke.MethodHandle; +import java.util.ArrayList; +import java.util.HashMap; +import java.util.List; +import java.util.Map; +import java.util.stream.Collectors; +import org.apache.ignite.configuration.internal.DynamicConfiguration; +import org.apache.ignite.configuration.internal.property.Modifier; + +/** + * Base selector holder. + */ +public class BaseSelectors { +/** Map from string representation of selector to {@link SelectorHolder}. */ +private static final Map selectors = new HashMap<>(); + +/** + * Get selector from selectors map by key. + * + * Valid formats for selector key: + * + * root.inner.option.field in case of static config field + * root.inner.named[name].field in case of dynamic (named) config field + * + * + * @param name Selector name. + * @return Selector. + */ +public static , B extends Modifier, C, D, E> Selector find(String name) { Review comment: Changed to actual type names, but not sure how to format signature THAT big This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [ignite-3] SammyVimes commented on a change in pull request #5: IGNITE-13562 Unified configuration initial prototype
SammyVimes commented on a change in pull request #5: URL: https://github.com/apache/ignite-3/pull/5#discussion_r535414280 ## File path: modules/configuration/src/main/java/org/apache/ignite/configuration/internal/validation/FieldValidator.java ## @@ -0,0 +1,46 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + +package org.apache.ignite.configuration.internal.validation; + +import java.io.Serializable; +import org.apache.ignite.configuration.internal.DynamicConfiguration; + +/** + * Base class for field validator. Contains exception message. + * @param Field type. + * @param Root configuration type. + */ +public abstract class FieldValidator> { +/** Validation error message. */ +protected final String message; + +/** Constructor. */ +protected FieldValidator(String message) { Review comment: Yes, why? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [ignite-3] SammyVimes commented on a change in pull request #5: IGNITE-13562 Unified configuration initial prototype
SammyVimes commented on a change in pull request #5: URL: https://github.com/apache/ignite-3/pull/5#discussion_r535417248 ## File path: modules/config-sample/pom.xml ## @@ -0,0 +1,86 @@ + + + + + +http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; + xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd";> +4.0.0 + +org.apache.ignite +ignite-configuration-sample +3.0-SNAPSHOT +http://ignite.apache.org + + +1.8 +1.8 + + + + +log4j +log4j +1.2.17 +test + + + +com.typesafe +config +1.4.1 + + + +org.apache.ignite +ignite-configuration +${project.version} + + +junit +junit +4.13 Review comment: Changed to JUnit5, but this method is going to be removed (it's just a demo), and also we don't really have a lot of options, as there is no single parent pom or smth like that. AFAIK there is no decision on dependency management yet, so I'd leave it be This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [ignite-3] SammyVimes commented on a change in pull request #5: IGNITE-13562 Unified configuration initial prototype
SammyVimes commented on a change in pull request #5: URL: https://github.com/apache/ignite-3/pull/5#discussion_r535418386 ## File path: modules/configuration-annotation-processor/src/main/java/org/apache/ignite/configuration/processor/internal/Processor.java ## @@ -0,0 +1,692 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + +package org.apache.ignite.configuration.processor.internal; Review comment: Reasonable, will do This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [ignite-3] SammyVimes commented on a change in pull request #5: IGNITE-13562 Unified configuration initial prototype
SammyVimes commented on a change in pull request #5: URL: https://github.com/apache/ignite-3/pull/5#discussion_r535440706 ## File path: modules/configuration/src/main/java/org/apache/ignite/configuration/internal/validation/FieldValidator.java ## @@ -0,0 +1,46 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + +package org.apache.ignite.configuration.internal.validation; + +import java.io.Serializable; +import org.apache.ignite.configuration.internal.DynamicConfiguration; + +/** + * Base class for field validator. Contains exception message. + * @param Field type. + * @param Root configuration type. + */ +public abstract class FieldValidator> { +/** Validation error message. */ +protected final String message; + +/** Constructor. */ +protected FieldValidator(String message) { +this.message = message; +} + +/** + * Validate field. + * + * @param value New value. + * @param newRoot New configuration root. + * @param oldRoot Old configuration root. + */ +public abstract void validate(T value, C newRoot, C oldRoot); Review comment: I decided to go with the checked exception (added it to the signature and docs ofcourse) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
swapping the blocks on the website https://ignite.apache.org/download.cgi: SOURCE RELEASES and BINARY RELEASES
Hello, igniters! I suggest swapping the blocks on the website https://ignite.apache.org/download.cgi: SOURCE RELEASES and BINARY RELEASES. It is more predictable for the user. https://ignite.apache.org/download.cgi -- Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/
Re: Joining the community
Hi Nikita, Welcome to the community! Any help with the documentation is extremely valuable. I've added you to the Contributors group in Jira - you should be able to assign tickets to yourself now. -Val On Thu, Dec 3, 2020 at 7:46 AM Никита Сафонов wrote: > Hi everyone! > My name is Nikita Safonov, I am a professional technical writer. Since I am > familiar with in-memory processing technology and deeply interested in its > emerging nature, I would be glad to contribute to the community. I kindly > request to grant me access to the Apache Ignite JIRA. > > My JIRA ID is: nsafonov > > > Best regards, > > Nikita >
[GitHub] [ignite-3] SammyVimes commented on a change in pull request #5: IGNITE-13562 Unified configuration initial prototype
SammyVimes commented on a change in pull request #5: URL: https://github.com/apache/ignite-3/pull/5#discussion_r535440706 ## File path: modules/configuration/src/main/java/org/apache/ignite/configuration/internal/validation/FieldValidator.java ## @@ -0,0 +1,46 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + +package org.apache.ignite.configuration.internal.validation; + +import java.io.Serializable; +import org.apache.ignite.configuration.internal.DynamicConfiguration; + +/** + * Base class for field validator. Contains exception message. + * @param Field type. + * @param Root configuration type. + */ +public abstract class FieldValidator> { +/** Validation error message. */ +protected final String message; + +/** Constructor. */ +protected FieldValidator(String message) { +this.message = message; +} + +/** + * Validate field. + * + * @param value New value. + * @param newRoot New configuration root. + * @param oldRoot Old configuration root. + */ +public abstract void validate(T value, C newRoot, C oldRoot); Review comment: I decided to go with the runtime exception in the end (added it to the signature and docs of course) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [ignite-3] SammyVimes commented on a change in pull request #5: IGNITE-13562 Unified configuration initial prototype
SammyVimes commented on a change in pull request #5: URL: https://github.com/apache/ignite-3/pull/5#discussion_r535547981 ## File path: modules/configuration/src/main/java/org/apache/ignite/configuration/internal/validation/MaxValidator.java ## @@ -0,0 +1,42 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + +package org.apache.ignite.configuration.internal.validation; + +import org.apache.ignite.configuration.internal.DynamicConfiguration; + +/** + * Validate that field value is not greater than some maximum value. + * + * @param Root configuration type. + */ +public class MaxValidator> extends FieldValidator { +/** Maximum value. */ +private final long maxValue; + +/** Constructor. */ +public MaxValidator(long maxValue, String message) { +super(message); +this.maxValue = maxValue; +} + +/** {@inheritDoc} */ +@Override public void validate(Number value, C newRoot, C oldRoot) { +if (value.longValue() > maxValue) +throw new ConfigurationValidationException(message); Review comment: If we make this exception checked, then every configuration API call like ``` local.baseline.enabled(false); ``` will have to be wrapped in try-catch with ConfigurationValidationException. I think it for sure needs further discussion, but we can leave it as-is for now, as changing runtime to checked is no biggie This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: swapping the blocks on the website https://ignite.apache.org/download.cgi: SOURCE RELEASES and BINARY RELEASES
+1 - Denis On Thu, Dec 3, 2020 at 10:58 AM kpushenko wrote: > Hello, igniters! > > I suggest swapping the blocks on the website > https://ignite.apache.org/download.cgi: SOURCE RELEASES > and BINARY RELEASES. > It is more predictable for the user. > https://ignite.apache.org/download.cgi > > > > > -- > Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/ >
Re: Joining the community
Hi Nikita, Welcome to the community! We've been waiting for professionals like you for a while ;) Sharing extra resources: - Our documentation contribution process, you're welcome to suggest changes: https://cwiki.apache.org/confluence/display/IGNITE/How+to+Document - Our Slack channel, you can reach out to most of the contributors there if need to talk out any ticket 101: https://cwiki.apache.org/confluence/display/IGNITE/How+to+Collaborate#HowtoCollaborate-IgniteSlack Please join in me and Maksim here, we already need your help: https://issues.apache.org/jira/browse/IGNITE-13796 - Denis On Thu, Dec 3, 2020 at 11:22 AM Valentin Kulichenko < valentin.kuliche...@gmail.com> wrote: > Hi Nikita, > > Welcome to the community! Any help with the documentation is extremely > valuable. > > I've added you to the Contributors group in Jira - you should be able to > assign tickets to yourself now. > > -Val > > On Thu, Dec 3, 2020 at 7:46 AM Никита Сафонов > wrote: > > > Hi everyone! > > My name is Nikita Safonov, I am a professional technical writer. Since I > am > > familiar with in-memory processing technology and deeply interested in > its > > emerging nature, I would be glad to contribute to the community. I kindly > > request to grant me access to the Apache Ignite JIRA. > > > > My JIRA ID is: nsafonov > > > > > > Best regards, > > > > Nikita > > >
[jira] [Created] (IGNITE-13810) Append additional log and metrics info regarding cache expiration.
Stanilovsky Evgeny created IGNITE-13810: --- Summary: Append additional log and metrics info regarding cache expiration. Key: IGNITE-13810 URL: https://issues.apache.org/jira/browse/IGNITE-13810 Project: Ignite Issue Type: Improvement Components: cache Affects Versions: 2.9 Reporter: Stanilovsky Evgeny Assignee: Stanilovsky Evgeny Currently we have no any additional information regarding _cache.withExpiryPolicy_ execution. Additionally it would be very useful to have a corresponding metric. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (IGNITE-13811) ServerImpl#pingNode(InetSocketAddress, UUID, UUID) fails to ping nodes with unresolved addresses
Ivan Bessonov created IGNITE-13811: -- Summary: ServerImpl#pingNode(InetSocketAddress, UUID, UUID) fails to ping nodes with unresolved addresses Key: IGNITE-13811 URL: https://issues.apache.org/jira/browse/IGNITE-13811 Project: Ignite Issue Type: Bug Reporter: Ivan Bessonov Assignee: Ivan Bessonov Wrong key is deleted from map. {code:java} pingMap.putIfAbsent(addr, fut) {code} {code:java} if (addr.isUnresolved()) addr = new InetSocketAddress(InetAddress.getByName(addr.getHostName()), addr.getPort()); {code} {code:java} boolean b = pingMap.remove(addr, fut); assert b; {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (IGNITE-13812) CheckpointEntry is read from WAL right after its creation.
Ivan Bessonov created IGNITE-13812: -- Summary: CheckpointEntry is read from WAL right after its creation. Key: IGNITE-13812 URL: https://issues.apache.org/jira/browse/IGNITE-13812 Project: Ignite Issue Type: Bug Reporter: Ivan Bessonov Assignee: Ivan Bessonov {noformat} [2020-07-31 16:33:15,545][INFO ][pitr-ctx-exec-#304][WalStateManager] WAL logging disabled [2020-07-31 16:33:15,545][INFO ][db-checkpoint-thread-#152][GridCacheDatabaseSharedManager] Checkpoint finished [cpId=e1a57b48-1610-4280-a3e2-4d808a5f0343, pages=64, markPos=FileWALPointer [idx=5, fileOff=45749881, len=186791], walSegmentsCleared=0, walSegmentsCovered=[], markDuration=49ms, pagesWrite=0ms, fsync=5ms, total=79ms] [2020-07-31 16:33:15,546][INFO ][pitr-ctx-exec-#304][GridRecoveryProcessor] Start apply segment idx=1 [2020-07-31 16:33:16,012][INFO ][pitr-ctx-exec-#304][GridRecoveryProcessor] Segment idx=1 applied [2020-07-31 16:33:16,373][INFO ][pitr-ctx-exec-#304][GridRecoveryProcessor] Segment idx=2 applied [2020-07-31 16:33:16,553][ERROR][db-checkpoint-thread-#152][root] Critical system error detected. Will be handled accordingly to configured handler [hnd=StopNodeOrHaltFailureHandler [tryStop=false, timeout=0, super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=FailureContext [type=CRITICAL_ERROR, err=java.lang.ClassCastException: class o.a.i.i.pagemem.wal.record.MemoryRecoveryRecord cannot be cast to class o.a.i.i.pagemem.wal.record.CheckpointRecord (o.a.i.i.pagemem.wal.record.MemoryRecoveryRecord and o.a.i.i.pagemem.wal.record.CheckpointRecord are in unnamed module of loader 'app')]] java.lang.ClassCastException: class org.apache.ignite.internal.pagemem.wal.record.MemoryRecoveryRecord cannot be cast to class org.apache.ignite.internal.pagemem.wal.record.CheckpointRecord (org.apache.ignite.internal.pagemem.wal.record.MemoryRecoveryRecord and org.apache.ignite.internal.pagemem.wal.record.CheckpointRecord are in unnamed module of loader 'app') at org.apache.ignite.internal.processors.cache.persistence.checkpoint.CheckpointEntry$GroupStateLazyStore.initIfNeeded(CheckpointEntry.java:353) at org.apache.ignite.internal.processors.cache.persistence.checkpoint.CheckpointEntry$GroupStateLazyStore.access$300(CheckpointEntry.java:245) at org.apache.ignite.internal.processors.cache.persistence.checkpoint.CheckpointEntry.initIfNeeded(CheckpointEntry.java:124) at org.apache.ignite.internal.processors.cache.persistence.checkpoint.CheckpointEntry.groupState(CheckpointEntry.java:106) at org.apache.ignite.internal.processors.cache.persistence.checkpoint.CheckpointHistory.addCpToEarliestCpMap(CheckpointHistory.java:246) at org.apache.ignite.internal.processors.cache.persistence.checkpoint.CheckpointHistory.addCheckpoint(CheckpointHistory.java:179) at org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager$Checkpointer.markCheckpointBegin(GridCacheDatabaseSharedManager.java:4221) at org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager$Checkpointer.doCheckpoint(GridCacheDatabaseSharedManager.java:3732) at org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager$Checkpointer.body(GridCacheDatabaseSharedManager.java:3621) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:119) at java.base/java.lang.Thread.run(Thread.java:834){noformat} -- This message was sent by Atlassian Jira (v8.3.4#803005)