Hello
I can make the same setup working on my computer.
What I mean is that when you write to the cache, you should see some files
being created in storage and these should persist across software reboots.
It is still possible there are some configuration settings in your Java
code, and also how the cache is being fed is undisclosed.
Also, are you running inside Kubernetes?
Can we have the output of:
- mount
- df
- lsattr /app
- lsattr /app/datastore1
- lsattr /app/datastore1
Cheers
Gianluca
On Mon, 15 May 2023 at 11:32, Krishna.Mulumudi.ril.com via user <
user@ignite.apache.org> wrote:
> After first restart of the cluster, Data is there and able retrieve from
> get calls but getting cache size zero, it's not retaining value.
>
>
>
> Able to replicate the issue with single server node also.
>
>
>
> 1. start server node
>
> 2. activate cluster.
>
> 3. write few records to cache.
>
> 4. restart the cluster
>
>
>
> Below are inline comments for requested info,
>
> Do these paths exist?
>
> -- Yes
>
> What are the permission flags for these three paths? (owner, group,
>
> permissions)
>
> -- drwxrwxr-x.
>
> Are you running the process by a user who has owner or group permission?
>
> -- runing with a user (tibusr)
>
> Any content in these directories from previous executions?
>
> -- No, we have setup new cluster and then inserted few records and then
> restarted the cluster.
>
> Any particular warning or failure description in the log files?
>
> -- could not see any warnings/errors
>
>
>
> Please find directories info for above requested info,
>
> #####################################################################
>
> [tibusr@******* ~]$ cd /app/Ignite/scripts
>
> [tibusr@******* scripts]$ cat config.properties
>
> nodeIpAddresses=*******:47500
>
> maxSize=#{10L * 1024 * 1024 * 1024}
>
> checkpointPageBufferSize=#{24L * 1024 * 1024 }
>
> pageSize=#{4 * 1024}
>
> #pageSize=#{16 * 1024}
>
> storagePath=/app/datastore1/data
>
> walMode=BACKGROUND
>
> walFlushFrequency=30000
>
> rebalanceThreadPoolSize=4
>
> rebalanceThrottle=100
>
> rebalanceBatchSize=#{16 * 1024 * 1024}
>
> walPath=/app/datastore1/wal
>
> metadataWorkDir=/app/datastore1/metadataWorkDir
>
> walArchivePath=/app/datastore1/archive
>
> #IGNITE_LOG4J2=/app/Ignite/scripts/ignite-log4j.xml
>
> IGNITE_LOG4J2=/app/Ignite/scripts/ignite-log4j2.xml
>
> IGNITE_INSTANCE_NAME=EDIF_IOT_ST
>
> snapshotsDirPath=/app/snapshots1/
>
> [tibusr@******* scripts]$ cd /app/
>
> [tibusr@******* app]$ ls -ltr
>
> total 27552
>
> drwx------. 2 tibusr tibusr 16384 Apr 6 2018 lost+found
>
> drwxrwxr-x. 2 tibusr tibusr 4096 May 11 17:11 snapshots1
>
> drwxrwxr-x. 3 tibusr tibusr 4096 May 13 15:34 logs
>
> drwxrwxr-x. 6 tibusr tibusr 4096 May 13 17:02 datastore1
>
> [tibusr@******* app]$ cd datastore1
>
> [tibusr@******* datastore1]$ ls -ltr
>
> total 16
>
> drwxrwxr-x. 3 tibusr tibusr 4096 May 13 17:02 data
>
> drwxrwxr-x. 4 tibusr tibusr 4096 May 13 17:02 metadataWorkDir
>
> drwxrwxr-x. 3 tibusr tibusr 4096 May 13 17:02 wal
>
> drwxrwxr-x. 3 tibusr tibusr 4096 May 13 17:02 archive
>
> [tibusr@******* datastore1]$
>
> #######################################################################
>
>
>
> And also please find attached server log.
>
>
>
>
>
> *From:* Krishna Mulumudi
> *Sent:* Friday, May 12, 2023 11:41 PM
> *To:* user@ignite.apache.org
> *Subject:* RE: Re: Cache size getting zero after first restart of server
> node in 2.13 version
>
>
>
> Hi Gianluca Bonetti,
>
> Please find below details
>
>
>
> CACHE CONFIGURATION :
>
>
>
>
>
> <property name="cacheConfiguration">
>
> <list>
>
> <bean
> class="org.apache.ignite.configuration.CacheConfiguration"
> parent="cache-template">
>
> <property name="name" value="JtlMapCustCache" />
>
> <property name="cacheMode" value="PARTITIONED" />
>
> <property name="atomicityMode" value="ATOMIC" />
>
> <property name="backups" value="1" />
>
> <property name="statisticsEnabled" value="true" />
>
> <property name="queryEntities">
>
> <list>
>
> <bean class="org.apache.ignite.cache.QueryEntity">
>
> <property name="keyType"
> value="com.jio.digitalapi.jtl.edif.model.JtlMapCustKey" />
>
> <property name="valueType" va
>
>
>
> SERVER CONFIGURATION :
>
>
>
> <?xml version="1.0" encoding="UTF-8"?>
>
>
>
> <beans
>
> xmlns="http://www.springframework.org/schema/beans";
>
> xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance";
>
> xmlns:util="http://www.springframework.org/schema/util";
>
> xsi:schemaLocation="http://www.springframework.org/schema/beans
> http://www.springframework.org/schema/beans/spring-beans.xsd
> http://www.springframework.org/schema/util
> http://www.springframework.org/schema/util/spring-util.xsd
> <http://www.springframework.org/schema/beans%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%20http:/www.springframework.org/schema/beans/spring-beans.xsd%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%20http:/www.springframework.org/schema/util%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%C2%A0%20http:/www.springframework.org/schema/util/spring-util.xsd>
> ">
>
> <!-- Load external properties file. -->
>
> <bean id="placeholderConfig"
>
>
> class="org.springframework.beans.factory.config.PropertyPlaceholderConfigurer">
>
> <property name="location" value="file:${PROPERTY_FILE_PATH}" />
>
> </bean>
>
> <bean class="org.apache.ignite.configuration.IgniteConfiguration">
>
> <property name="igniteInstanceName"
> value="${IGNITE_INSTANCE_NAME}" />
>
> <property name="peerClassLoadingEnabled" value="true"/>
>
> <property name="metricsLogFrequency" value="0" />
>
> <property name="failureDetectionTimeout" value="60000" />
>
> <property name="clientFailureDetectionTimeout" value="120000" />
>
> <property name="networkTimeout" value="60000" />
>
> <property name="workDirectory" value="${metadataWorkDir}"/>
>
> <property name="snapshotPath" value="${snapshotsDirPath}"/>
>
> <!--<property name="authenticationEnabled" value="true"/>-->
>
> <!-- <property name="failureHandler">
>
> <bean
> class="org.apache.ignite.failure.NoOpFailureHandler"/>
>
> </property> -->
>
>
>
> <!-- <property name="includeEventTypes">
>
> <list>
>
> <util:constant
> static-field="org.apache.ignite.events.EventType.EVT_CACHE_OBJECT_PUT"/>
>
> </list>
>
> </property> -->
>
>
>
> <property name="rebalanceThreadPoolSize"
> value="${rebalanceThreadPoolSize}"/>
>
> <!--<property name="clientConnectorConfiguration">
>
> <bean
> class="org.apache.ignite.configuration.ClientConnectorConfiguration" >
>
> <property name="jdbcEnabled"
> value="false"/>
>
> </bean>
>
> </property>-->
>
> <property name="gridLogger">
>
> <bean class="org.apache.ignite.logger.log4j2.Log4J2Logger">
>
> <constructor-arg type="java.lang.String"
> value="${IGNITE_SCRIPT}/ignite-log4j2.xml" />
>
> </bean>
>
> </property>
>
> <property name="dataStorageConfiguration">
>
> <bean
>
>
> class="org.apache.ignite.configuration.DataStorageConfiguration">
>
> <property name="defaultDataRegionConfiguration">
>
> <bean
>
>
> class="org.apache.ignite.configuration.DataRegionConfiguration">
>
> <property name="metricsEnabled" value="true"/>
>
> <property name="persistenceEnabled" value="true" />
>
> <!--<property name="maxSize" value="#{10L * 1024 *
> 1024 * 1024}"/> -->
>
> <property name="maxSize" value="${maxSize}" />
>
> <!-- Increasing the buffer size to 4 GB. -->
>
> <property name="checkpointPageBufferSize"
>
>
> value="${checkpointPageBufferSize}" />
>
> </bean>
>
> </property>
>
> <property name="storagePath" value="${storagePath}" />
>
> <property name="walPath" value="${walPath}" />
>
> <property name="walArchivePath" value="${walArchivePath}"
> />
>
> <!--<property name="walMode" value="LOG_ONLY" />-->
>
> <property name="walMode"
> value="${walMode}" />
>
> <property name="walFlushFrequency"
> value="${walFlushFrequency}"/>
>
> <property name="pageSize" value="${pageSize}" />
>
> <!-- Enable write throttling. -->
>
> <property name="writeThrottlingEnabled" value="true" />
>
> <property name="walHistorySize" value="1" />
>
> <property name="metricsEnabled" value="true"/>
>
> <property name="defaultWarmUpConfiguration">
>
> <bean
> class="org.apache.ignite.configuration.LoadAllWarmUpConfiguration"/>
>
> </property>
>
> </bean>
>
> </property>
>
> <property name="discoverySpi">
>
> <bean
>
>
> class="org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi">
>
> <property name="ipFinder">
>
> <bean
>
>
> class="org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder">
>
> <property name="addresses">
>
> <bean
> class="org.springframework.util.StringUtils"
>
>
> factory-method="commaDelimitedListToSet">
>
> <constructor-arg type="java.lang.String"
>
>
> value="${nodeIpAddresses}" />
>
> </bean>
>
> </property>
>
> </bean>
>
> </property>
>
> </bean>
>
> </property>
>
> <property name="communicationSpi">
>
> <bean
> class="org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi">
>
> <property name="socketWriteTimeout" value="60000"/>
>
> </bean>
>
> </property>
>
> </bean>
>
> </beans>
>
>
>
>
>
> Regards,
>
> Krishna Mulumudi
>
>
>
>
>
> On 2023/05/12 08:14:25 Gianluca Bonetti wrote:
>
> > Hello
>
> >
>
> > Not enough information, you didn't provide the current full configuration
>
> > nor a reproducible code test case.
>
> >
>
> > Cheers
>
> > Gianluca
>
> >
>
> > On Fri, 12 May 2023 at 09:07, Ganguly Gundeboina <ga...@gmail.com>
>
> > wrote:
>
> >
>
> > > Hi,
>
> > >
>
> > > We recently setup the 2.13 ignite cluster having three server nodes and
>
> > > enabled write services to write the records to the cluster.
>
> > >
>
> > > After few days, want to restart the cluster as part of maintenance
>
> > > activity. After restart all cache sizes showing zero even though data
> is
>
> > > there and getting retrieved.
>
> > >
>
> > > Below one used to get the cache size,
>
> > > cache.size(new CachePeekMode[]{Cache.PeekMode.PRIMARY})
>
> > >
>
> > > cache size is important to validate the data during maintenance.
>
> > >
>
> > > Replication steps:
>
> > > 1. setup cluster 2.13
>
> > > 2. insert few records in any cache.
>
> > > 3. restart the cluster.
>
> > >
>
> > > Same issue not observed in 2.11 and 2.7.6 versions.
>
> > >
>
> > > Regards,
>
> > > Ganguly
>
> > >
>
> >
>
> Sent from Mail <https://go.microsoft.com/fwlink/?LinkId=550986> for
> Windows
>
>
>
>
> "*Confidentiality Warning*: This message and any attachments are intended
> only for the use of the intended recipient(s), are confidential and may be
> privileged. If you are not the intended recipient, you are hereby notified
> that any review, re-transmission, conversion to hard copy, copying,
> circulation or other use of this message and any attachments is strictly
> prohibited. If you are not the intended recipient, please notify the sender
> immediately by return email and delete this message and any attachments
> from your system.
>
> *Virus Warning:* Although the company has taken reasonable precautions to
> ensure no viruses are present in this email. The company cannot accept
> responsibility for any loss or damage arising from the use of this email or
> attachment."
>
