Andreas Koch created NIFI-14740:
-----------------------------------

             Summary: provenance event not found via getEvent
                 Key: NIFI-14740
                 URL: https://issues.apache.org/jira/browse/NIFI-14740
             Project: Apache NiFi
          Issue Type: Wish
    Affects Versions: 2.2.0
            Reporter: Andreas Koch


I use EventAccess to get an instance of ProvenanceEventRepository. There I use 
getEvents to retrieve all events like getEvents(1,10) Sometimes some events are 
missing, for example event no. 5. I keep the missing ids in a list and 
periodically use getEvent(long) to check for the missing event ids.

In my use case I have a complex workflow and do process some millions of 
events. After all the flowfiles (hours ago) are being process (checked via UI). 
I still do not get some events via getEvent(long)

I added some logs into nifi:

o.a.n.p.WriteAheadProvenanceRepository getEvent 6839523
o.a.n.p.store.PartitionedEventStore getEvent 6839523 partitions: 1
o.a.n.p.store.WriteAheadStorePartition file true
o.a.n.p.store.WriteAheadStorePartition file 
/opt/nifi-nfs/config_resources/provenance_repository/6837237.prov
.a.n.p.store.WriteAheadStorePartition eventOption false

 

after restarting nifi I get

o.a.n.p.store.PartitionedEventStore getEvent 6839523 partitions: 1
o.a.n.p.store.WriteAheadStorePartition file true
o.a.n.p.store.WriteAheadStorePartition file 
/opt/nifi-nfs/config_resources/provenance_repository/6838323.prov.gz
o.a.n.p.store.WriteAheadStorePartition eventOption true

 

Why is that?

 

 

 

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to