No, we use a more general approach to collect all kinds of logfiles

TailFile -> ExtractGrok -> JoltTransformJSON (make some transformation) -> 
PutSolrRecord 


And we dont use Nifi directly, we use Minifi running on each machine. So we can 
collect all kinds of logfiles from all kinds of applications.

------- Original Message -------

Sam Lee <samlee...@yahoo.com.INVALID> schrieb am Montag, 21. Februar 2022 um 
16:35:

> > yes solr is suitable for this. We aggregate various logfiles from many
> 

> > hosts with minifi and send them line by line to solr. Ingestion and
> > 

> > indexing is fine and you can query the logfiles just moments after
> > 

> > ingestion.
> 

> Thank you for the idea. I have no experience with Apache NiFi at the
> 

> moment. Is your Apache NiFi set up something like this?
> 

> https://bryanbende.com/development/2015/05/17/collecting-logs-with-apache-nifi
> 

> (ListenUDP -> MergeContent -> PutSolrContentStream).

Attachment: publickey - z0ltrix@pm.me - 0xF0E154C5.asc
Description: application/pgp-keys

Attachment: signature.asc
Description: OpenPGP digital signature

Reply via email to