[ 
https://issues.apache.org/jira/browse/NIFI-10428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17603636#comment-17603636
 ] 

John Wise commented on NIFI-10428:
----------------------------------

We're currently using an old HWX Schema Registry server to allow for 
near-real-time schema creation & updates.  Unfortunately, since that's been 
subsumed into Cloudera HDF, there haven't been any updates in a couple of years 
& the security model (KRB-only) is severely lacking.

NiFi absolutely *needs* some type of real-time schema management, in order to 
prevent having to stop & start an AvroSchemaRegistry (ASR) controller service & 
all of its dependent controller services and processors every time a schema 
addition/update is required.  That's not ideal in a production environment, 
where downtime is critical.

We already have a reusable flow in our NiFi Registry for downloading artifacts 
from multiple external URLs & placing them on NiFi nodes for use by 
controllers, so file-based schemas would be more ideal than ASR.

However, I'd still prefer a web-based GUI similar to HWX (except with inline 
schema validation & highlighting) to create & maintain schemas.  Either would 
be preferable to ASR, really.

> Allow for loading Avro record schema from files
> -----------------------------------------------
>
>                 Key: NIFI-10428
>                 URL: https://issues.apache.org/jira/browse/NIFI-10428
>             Project: Apache NiFi
>          Issue Type: New Feature
>          Components: Core Framework
>    Affects Versions: 1.18.0
>            Reporter: Daniel Stieglitz
>            Assignee: Daniel Stieglitz
>            Priority: Major
>              Labels: Record, avro, registry, schema
>
> The various record reader and writer controllers XML, CSV, JSON and AVRO, etc 
> can load schemas from a registry service.  The AvroSchemaRegistry can only 
> load its schema from a text property.  It would be useful to have a file 
> based Avro schema registry, with a configurable refresh interval to allow for 
> adding, removing or updates to schema files.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to