[
https://issues.apache.org/jira/browse/NIFI-10428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17603636#comment-17603636
]
John Wise commented on NIFI-10428:
----------------------------------
We're currently using an old HWX Schema Registry server to allow for
near-real-time schema creation & updates. Unfortunately, since that's been
subsumed into Cloudera HDF, there haven't been any updates in a couple of years
& the security model (KRB-only) is severely lacking.
NiFi absolutely *needs* some type of real-time schema management, in order to
prevent having to stop & start an AvroSchemaRegistry (ASR) controller service &
all of its dependent controller services and processors every time a schema
addition/update is required. That's not ideal in a production environment,
where downtime is critical.
We already have a reusable flow in our NiFi Registry for downloading artifacts
from multiple external URLs & placing them on NiFi nodes for use by
controllers, so file-based schemas would be more ideal than ASR.
However, I'd still prefer a web-based GUI similar to HWX (except with inline
schema validation & highlighting) to create & maintain schemas. Either would
be preferable to ASR, really.
> Allow for loading Avro record schema from files
> -----------------------------------------------
>
> Key: NIFI-10428
> URL: https://issues.apache.org/jira/browse/NIFI-10428
> Project: Apache NiFi
> Issue Type: New Feature
> Components: Core Framework
> Affects Versions: 1.18.0
> Reporter: Daniel Stieglitz
> Assignee: Daniel Stieglitz
> Priority: Major
> Labels: Record, avro, registry, schema
>
> The various record reader and writer controllers XML, CSV, JSON and AVRO, etc
> can load schemas from a registry service. The AvroSchemaRegistry can only
> load its schema from a text property. It would be useful to have a file
> based Avro schema registry, with a configurable refresh interval to allow for
> adding, removing or updates to schema files.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)