The difference between PostHTTP and GetHTTP wrt headers

Can someone explain or confirm why GetHTTP uses Dynamic Properties for setting custom headers in http requests but PostHTTP uses a Property with a Regex to pull flow file attributes? Is it due to the forbidden input? Thanks ottO

Re: The difference between PostHTTP and GetHTTP wrt headers

98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 On Mar 15, 2018, at 12:47 PM, Otto Fowler wrote: Can someone explain or confirm why GetHTTP uses Dynamic Properties for setting custom headers in http requests but PostHTTP uses a Property with a Regex to pull flow file attributes? Is it due to the

Re: The difference between PostHTTP and GetHTTP wrt headers

So looking at it, the standard way would be dynamic properties. Thank you Andy. On March 15, 2018 at 22:30:33, Otto Fowler (ottobackwa...@gmail.com) wrote: I’m actually looking at doing a web service processor , that would support setting custom headers, and I want it to be “standard”. I’ll

Re: The difference between PostHTTP and GetHTTP wrt headers

Along with user defined…. On March 15, 2018 at 22:40:33, Otto Fowler (ottobackwa...@gmail.com) wrote: So looking at it, the standard way would be dynamic properties. Thank you Andy. On March 15, 2018 at 22:30:33, Otto Fowler (ottobackwa...@gmail.com) wrote: I’m actually looking at doing a

AWS Processors and Proxy User/Password

Does anyone know why the AWS Processors support proxy host and port but not user and password as InvokeHttp does? ottO

Re: AWS Processors and Proxy User/Password

service -Charlie ᐧ Charlie Meyer On Fri, Mar 16, 2018 at 1:25 PM, Otto Fowler wrote: > Does anyone know why the AWS Processors support proxy host and port but not > user and password as InvokeHttp does? > > ottO >

Re: Will you accept contributions in Scala?

Sorry for the late response, but the point about the Extension Repo making this a moot point is an important one. The idea that you need to get your processor into the main codebase to have it be known and useful is something that is easier to overcome than a language war. On February 13, 2018 at

Re: Custom NAR Class Loader Issue

This is also a problem for new AWS processors, say if you use a newer aws java sdk core in a dependency but also have to depend on the nifi-aws-nar. On March 2, 2018 at 13:40:21, Bryan Bende (bbe...@gmail.com) wrote: Doug, I think the only solution is what you proposed about fixing the nifi-gcp

Re: Custom NAR Class Loader Issue

/jira/browse/NIFI-4936 On Fri, Mar 16, 2018 at 3:49 PM, Otto Fowler wrote: > This is also a problem for new AWS processors, say if you use a newer aws > java sdk core in a dependency but also have to depend on the nifi-aws-nar. > > > On March 2, 2018 at 13:40:21, Bryan Bende (bbe...@g

Re: FlattenJson

Why not create a new processor that does routeOnJSONPath and works on the flow file? On March 20, 2018 at 10:39:37, Jorge Machado (jom...@me.com) wrote: So that is what we actually are doing EvaluateJsonPath the problem with that is, that is hard to build something generic if we need to specify

Re: FlattenJson

stricted to that > processor alone. > > On Tue, Mar 20, 2018 at 8:37 PM, Otto Fowler > wrote: > >> Why not create a new processor that does routeOnJSONPath and works on the >> flow file? >> >> >> On March 20, 2018 at 10:39:37, Jorge Machado (jom...@me.com) wrote:

Master failing in travis

Anyone have an idea why Master is failing in travis?

Re: ListSFTP incoming relationship

What if the changes where ‘on top of’ some base set of properties, like directory? Like a filter, where if present from the incoming file will have the LIST* list only things that match a name or attribute? On March 27, 2018 at 00:08:41, Joe Witt (joe.w...@gmail.com) wrote: Scott This idea has

Re: Class Loading Conflicts - Different JAR Versions

You can look at the aws nar for a sample of what I think Brian means. On March 27, 2018 at 07:31:54, Mike Thomsen (mikerthom...@gmail.com) wrote: Brian, So... nifi-foo-service-impl-nar + nifi-foo-processors-nar ---depend on---> nifi-foo-service-api-nar ---depends on---> nifi-standard-services

Rat errors building with mvn clean install -Pcontrib-check

I have a branch on my work where I have been doing processor work. I ran mvn clean install -Pcontrib-check and now I’m getting rat errors for nifi-commons, which I didn’t change at all. As anyone see this? * Summary --- Generated at: 2018-03

Re: Rat errors building with mvn clean install -Pcontrib-check

wrong. Just a by-product of doing dev work and you just need to remove the offending files. Joe On Tue, Mar 27, 2018 at 11:02 AM, Otto Fowler wrote: > I have a branch on my work where I have been doing processor work. > I ran mvn clean install -Pcontrib-check > and now I’m getting ra

Re: ForkJoinPool.commonPool() in Nifi

I would think NiFi should have it’s own thread pool. On March 28, 2018 at 09:29:31, Oleksi Derkatch (oderka...@vitalimages.com) wrote: Anyone have any thoughts on this? Should I make a JIRA ticket? From: Oleksi Derkatch Sent: Thursday, March 8, 2018 4:36:51 PM

Re: [RESULT][VOTE] Release Apache NiFi 1.6.0

Congratulations! On April 6, 2018 at 19:51:10, Joe Witt (joe.w...@gmail.com) wrote: Apache NiFi Community, I am pleased to announce that the 1.6.0 release of Apache NiFi passes with 12 +1 (binding) votes 4 +1 (non-binding) votes 0 0 votes 0 -1 votes Thanks to all who helped make this release p

Re: Signing AWS Elasticsearch Requests?

The aws java sdk has a purpose built ElasticSearchClient class. The way to do this and be consistent would be to add a new nifi-aws processor for the ES client, as there is for s3 and dynamoDB etc. https://github.com/apache/nifi/pull/2588 is my outstanding PR for HttpInvoke for AWS Gateway Web API

Re: Signing AWS Elasticsearch Requests?

Sorry, just like the gateway api class, it is for managing ES not calling. On April 9, 2018 at 20:29:33, Otto Fowler (ottobackwa...@gmail.com) wrote: The aws java sdk has a purpose built ElasticSearchClient class. The way to do this and be consistent would be to add a new nifi-aws processor for

java-grok activity

I have been in contact with the maintainer of java-grok about the status of the project and I am happy to say that there has been activity today , as well as some steps to move it forward and pull some forks back in. https://groups.google.com/fo

Re: Custom Controller Service

Can services work with other controller services? Maybe a PropertiesControllerService, FilePropertiesControllerService could work with your service? the PCS could fire events on property changes etc. On April 25, 2018 at 08:05:27, Mike Thomsen (mikerthom...@gmail.com) wrote: Shot in the dark he

Re: Custom Controller Service

Or you could just call every time you needed properties more likely. This would still be custom unless integrated…. On April 25, 2018 at 08:26:57, Otto Fowler (ottobackwa...@gmail.com) wrote: Can services work with other controller services? Maybe a PropertiesControllerService

Re: Custom Controller Service

both, and then modify all DB processors to have logic to determine which service to use. On Wed, Apr 25, 2018 at 8:28 AM Otto Fowler wrote: > Or you could just call every time you needed properties more likely. > This would still be custom unless integrated…. > > > On April 25, 2

Re: [DISCUSS] Support for accessing sensitive values safely

"It would provide a list of variables that are readable to the current user and one can be selected, just like allowable values or controller services.” A person may have rights to configure nifi without knowing the “value” of the secure db password ( for example ), but that doesn’t mean they don’

Re: JSON Path Expression

The reason why your path is failing is because of the embedded quotes. If you remove the quotes it will work. I wrote this test: @Test public void testIssue() throws Exception{ String jsonPathAttrKey = "JsonPath1"; final TestRunner testRunner = TestRunners.newTestRunner(new EvaluateJsonPa

Re: JSON Path Expression

For the record, I am not saying that the json path library version nifi uses isn’t broken because this doesn’t work. On April 27, 2018 at 16:30:57, Otto Fowler (ottobackwa...@gmail.com) wrote: The reason why your path is failing is because of the embedded quotes. If you remove the quotes it

Re: JSON Path Expression

I am still getting [] output. I am I missing something? On Fri, Apr 27, 2018 at 4:32 PM, Otto Fowler wrote: > For the record, I am not saying that the json path library version nifi > uses isn’t broken because this doesn’t work. > > > > On April 27, 2018 at 16:30:57, Otto Fow

RAT errors after pull of master

Anyone else seeing: [WARNING] Files with unapproved licenses: /Users/ottofowler/src/apache/forks/nifi/nifi-nar-bundles/nifi-standard-services/nifi-mongodb-client-service-api/target/maven-status/maven-compiler-plugin/compile/default-compile/inputFiles.lst /Users/ottofowler/src/apache/forks/nifi/n

Re: RAT errors after pull of master

checks” in th dev threads. You’ll find it. > > - > Sivaprasanna > > On Mon, 30 Apr 2018 at 7:10 PM, Otto Fowler wrote: > >> Anyone else seeing: >> >> [WARNING] Files with unapproved licenses: >> >> >> /Users/ottofowler/src/apache/forks/nifi/

Grok Reader, Extract and the default patterns

I’m working on upgrading java-grok to the new 0.1.9 release. While going through the GrokReader the the ExtractGrok components I noticed that they differ in a very important way grok wise. The reader loads the default patterns ( which are a copy of the ubiquitous default patterns in java-grok itse

Re: Grok Reader, Extract and the default patterns

think ExtractGrok is useful and want to improve it as you suggest I think you're good to go provided you do so in a way that doesn't break existing flows (change their behavior unless they opt in so to speak). Is that feasible for your idea? Thanks On Tue, May 8, 2018 at 9:11 PM, Otto Fowle

Re: Grok Reader, Extract and the default patterns

metron. There is something that feels wrong about possible duplication between the reader serialization service nar and standard processors ( GrokExpressionValidator for example ) but that is another kettle of fish. On May 8, 2018 at 21:33:59, Otto Fowler (ottobackwa...@gmail.com) wrote: I think

Re: Grok Reader, Extract and the default patterns

current pr’s about empty capture returns and multiple pattern files. I would guess that the outstanding Jira’s would also be evaluated before depreciation. On May 8, 2018 at 21:37:41, Otto Fowler (ottobackwa...@gmail.com) wrote: I would add a test for putting in the defaults as a file when they

Re: ASF -> GitHub sync

There can be issues with the integration. You may want to open an INFRA ticket on it. We have had to do that in the past with Metron. On May 11, 2018 at 09:01:24, Mike Thomsen (mikerthom...@gmail.com) wrote: No, it was probably 5k-10kb of updates. On Fri, May 11, 2018 at 8:59 AM Marc Parisi w

Re: Graph database support w/ NiFi

+1 for the wiki page On May 12, 2018 at 10:52:43, Matt Burgess (mattyb...@apache.org) wrote: All, As Joe implied, I'm very happy that we are discussing graph tech in relation to NiFi! NiFi and Graph theory/tech/analytics are passions of mine. Mike, the examples you list are great, I would add T

Re: Graph database support w/ NiFi

The wiki discussion should list these and other points of concern and should document the extent to which they are to be addressed. On May 12, 2018 at 12:37:59, u...@moosheimer.com (u...@moosheimer.com) wrote: Matt, You have some interesting ideas that I really like. GraphReaders and GraphWrite

Re: Proposal: standard record metadata attributes for data sources

I commented on the PR, but I’ll add this to the thread here. Wouldn’t something like this lend itself to a ReportingTask? If not the current structure, a like structure for records? That would allow the destination to do time series analysis etc. That is not saying there isn’t a case to have it

rat failures afte taking master?

[WARNING] Files with unapproved licenses: /home/travis/build/ottobackwards/nifi/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/test/resources/ExecuteCommand/1mb.txt Anyone know what this is?

Re: rat failures afte taking master?

Yeah, I was just lucky when I did my fetch. Thanks Mike. On May 31, 2018 at 09:49:05, Mike Thomsen (mikerthom...@gmail.com) wrote: Should be resolved now. It got added to the exclude list for standard-processors. On Thu, May 31, 2018 at 8:56 AM Otto Fowler wrote: > [WARNING] Files w

Re: ConvertAvroToJSON: RE: NIFI-5093

Another option would be to not output anything if there are no records, like the elasticsearch http query processor. Then if there ever *is* any output, it is always consistent. On June 2, 2018 at 08:09:44, Mark Payne (marka...@hotmail.com) wrote: Matthew, Have you tried looking at the ConvertR

Re: NIFI URL

Do you already have something running that is listening on 8080? On June 3, 2018 at 13:44:09, Dev Lamani (ddlaman...@gmail.com) wrote: Dear Team, I need urgent help on Apache NIFI. 1. I could able to install NIFI-1.3.0 2. Started the NIFI services 3. Tried Invoking NIFI UI : localhost:8080

Re: Travis is broken?

No caches. On June 4, 2018 at 16:37:42, Otto Fowler (ottobackwa...@gmail.com) wrote: I just built one of my branches in my personal travis, and all 3 jobs completed. On June 4, 2018 at 15:39:48, Mike Thomsen (mikerthom...@gmail.com) wrote: It says it cannot find repo apache/nifi. Anyone know

Re: Travis is broken?

I just built one of my branches in my personal travis, and all 3 jobs completed. On June 4, 2018 at 15:39:48, Mike Thomsen (mikerthom...@gmail.com) wrote: It says it cannot find repo apache/nifi. Anyone know what's happening?

Re: [ANNOUNCE] New Apache NiFi Committer Sivaprasanna Sethuraman

Congratulations! On June 5, 2018 at 10:09:28, Tony Kurc (tk...@apache.org) wrote: On behalf of the Apache NiFI PMC, I am very pleased to announce that Sivaprasanna has accepted the PMC's invitation to become a committer on the Apache NiFi project. We greatly appreciate all of Sivaprasanna's hard

Re: [ANNOUNCE] New NiFi PMC member Mike Thomsen

Congratulations! On June 6, 2018 at 18:22:32, Tony Kurc (tk...@apache.org) wrote: NiFi community, On behalf of the Apache NiFi PMC, I am pleased to announce that Mike Thomsen has accepted the PMC's invitation to join the Apache NiFi PMC. We greatly appreciate all of Mike's hard work and generous

Re: Java 10

You can track progress here: https://issues.apache.org/jira/browse/NIFI-5174 There has been some progress very recently. On June 7, 2018 at 09:40:50, Sivaprasanna (sivaprasanna...@gmail.com) wrote: Nope. Not yet. AFAIK, there is a Jira to support Java 9. On Thu, Jun 7, 2018 at 7:09 PM, kirilzi

Re: [DISCUSS] Change of Cluster Flow Inheritance

Great write up. While I am not an expert on clustering, it would seem that having one method of comparing flows, perhaps with different strategies within that would be more maintainable as well. Are you proposing that there is a unified flow comparison capability/implementation/service that is sh

Re: [DISCUSS] Release candidate timeframe for Apache NiFi 1.7.0

59 MongoDBLookupService should be able to determine a schema or have one provided — Mike Thomsen * NIFI-5054 NiFi Couchbase Processors do not support User Authentication — Koji Kawamura * NIFI-5022 Create an AWS Gateway Web API version of InvokeHTTP — Otto Fowler * NIFI-4930 Nar-Dependency-

Re: Unable to bring up NiFi user interface

Running with Java 9 is not supported with 1.6.0 I believe. On June 15, 2018 at 06:32:27, Dave (dave7sw...@gmail.com) wrote: Hi, I am not sure if I can post my query here. If I am not supposed to, my apologies. Please let me know if I can start a different thread. I am also facing a similar si

Re: Transition Mongo processors to use a controller service

Wouldn’t it be like the proxy configuration and the aws configuration stuff ( optional )? Is there any kind of ‘property’ depreciation plan? If you say make it optional for a little while, that doesn’t mitigate issues in the future when it is *not* optional. On June 15, 2018 at 08:12:05, Mike Th

Re: Apache NiFi 1.7.0 RC1 Release Helper Guide

I am working on a script to automate a bunch of this. I just created a work in progress PR if you would like to check it out. https://github.com/apache/nifi/pull/2806 Checking the commit is next thing on my list to automate. On June 20, 2018 at 10:52:23, Bryan Bende (bbe...@gmail.com) wrote:

Re: [VOTE] Release Apache NiFi 1.7.0

+1 builds, tests, contrib checksum, signing tag checkout by commit and diff On June 20, 2018 at 03:16:47, Andy LoPresto (alopre...@apache.org) wrote: Hello, I am pleased to be calling this vote for the source release of Apache NiFi nifi-1.7.0. The source zip, including signatures, digests, et

Re: Apache NiFi 1.7.0 RC1 Release Helper Guide

with the link having a trailing / which I have removed. https://gist.github.com/ottobackwards/caeb6c9f25b55188e20b3c19b1d4b948 On June 20, 2018 at 15:03:15, Otto Fowler (ottobackwa...@gmail.com) wrote: I am working on a script to automate a bunch of this. I just created a work in progress PR if you

[PROPOSAL] Reference Utility Script to help automate some of RC validation in Release Process

I would like to propose the the Release Process , specifically the section: *RM sends the following helper email to the NiFi Developers Mailing List* be changed to include a link to, as well as a description of valid use of the script referenced in PR 28

Re: [DISCUSS] Tar + Gzip vs. Zip

I end up using zip all the time. zip +1 On June 26, 2018 at 13:30:33, Tony Kurc (tk...@apache.org) wrote: My preference is zip. On Tue, Jun 26, 2018, 9:21 AM Josh Elser wrote: > > > On 6/25/18 11:34 PM, Andy LoPresto wrote: > > Hi folks, > > > > I do not want to start a long-running argument

Re: [ANNOUNCE] Apache NiFi 1.7.0 release

Congratulations everyone! On June 26, 2018 at 20:56:19, Andy LoPresto (alopre...@apache.org) wrote: Hello The Apache NiFi team would like to announce the release of Apache NiFi 1.7.0. Apache NiFi is an easy to use, powerful, and reliable system to process and distribute data. Apache NiFi was

Re: #JIRA NIFI-5327 #PR 2820

Do we have any kind of guide or blog to refer to for this? On July 3, 2018 at 08:21:39, Mike Thomsen (mikerthom...@gmail.com) wrote: Prashanth, Knowing nothing about the problem domain, I would recommend that you set up things like Docker Compose files and sample flows that can be used to help

Re: Cannot add a new nifi module due to maven-compiler-plugin:3.6.0:testCompile (groovy-tests) failure

mvn clean install Worked for me off of your current master. [INFO] nifi-assembly .. SUCCESS [01:53 min] [INFO] nifi-testharness ... SUCCESS [ 8.170 s] On July 6, 2018 at 08:42:03, Horváth Péter Gergely ( horvath.peter.gerg..

Re: Cannot add a new nifi module due to maven-compiler-plugin:3.6.0:testCompile (groovy-tests) failure

Running `mvn clean install from inside the nifi-testharness worked as well On July 6, 2018 at 11:37:46, Otto Fowler (ottobackwa...@gmail.com) wrote: mvn clean install Worked for me off of your current master. [INFO] nifi-assembly .. SUCCESS [01:53 min

Re: Apache NiFi 1.7.1 RC1 Release Helper Guide

Since there is an active RC and that is the only time it can be tested, I’d like to point out or ask if anyone feels generous they can try https://github.com/apache/nifi/pull/2806 to make sure it works as well as automate some of the below. On July 12, 2018 at 17:01:10, Andy LoPresto (alopre...@a

Re: [VOTE] Release Apache NiFi 1.7.1

+1 validated using rc-check script ( signed, hashed, commit matches, builds per guide, runs ) Ran manual, validate help and version in about. On July 14, 2018 at 09:21:57, Pierre Villard (pierre.villard...@gmail.com) wrote: +1, binding Ran through release helper guide and confirmed fixes for w

Re: [ANNOUNCE] New NiFi PMC member Kevin Doran

Congratulations! On July 31, 2018 at 08:26:34, Tony Kurc (tk...@apache.org) wrote: NiFi Community, On behalf of the Apache NiFi PMC, I am pleased to announce that Kevin Doran has accepted the PMC's invitation to join the Apache NiFi PMC. In addition to being a regular code contributor to the p

Re: [ANNOUNCE] New NiFi PMC member Jeremy Dyer

Congratulations! On July 31, 2018 at 08:36:48, Tony Kurc (tk...@apache.org) wrote: All, On behalf of the Apache NiFi PMC, I am pleased to announce that Jeremy Dyer has accepted the PMC's invitation to join the Apache NiFi PMC. Jeremy has been a long-time contributor to the project - across man

Stability of the Record API

I’m seeing https://github.com/apache/nifi/blob/master/nifi-commons/nifi-record/src/main/java/org/apache/nifi/serialization/RecordReader.java#L34 being quoted as a reason to NOT build Record based processors but instead stick with the original Processor api. Yet, on list and on hipchat and in pr’s

Re: [PROPOSAL] Reference Utility Script to help automate some of RC validation in Release Process

Just re-upping this for next release. On June 26, 2018 at 13:21:40, Otto Fowler (ottobackwa...@gmail.com) wrote: I would like to propose the the Release Process <http://nifi.apache.org/release-guide.html>, specifically the section: *RM sends the following helper email to the NiFi Deve

Re: [PROPOSAL] Reference Utility Script to help automate some of RC validation in Release Process

ll want to be really explicit about what its usage covers precisely and in what environments it is tested and maintained. Thanks joe On Mon, Aug 13, 2018 at 9:57 AM Otto Fowler wrote: > > Just re-upping this for next release. > > > On June 26, 2018 at 13:21:40, Otto Fowler (ottoback

Re: [DISCUSS] Stale PRs

In Metron we just put something like this in place, but not using a bot. We limit it to PR’s where the contributor has gone inactive. https://cwiki.apache.org/confluence/display/METRON/Development+Guidelines 2.6.1 Inactive Pull Requests Contributions can often take a significant amount of time to

Re: [DISCUSS] Stale PRs

Infra for this is great. What would be the best way forward on this subject? Andy, do you still have concerns and/or comments based on the feedback? Should it go through a formal VOTE thread? Happy to take care of it if there is a consensus. Thanks, Pierre Le dim. 16 sept. 2018 à 15:38, Otto Fowl

Re: Apache NiFi 1.8.0 RC1 Release Helper Guide

I don’t see a tag for nifi-1.8.0-RC1 On October 18, 2018 at 00:01:06, Jeff (jsto...@apache.org) wrote: Hello Apache NiFi community, Please find the associated guidance to help those interested in validating/verifying the release so they can vote. # Download latest KEYS file: https://dist.apach

Re: [VOTE] Release Apache NiFi 1.8.0

+1 Confirmed signatures Confirmed hashes Confirmed source matches commit src ran build withe check ran nifi with a template from a bug to verify fix On October 18, 2018 at 09:45:12, Joe Witt (joe.w...@gmail.com) wrote: +1 (binding) Confirmed sigs, hashes, source L&N, and specified commit pre

Re: [VOTE] Release Apache NiFi 1.8.0 (RC2)

+1 Confirmed signatures Confirmed hashes Confirmed source matches commit src ran build withe check On October 20, 2018 at 23:11:29, Jeff (jsto...@apache.org) wrote: Hello, I am pleased to be calling this vote for the source release of Apache NiFi nifi-1.8.0. The source zip, including signatur

Re: [VOTE] Release Apache NiFi 1.8.0 (RC3)

+1 Confirmed signatures Confirmed hashes Confirmed source matches commit src ran build withe check On October 23, 2018 at 01:56:42, Jeff (jsto...@apache.org) wrote: Hello, I am pleased to be calling this vote for the source release of Apache NiFi nifi-1.8.0. The source zip, including signatu

Re: [ANNOUNCE] Apache NiFi 1.8.0 release

Congratulations everyone, great job! On October 27, 2018 at 21:50:54, Jeff (jsto...@apache.org) wrote: Hello The Apache NiFi team would like to announce the release of Apache NiFi 1.8.0. Apache NiFi is an easy to use, powerful, and reliable system to process and distribute data. Apache NiFi wa

Re: Hi

https://community.hortonworks.com/articles/58493/parsing-evtx-files-with-apache-nifi.html On October 29, 2018 at 23:17:27, find (907611...@qq.com) wrote: Hi, Sorry to disturb you.I want to parse a .evtx(a window event log file) file using nifi(https://github.com/apache/nifi),but I just don't kno

Re: Custom processors/controller services without Maven

I would recommend ( if you want to do this ) looking at the source code for the nar maven plugin, since you will have to re-implement it some how. On November 15, 2018 at 18:19:36, Milan Das (m...@interset.com) wrote: Trust me, you are bringing trouble. I am not sure if there is any user have d

Re: Think I hit a regression in the record api

Is there a unit test for that? On December 10, 2018 at 12:05:22, Mike Thomsen (mikerthom...@gmail.com) wrote: Schema: { "type": "record", "name": "TSTest", "fields": [ { "name": "uuid", "type":"string" }, { "name": "ts", "type": { "type": "long", "logicalType": "timestamp-millis" }} ] } Exampl

Re: [ANNOUNCE] New Apache NiFi Committer Ed Berezitsky

Congratulations Ed! On January 2, 2019 at 21:36:45, Tony Kurc (tk...@apache.org) wrote: On behalf of the Apache NiFI PMC, I am very pleased to announce that Ed has accepted the PMC's invitation to become a committer on the Apache NiFi project. We greatly appreciate all of Ed's hard work and gene

Re: [ANNOUNCE] New Apache NiFi Committer Nathan Gough

Congratulations Nathan! On January 2, 2019 at 21:30:42, Tony Kurc (tk...@apache.org) wrote: On behalf of the Apache NiFI PMC, I am very pleased to announce that Nathan has accepted the PMC's invitation to become a committer on the Apache NiFi project. We greatly appreciate all of Nathan's hard w

Re: Proposing NiFi-Fn

This is really cool. Is there a design document to reference? Any diagrams? I don’t remember clearly if Nifi requires or prefers javadoc or not, but it would help to have those things I think. On January 2, 2019 at 20:42:02, Samuel Hjelmfelt ( samhjelmf...@yahoo.com.invalid) wrote: Hi Andy,I

Re: [draft board report] NiFi Board Report - January 2019

Nice! Well done guys On January 8, 2019 at 16:25:57, Joe Witt (joe.w...@gmail.com) wrote: Team, It is again that time to submit our board report. Here is what I plan to send but please take a look at share any important omissions or issues. Great work all! ## Description: - Apache NiFi is an

[DISCUSS] Nifi Archetypes “refresh”

I would like to have a discussion around the archetypes. Right now Nifi has two archetypes : A controller service and a processor. Both are simple, and don’t reference anything outside of them. I have a few topics for comment here: 1. Are there things about the current archetypes that could be

Re: [DISCUSS] Nifi Archetypes “refresh”

So I’ll kick it off with a small one: - All archetypes should have a dummy additional details documentation entry to show how that is done. On January 11, 2019 at 09:25:13, Otto Fowler (ottobackwa...@gmail.com) wrote: I would like to have a discussion around the archetypes. Right now Nifi

Re: Lowering the barrier of entry

I think this ties into my other discuss thread on refreshing the archetypes On January 25, 2019 at 11:50:10, Andrew Grande (apere...@gmail.com) wrote: I consistently see my users struggling when they move up the nifi food chain and start looking at custom processors. The good content about proto

Re: Lowering the barrier of entry

come back >>>>> to this and refresh my brain synapses. If we could make these not require >>>>> any of that and make simple thinga dead simple >>>>> >>>>> Andrew >>>>> >>>>> On Fri, Jan 25, 2019, 9:47 AM

Re: JIRA Ticket Help Needed

You can only be assigned tickets in jira if you are give a `contributor` role for that project in jira. This must be done by a PMC member for that project. On January 30, 2019 at 16:59:17, Alex Aversa (alexeave...@gmail.com) wrote: Hello, I had created a ticket in JIRA and it appears I am unab

Re: [VOTE] Release Apache NiFi 1.9.0 (rc1)

+1 X gpg --verify nifi-1.9.0-source-release.zip.asc X shasum -a 256 nifi-1.9.0-source-release.zip X shasum -a 512 nifi-1.9.0-source-release.zip X mvn clean install -Pcontrib-check,include-grpc X Verify the git commit ID is correct X Verify the RC was branched off the correct git commit ID X Verify

Re: [VOTE] Release Apache NiFi 1.9.0 (rc2)

+1 (non-binding) - Verified signature - Verified hashes - Verified the build and tests were successful - Verified Git commit ID - Binary starts as expected On February 16, 2019 at 22:50:46, Joe Witt (joew...@apache.org) wrote: +1 (non-binding) - Verified signature - Verified hashes - Verified

Re: [RESULT][VOTE] Release Apache NiFi 1.9.0

Great job! On February 19, 2019 at 23:13:53, Joe Witt (joe.w...@gmail.com) wrote: Apache NiFi Community, I am pleased to announce that the 1.9.0 release of Apache NiFi passes with 15 +1 (binding) votes 6 +1 (non-binding) votes 0 0 votes 0 -1 votes Thanks to all who helped make this release pos

Re: [DISCUSS] Deprecate processors who have Record oriented counterpart?

It is probably worth thinking about getting *new* processors as record processors, as in having a developer focus as well. If we can think about what we can do to make that better ( we started a discussion on record / service use in the archetype ) that would be worth it. We can definitely make i

Re: SplitRecord behaviour

Bryan, So the best practice when segmenting is to - build your segments as a list while processing the incoming stream - then after send them all to the relationship right? On March 1, 2019 at 09:21:46, Bryan Bende (bbe...@gmail.com) wrote: Hello, Flow files are not transferred until the sess

Re: [VOTE] Release Apache NiFi 1.9.1 (rc1)

+1 verified the checksums, signing, commit etc. Build and run, validated a simple flow. Checked the LICENCE, NOTICE and README. One small nit on the readme is that it still refers to Hipchat, and maybe should not anymore since that is gone. On March 13, 2019 at 01:49:14, Joe Witt (joew...@apache

Re: Issue with json.decode in jython 2.7.1

Can you create a jira? On March 13, 2019 at 09:47:26, Kevin Hill (ke...@hyas.com) wrote: Hi, I was wondering if it would be possible to upgrade the jython bundled with nifi 1.9.0, which currently stands at 2.7.1. It appears there is a very obscure bug related to multi-threading and json.decode t

Re: Docker build broken for me in 1.9.1RC2

You mean RC1? I’ll try to reproduce On March 14, 2019 at 09:18:49, Mike Thomsen (mikerthom...@gmail.com) wrote: mvn clean install -Pdocker Throws the following error: [WARNING] An attempt failed, will retry 1 more times org.apache.maven.plugin.MojoExecutionException: Could not build image at c

Re: Docker build broken for me in 1.9.1RC2

[ERROR] Failed to execute goal com.spotify:dockerfile-maven-plugin:1.3.5:build (default) on project nifi-toolkit-assembly: Could not build image: com.spotify.docker.client.shaded.com.fasterxml.jackson.databind.JsonMappingException: Can not construct instance of com.spotify.docker.client.messages.Re

Re: Docker build broken for me in 1.9.1RC2

I got the same error after resume On March 14, 2019 at 10:42:05, Otto Fowler (ottobackwa...@gmail.com) wrote: [ERROR] Failed to execute goal com.spotify:dockerfile-maven-plugin:1.3.5:build (default) on project nifi-toolkit-assembly: Could not build image

Re: Docker build broken for me in 1.9.1RC2

https://github.com/spotify/docker-maven-plugin/issues/350 maybe? I will try logging into docker hub and see On March 14, 2019 at 10:43:22, Otto Fowler (ottobackwa...@gmail.com) wrote: I got the same error after resume On March 14, 2019 at 10:42:05, Otto Fowler (ottobackwa...@gmail.com

Re: Docker build broken for me in 1.9.1RC2

Logging into docker hub got me past that issue On March 14, 2019 at 10:46:00, Otto Fowler (ottobackwa...@gmail.com) wrote: https://github.com/spotify/docker-maven-plugin/issues/350 maybe? I will try logging into docker hub and see On March 14, 2019 at 10:43:22, Otto Fowler (ottobackwa

Re: Docker build broken for me in 1.9.1RC2

Maybe we should update to the latest dockerfile-maven-plugin On March 14, 2019 at 10:49:39, Otto Fowler (ottobackwa...@gmail.com) wrote: Logging into docker hub got me past that issue On March 14, 2019 at 10:46:00, Otto Fowler (ottobackwa...@gmail.com) wrote: https://github.com/spotify

Re: How to decrypt one field in a Json and return the original JSON with that field decrypted

DecryptRecord ( with record path setting ) sounds like it could be something that could do this if it existed. On April 16, 2019 at 08:49:41, Peter Turcsanyi ( turcsa...@cloudera.com.invalid) wrote: Hi JP, If I understand correctly, your scenario would be: 1. extract the encrypted data item fro

  1   2   3   >