Re: [go-nuts] Re: Go implementation of CLP

2022-11-19 Thread Jason E. Aten
on the off-chance that ISO8601 timestamp parsing is new (unlikely since you're dealing with logs), I'll point out that parsing them is relatively easy in Go: import "time" const RFC3339NanoNumericTZ = "2006-01-02T15:04:05.9-07:00" tmstr := "2019-05-23T15:09:57.000-05:00" tm, err = time.Par

Re: [go-nuts] Re: Go implementation of CLP

2022-11-19 Thread Jason E. Aten
On Sat, Nov 19, 2022 at 8:45 AM david lion wrote: > ...could you let us know more about what kind of queries you want to run? > The open-source C++ code supports wildcard queries but some users prefer > grep-like regex, SQL-like boolean expressions, etc. We haven't yet settled > on one, especiall

Re: [go-nuts] Re: Go implementation of CLP

2022-11-19 Thread david lion
Ah, the parsing component doesn't include search, but it is a necessary part to enable searching compressed logs. CLP's searching of compressed logs is enabled by the storage format it uses (as it both compresses and indexes the logs). The parsing component is how we extract information from th

Re: [go-nuts] Re: Go implementation of CLP

2022-11-18 Thread Jason E. Aten
Sorry for not being familiar with the terminology. I thought the search through compressed logs was the most interesting part. Is that included in the "parsing component"? On Fri, Nov 18, 2022 at 1:21 PM david lion wrote: > At the moment we're working on a Go binding around the parsing component

Re: [go-nuts] Re: Go implementation of CLP

2022-11-18 Thread david lion
At the moment we're working on a Go binding around the parsing component of CLP. You're right, the current code is all C++, but we'll be moving the parsing component to be standalone and creating a C API for it. Right now, we're only creating bindings for the parsing component since it seems to

Re: [go-nuts] Re: Go implementation of CLP

2022-11-13 Thread Jason E. Aten
CLP looks impressive. Is there is a C API then it would probably be easy to write Go bindings to it. Since there is some kind of python integration, perhaps a C API is already there. I took a quick look but could only see C++ code; it would have to be an actual C (not C++) API for cgo to be u

Re: [go-nuts] Re: Go implementation of CLP

2022-11-09 Thread Bharghava Varun Ayada
I'm exploring CLP for a logging platform and I think either a cgo or native go library might be something that would help us. On Tuesday, 4 October 2022 at 22:03:34 UTC+5:30 david...@gmail.com wrote: > It would be awesome to help SeaweedFS, so I'm eager to hear more about > your ideas to try an

Re: [go-nuts] Re: Go implementation of CLP

2022-10-04 Thread david lion
It would be awesome to help SeaweedFS, so I'm eager to hear more about your ideas to try and understand anything we can do. Sorry if some of my questions are naive. At a high level I'm trying to better understand two topics: 1. the use cases (or features) we/CLP can help with 2. the technical as

Re: [go-nuts] Re: Go implementation of CLP

2022-10-02 Thread Chris Lu
Thanks! CLP is great! I am working on a distributed file system, SeaweedFS, https://github.com/seaweedfs/seaweedfs I am interested in a pure-go implementation to store the log files more efficiently. Chris On Sun, Oct 2, 2022 at 6:45 PM david lion wrote: > Hi Chris, > > I'm one of the CLP deve