Re: Kafka on Windows

2018-09-05 Thread jan
@M.Manna - thanks for your reply. I did read that document but clearly didn't digest that bit properly. @Liam Clarke I don't expect code's users (either maintainers or end-users) to need to deduce *anything*. If it needs knowing, I documented it. I'll send you an actual example so you know it's n

Re: Kafka on Windows

2018-09-05 Thread Liam Clarke
Hi Jan, .sh is not .bat and easily googleable. Nothing is terrifying about updating the documentation, I just took umbrage at you "resenting" your 3 days you expended on learning the hard way that Windows is the minority market share in servers - you're resenting a free open source project? Becau

Re: Kafka on Windows

2018-09-05 Thread M. Manna
I believe this needs to be articulated a bit more, which is not a big issue. The common practice for a large-scale distributed system is to use Linux servers, and it's always been a popular choice. That doesn't mean the Windows is ignored. The issue at hand is that file deletion/renaming seems to h

Re: Kafka on Windows

2018-09-05 Thread jan
Hi Liam, as a DB guy that does MSSQL (on windows, obviously) I literally have no idea what a .sh file is,or what that would imply. I guess it's bash so yeah. But what's so terrifying about actually stating in the FAQ that you should not run it as production on windows? Why should I conclude that k

Re: Kafka on Windows

2018-09-04 Thread Liam Clarke
Hi Jan, I'd presume that downloading an archive and seeing a bunch of .sh files would imply that Kafka wasn't built to run on Windows. Given that it's a cluster based technology, I'd assume that it wouldn't be supported for Windows given that most server based stuff isn't unless Microsoft built i

Re: Kafka on Windows

2018-09-04 Thread Koushik Chitta
s? Can you share the link? Thanks, Koushik From: M. Manna Sent: Wednesday, August 8, 2018 4:49 AM To: Kafka Users Subject: Re: Kafka on Windows Using docker is probably the best option. The one thing I cannot confirm (and I haven't tried yet) is how the vol

Re: Kafka on Windows

2018-08-08 Thread M. Manna
Using docker is probably the best option. The one thing I cannot confirm (and I haven't tried yet) is how the volumes will behave when you are transferring the topic log offsets to your windows drive. Hopefully, this will be fine but do let us know if someone has tried. Thanks, On 7 August 201

Re: Kafka on Windows

2018-08-07 Thread jan
@Jacob Sheck: It was 18 months ago so I don't recall but I was told clearly windows ain't supported when I reported problems. I don't know if my problems were down to my inexperience or my use of windows, but I basically assuming I was controlling for one variable (n00bish inexperience) but was in

Re: Kafka on Windows

2018-08-07 Thread M. Manna
By fully broken, i mean not designed and tested to work on Windows. On Tue, 7 Aug 2018, 16:34 M. Manna, wrote: > Log Cleaner functionality is fully broken... If you haven't tried that > already. > > > > On 7 Aug 2018 4:24 pm, "Jacob Sheck" wrote: > > While I agree that it is less frustrating to

Re: Kafka on Windows

2018-08-07 Thread M. Manna
Log Cleaner functionality is fully broken... If you haven't tried that already. On 7 Aug 2018 4:24 pm, "Jacob Sheck" wrote: While I agree that it is less frustrating to run Kafka on Linux, I am interested to hear what specific issues you are running into on windows? On Tue, Aug 7, 2018 at 9:

Re: Kafka on Windows

2018-08-07 Thread Jacob Sheck
While I agree that it is less frustrating to run Kafka on Linux, I am interested to hear what specific issues you are running into on windows? On Tue, Aug 7, 2018 at 9:42 AM jan wrote: > This is an excellent suggestion and I intend to do so henceforth > (thanks!), but it would be an adjunct to m

Re: Kafka on Windows

2018-08-07 Thread jan
This is an excellent suggestion and I intend to do so henceforth (thanks!), but it would be an adjunct to my request rather than the answer; it still needs to be made clear in the docs/faq that you *can't* use windows directly. jan On 07/08/2018, Rahul Singh wrote: > I would recommend using Dock

Re: Kafka on Windows

2018-08-07 Thread Rahul Singh
I would recommend using Docker — it would end up being run on a Linux kernel VM on windows and is easier to get started on with a bit of learning curve for Docker. Less time wasted overall and at least at that point you would know Docker. Rahul On Aug 7, 2018, 4:50 AM -0400, jan , wrote: > I tr

Re: Kafka on Windows

2018-08-07 Thread jan
I tried using it just for learning a while back and wasted 3 days because it's not supported on windows. Even basic stuff didn't work. I did read the docs first! I think I've seen other people on this list have questions about/problems for exactly the same reason, and that could be a lot of time s

Re: Kafka on Windows

2018-08-07 Thread M. Manna
The answer is - Absolutely not. If you don’t have Linux rack, or Kubernetes deployment -it will not work on Windows as guaranteed. I know this because I have tried to make it work for the past 1 year. File handling always fails and crashes the cluster on Windows. Thanks, On Tue, 7 Aug 2018 at

Re: Kafka on windows

2017-04-14 Thread Daniel Hinojosa
Kafka uses Linux OS page cache and flushing techniques as well as in-sync replicas to bring down latency since storing to the hard drive is likely the slowest part. It seems it would be defeating the point if you were to install it on Windows, just like everyone here mentioned. ;) Just wanted to

Re: Kafka on windows

2017-04-14 Thread David Garcia
If you want reduce maintenance headaches, I highly recommend not running brokers on windows (or in vm’s for that matter). It really isn’t supported. Kafka needs highly performant OS primitives. For example, XFS, and ext4 are recommended filesystems for reasons specific to Kafka. If this is j

Re: Kafka on windows

2017-04-11 Thread David Luu
I'm curious as well. That doc blurb doesn't give specifics. How is kafka run (or tested) on Windows? Natively via the command line shell, etc. or via cygwin, within a *nix VM on Windows, or via Windows 10's Ubuntu Linux Bash shell? Would be interesting to see how each method I listed performs, mayb

Re: Kafka on windows

2017-04-11 Thread David Garcia
One issue is that Kafka leverage some very specific features of the linux kernel that are probably far different from Windows, so I imagine the performance profile is likewise much different. On 4/11/17, 8:52 AM, "Tomasz Rojek" wrote: Hi All, We want to choose provider of messagin