Ugh, stupid me, I could see what was the problem from mentioned logged
lines.

One should escape the path if using \ char, since it interprets the \tmp as
tab followed by "mp" so using:
\\tmp\\kafka-logs work, and I guess that its normal behavior for
java.util.Properties.load() method.

-Vjeran

-----Original Message-----
From: Vjeran Marcinko [mailto:vjeran.marci...@email.t-com.hr] 
Sent: Saturday, January 25, 2014 6:10 PM
To: users@kafka.apache.org
Subject: RE: Using Kafka on Windows - file path problems

Even if in that one case the thing would work, it would be best if any
correct windows file path would work.

I checked again, and it behaves as I've written.

In case when one specifies /tmp/kafka-logs, it works, and during startup one
log line says:
[2014-01-25 18:04:08,335] INFO Property log.dirs is overridden to
/tmp/kafka-logs (kafka.utils.VerifiableProperties)
, but as I said during topic creation it fails.

But when I specify the path as \tmp\kafka-logs, then the startup fails, and
the same logged line says:
[2014-01-25 18:07:51,395] INFO Property log.dirs is overridden to
mpkafka-logs (kafka.utils.VerifiableProperties)
And it fails with mentioned:
java.io.IOException: The filename, directory name, or volume label syntax is
incorrect
        at java.io.WinNTFileSystem.canonicalize0(Native Method)
        at java.io.Win32FileSystem.canonicalize(Win32FileSystem.java:396)
        at java.io.File.getCanonicalPath(File.java:559)
        at
kafka.log.LogManager$$anonfun$createAndValidateLogDirs$1.apply(LogManager.sc
ala:70)
        at
kafka.log.LogManager$$anonfun$createAndValidateLogDirs$1.apply(LogManager.sc
ala:70)

The same startup failure occurs, when I specify full windows file path as
D:\tmp\kafka-logs, and then the logged line is:
[2014-01-25 18:08:44,377] INFO Property log.dirs is overridden to D:
mpkafka-logs (kafka.utils.VerifiableProperties)

I hope this helps somewhat.

-Vjeran

-----Original Message-----
From: Jun Rao [mailto:jun...@gmail.com]
Sent: Saturday, January 25, 2014 5:25 PM
To: users@kafka.apache.org
Subject: Re: Using Kafka on Windows - file path problems

It sounds like \tmp\kafka-logs should work since that's what
File.getParent() returns. Not sure why you can't use that to create the
file.

Thanks,

Jun


On Sat, Jan 25, 2014 at 12:43 AM, Vjeran Marcinko <
vjeran.marci...@email.t-com.hr> wrote:

> Hi,
>
> I have a problem going through start guide on Windows. Basically what 
> I found are file path problems it seems:
>
> If I try to set Kafka log dir path in server.properties using Windows 
> file separator, such as D:\tmp\kafka-logs, or even \tmp\kafka-logs , 
> then kafka cannot be started, since it throws
>
> [2014-01-25 08:04:00,495] FATAL Fatal error during KafkaServerStable 
> startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
> java.io.IOException: The filename, directory name, or volume label 
> syntax is incorrect
>         at java.io.WinNTFileSystem.canonicalize0(Native Method)
>         at java.io.Win32FileSystem.canonicalize(Win32FileSystem.java:396)
>         at java.io.File.getCanonicalPath(File.java:559)
>         at
>
> kafka.log.LogManager$$anonfun$createAndValidateLogDirs$1.apply(LogMana
> ger.sc
> ala:70)
>         at
>
> kafka.log.LogManager$$anonfun$createAndValidateLogDirs$1.apply(LogMana
> ger.sc
> ala:70)
>         at
>
>
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:
> 206)
>         at
>
>
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:
> 206)
>         at
>
> scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized
> .scala
> :34)
>         at
> scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:32)
>         at
> scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
>         at
scala.collection.mutable.WrappedArray.map(WrappedArray.scala:32)
>         at
> kafka.log.LogManager.createAndValidateLogDirs(LogManager.scala:70)
>         at kafka.log.LogManager.<init>(LogManager.scala:60)
>         at kafka.server.KafkaServer.startup(KafkaServer.scala:63)
>         at
> kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:34)
>         at kafka.Kafka$.main(Kafka.scala:46)
>
> If I use Unix file separator in settings, such as default 
> /tmp/kafka-logs, (and for those who don't use Windows, java on Windows 
> accepts paths that have unix path separator such as D:/tmp/some.file), 
> then Kafka can be started, but during topic creation I get following 
> error which I assume is due to trying to find the key using windows 
> file separator as given in exception log:
>
> [2014-01-25 08:05:53,681] ERROR Error on broker 0 while processing 
> LeaderAndIsr request correlationId 6 received from controller 0 epoch
> 1 for partition (mytopic,0) (state.change.logger)
> java.util.NoSuchElementException: key not found: \tmp\kafka-logs
>         at scala.collection.MapLike$class.default(MapLike.scala:223)
>         at scala.collection.immutable.Map$Map1.default(Map.scala:93)
>         at scala.collection.MapLike$class.apply(MapLike.scala:134)
>         at scala.collection.immutable.Map$Map1.apply(Map.scala:93)
>         at kafka.cluster.Partition.getOrCreateReplica(Partition.scala:88)
>         at kafka.cluster.Partition$$anonfun$1.apply(Partition.scala:154)
>         at kafka.cluster.Partition$$anonfun$1.apply(Partition.scala:154)
>         at
>
>
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:
> 206)
>         at
>
>
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:
> 206)
>         at
>
> scala.collection.LinearSeqOptimized$class.foreach(LinearSeqOptimized.s
> cala:6
> 1)
>         at scala.collection.immutable.List.foreach(List.scala:45)
>         at
> scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
>         at scala.collection.immutable.List.map(List.scala:45)
>         at kafka.cluster.Partition.makeLeader(Partition.scala:154)
>         at
>
> kafka.server.ReplicaManager.kafka$server$ReplicaManager$$makeLeader(Re
> plicaM
> anager.scala:257)
>         at
>
> kafka.server.ReplicaManager$$anonfun$becomeLeaderOrFollower$3.apply(Re
> plicaM
> anager.scala:221)
>         at
>
> kafka.server.ReplicaManager$$anonfun$becomeLeaderOrFollower$3.apply(Re
> plicaM
> anager.scala:213)
>         at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
>         at
>
>
kafka.server.ReplicaManager.becomeLeaderOrFollower(ReplicaManager.scala:213)
>         at
> kafka.server.KafkaApis.handleLeaderAndIsrRequest(KafkaApis.scala:86)
>         at kafka.server.KafkaApis.handle(KafkaApis.scala:69)
>         at
> kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
>         at java.lang.Thread.run(Thread.java:662)
>
> Regards,
> Vjeran
>
>
>

Reply via email to