Re: [jira] [Commented] (KAFKA-656) Add Quotas to Kafka

[S Ahmed]

This thread might be of some use, it discusses the memory footprint when
using metrics:
https://groups.google.com/forum/#!topic/metrics-user/T68H70ea1Og



On Sat, Jul 13, 2013 at 5:35 PM, Swapnil Ghike (JIRA) wrote:

>
> [
> https://issues.apache.org/jira/browse/KAFKA-656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707836#comment-13707836]
>
> Swapnil Ghike commented on KAFKA-656:
> -
>
> Hey Prashanth/Jonathan, have you had the time to run with this? If you're
> busy, I would be interested in taking this up.
>
> > Add Quotas to Kafka
> > ---
> >
> > Key: KAFKA-656
> > URL: https://issues.apache.org/jira/browse/KAFKA-656
> > Project: Kafka
> >  Issue Type: New Feature
> >  Components: core
> >Affects Versions: 0.8.1
> >Reporter: Jay Kreps
> >  Labels: project
> >
> > It would be nice to implement a quota system in Kafka to improve our
> support for highly multi-tenant usage. The goal of this system would be to
> prevent one naughty user from accidently overloading the whole cluster.
> > There are several quantities we would want to track:
> > 1. Requests pers second
> > 2. Bytes written per second
> > 3. Bytes read per second
> > There are two reasonable groupings we would want to aggregate and
> enforce these thresholds at:
> > 1. Topic level
> > 2. Client level (e.g. by client id from the request)
> > When a request hits one of these limits we will simply reject it with a
> QUOTA_EXCEEDED exception.
> > To avoid suddenly breaking things without warning, we should ideally
> support two thresholds: a soft threshold at which we produce some kind of
> warning and a hard threshold at which we give the error. The soft threshold
> could just be defined as 80% (or whatever) of the hard threshold.
> > There are nuances to getting this right. If you measure second-by-second
> a single burst may exceed the threshold, so we need a sustained measurement
> over a period of time.
> > Likewise when do we stop giving this error? To make this work right we
> likely need to charge against the quota for request *attempts* not just
> successful requests. Otherwise a client that is overloading the server will
> just flap on and off--i.e. we would disable them for a period of time but
> when we re-enabled them they would likely still be abusing us.
> > It would be good to a wiki design on how this would all work as a
> starting point for discussion.
>
> --
> This message is automatically generated by JIRA.
> If you think it was sent incorrectly, please contact your JIRA
> administrators
> For more information on JIRA, see: http://www.atlassian.com/software/jira
>

[jira] [Resolved] (KAFKA-968) Typographical Errors in Output

[Rebecca Sealfon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/KAFKA-968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rebecca Sealfon resolved KAFKA-968.
---

Resolution: Fixed

I checked the repository and this seems to have been fixed.

> Typographical Errors in Output
> --
>
> Key: KAFKA-968
> URL: https://issues.apache.org/jira/browse/KAFKA-968
> Project: Kafka
>  Issue Type: Bug
>  Components: core, replication
>Affects Versions: 0.8
> Environment: Kafka was run on GNU/Linux x86_64 but this is relevant 
> to all environments
>Reporter: Rebecca Sealfon
>Assignee: Neha Narkhede
>Priority: Trivial
>  Labels: partition, typo
> Fix For: 0.8
>
>   Original Estimate: 5m
>  Remaining Estimate: 5m
>
> The word "partition" is referred to as "partion" in 
> system_test/replication_testsuite/testcase_0106/testcase_0106_properties.json 
> line 2 and core/src/main/scala/kafka/server/AbstractFetcherManager.scala line 
> 49.  This typo may interfere with text-based searching of output.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (KAFKA-974) can't use public release maven repo because of failure of downloaded dependency

[Joe Stein (JIRA)]

[ 
https://issues.apache.org/jira/browse/KAFKA-974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13708177#comment-13708177
 ] 

Joe Stein commented on KAFKA-974:
-

tried this with no luck, same error

diff --git a/project/Build.scala b/project/Build.scala
index bad93db..219d7e0 100644
--- a/project/Build.scala
+++ b/project/Build.scala
@@ -52,7 +52,11 @@ object KafkaBuild extends Build {
 javacOptions ++= Seq("-Xlint:unchecked", "-source", "1.5"),
 parallelExecution in Test := false, // Prevent tests from overrunning each 
other
 libraryDependencies ++= Seq(
-  "log4j" % "log4j"% "1.2.15",
+  "log4j" % "log4j"% "1.2.15" excludeAll(
+ExclusionRule(organization = "com.sun.jdmk"),
+ExclusionRule(organization = "com.sun.jmx"),
+ExclusionRule(organization = "javax.jms")
+),
   "net.sf.jopt-simple"% "jopt-simple"  % "3.2",
   "org.slf4j" % "slf4j-simple" % "1.6.4"
 ),


> can't use public release maven repo because of failure of downloaded 
> dependency
> ---
>
> Key: KAFKA-974
> URL: https://issues.apache.org/jira/browse/KAFKA-974
> Project: Kafka
>  Issue Type: Bug
>Reporter: Joe Stein
> Fix For: 0.8
>
> Attachments: KAFKA-974.patch
>
>
> trying to use the 0.8.0-beta1 release from public maven
> name := "Stub"
> version := "1.0.0.0"
> scalaVersion := "2.9.2"
> mainClass := Some("Stub")
> libraryDependencies ++= Seq(
>   "org.apache.kafka" % "kafka_2.9.2" % "0.8.0-beta1"
> )
> results in
> Joes-MacBook-Air:stub joestein$ ./sbt compile
> [info] Set current project to default-63d5f2 (in build 
> file:/opt/medialets/SymanticManager/scala/stub/)
> [info] Updating 
> {file:/opt/medialets/SymanticManager/scala/stub/}default-63d5f2...
> [warn][NOT FOUND  ] javax.jms#jms;1.1!jms.jar (50ms)
> [warn]  public: tried
> [warn]   http://repo1.maven.org/maven2/javax/jms/jms/1.1/jms-1.1.jar
> [warn][NOT FOUND  ] com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar (12ms)
> [warn]  public: tried
> [warn]   
> http://repo1.maven.org/maven2/com/sun/jdmk/jmxtools/1.2.1/jmxtools-1.2.1.jar
> [warn][NOT FOUND  ] com.sun.jmx#jmxri;1.2.1!jmxri.jar (71ms)
> [warn]  public: tried
> [warn]   http://repo1.maven.org/maven2/com/sun/jmx/jmxri/1.2.1/jmxri-1.2.1.jar
> [warn]::
> [warn]::  FAILED DOWNLOADS::
> [warn]:: ^ see resolution messages for details  ^ ::
> [warn]::
> [warn]:: javax.jms#jms;1.1!jms.jar
> [warn]:: com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar
> [warn]:: com.sun.jmx#jmxri;1.2.1!jmxri.jar
> [warn]::
> [info] 
> [warn] :: problems summary ::
> [warn]  WARNINGS
> [warn][NOT FOUND  ] javax.jms#jms;1.1!jms.jar (50ms)
> [warn] public: tried
> [warn]  http://repo1.maven.org/maven2/javax/jms/jms/1.1/jms-1.1.jar
> [warn][NOT FOUND  ] com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar 
> (12ms)
> [warn] public: tried
> [warn]  
> http://repo1.maven.org/maven2/com/sun/jdmk/jmxtools/1.2.1/jmxtools-1.2.1.jar
> [warn][NOT FOUND  ] com.sun.jmx#jmxri;1.2.1!jmxri.jar (71ms)
> [warn] public: tried
> [warn]  
> http://repo1.maven.org/maven2/com/sun/jmx/jmxri/1.2.1/jmxri-1.2.1.jar
> [warn]::
> [warn]::  FAILED DOWNLOADS::
> [warn]:: ^ see resolution messages for details  ^ ::
> [warn]::
> [warn]:: javax.jms#jms;1.1!jms.jar
> [warn]:: com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar
> [warn]:: com.sun.jmx#jmxri;1.2.1!jmxri.jar
> [warn]::
> [info] 
> [info] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
> [error] 
> {file:/opt/medialets/SymanticManager/scala/stub/}default-63d5f2/*:update: 
> sbt.ResolveException: download failed: javax.jms#jms;1.1!jms.jar
> [error] download failed: com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar
> [error] download failed: com.sun.jmx#jmxri;1.2.1!jmxri.jar
> [error] Total time: 3 s, completed Jul 13, 2013 1:55:36 AM

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (KAFKA-974) can't use public release maven repo because of failure of downloaded dependency

[Joe Stein (JIRA)]

[ 
https://issues.apache.org/jira/browse/KAFKA-974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13708183#comment-13708183
 ] 

Joe Stein commented on KAFKA-974:
-

well, as far as SBT goes 
http://www.scala-sbt.org/release/docs/Detailed-Topics/Library-Management#exclude-transitive-dependencies
 it looks like exclude is the right command to use not excludeAll 

diff --git a/project/Build.scala b/project/Build.scala
index bad93db..b3858f3 100644
--- a/project/Build.scala
+++ b/project/Build.scala
@@ -52,7 +52,7 @@ object KafkaBuild extends Build {
 javacOptions ++= Seq("-Xlint:unchecked", "-source", "1.5"),
 parallelExecution in Test := false, // Prevent tests from overrunning each 
other
 libraryDependencies ++= Seq(
-  "log4j" % "log4j"% "1.2.15",
+  "log4j" % "log4j"% "1.2.15" exclude("javax.jms", 
"jms"),
   "net.sf.jopt-simple"% "jopt-simple"  % "3.2",
   "org.slf4j" % "slf4j-simple" % "1.6.4"
 ),


however, still same error though 

[error] 
{file:/opt/medialets/SymanticManager/scala/stub/}default-63d5f2/*:update: 
sbt.ResolveException: download failed: javax.jms#jms;1.1!jms.jar

the pom does look better with the exclusion in the place I expected 


log4j
log4j
1.2.15


javax.jms
jms




still not working

> can't use public release maven repo because of failure of downloaded 
> dependency
> ---
>
> Key: KAFKA-974
> URL: https://issues.apache.org/jira/browse/KAFKA-974
> Project: Kafka
>  Issue Type: Bug
>Reporter: Joe Stein
> Fix For: 0.8
>
> Attachments: KAFKA-974.patch
>
>
> trying to use the 0.8.0-beta1 release from public maven
> name := "Stub"
> version := "1.0.0.0"
> scalaVersion := "2.9.2"
> mainClass := Some("Stub")
> libraryDependencies ++= Seq(
>   "org.apache.kafka" % "kafka_2.9.2" % "0.8.0-beta1"
> )
> results in
> Joes-MacBook-Air:stub joestein$ ./sbt compile
> [info] Set current project to default-63d5f2 (in build 
> file:/opt/medialets/SymanticManager/scala/stub/)
> [info] Updating 
> {file:/opt/medialets/SymanticManager/scala/stub/}default-63d5f2...
> [warn][NOT FOUND  ] javax.jms#jms;1.1!jms.jar (50ms)
> [warn]  public: tried
> [warn]   http://repo1.maven.org/maven2/javax/jms/jms/1.1/jms-1.1.jar
> [warn][NOT FOUND  ] com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar (12ms)
> [warn]  public: tried
> [warn]   
> http://repo1.maven.org/maven2/com/sun/jdmk/jmxtools/1.2.1/jmxtools-1.2.1.jar
> [warn][NOT FOUND  ] com.sun.jmx#jmxri;1.2.1!jmxri.jar (71ms)
> [warn]  public: tried
> [warn]   http://repo1.maven.org/maven2/com/sun/jmx/jmxri/1.2.1/jmxri-1.2.1.jar
> [warn]::
> [warn]::  FAILED DOWNLOADS::
> [warn]:: ^ see resolution messages for details  ^ ::
> [warn]::
> [warn]:: javax.jms#jms;1.1!jms.jar
> [warn]:: com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar
> [warn]:: com.sun.jmx#jmxri;1.2.1!jmxri.jar
> [warn]::
> [info] 
> [warn] :: problems summary ::
> [warn]  WARNINGS
> [warn][NOT FOUND  ] javax.jms#jms;1.1!jms.jar (50ms)
> [warn] public: tried
> [warn]  http://repo1.maven.org/maven2/javax/jms/jms/1.1/jms-1.1.jar
> [warn][NOT FOUND  ] com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar 
> (12ms)
> [warn] public: tried
> [warn]  
> http://repo1.maven.org/maven2/com/sun/jdmk/jmxtools/1.2.1/jmxtools-1.2.1.jar
> [warn][NOT FOUND  ] com.sun.jmx#jmxri;1.2.1!jmxri.jar (71ms)
> [warn] public: tried
> [warn]  
> http://repo1.maven.org/maven2/com/sun/jmx/jmxri/1.2.1/jmxri-1.2.1.jar
> [warn]::
> [warn]::  FAILED DOWNLOADS::
> [warn]:: ^ see resolution messages for details  ^ ::
> [warn]::
> [warn]:: javax.jms#jms;1.1!jms.jar
> [warn]:: com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar
> [warn]:: com.sun.jmx#jmxri;1.2.1!jmxri.jar
> [warn]::
> [info] 
> [info] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
> [error] 
> {file:/opt/medialets/SymanticManager/scala/stub/}default-63d5f2/*:update: 
> sbt.ResolveException: download failed: javax.jms#jms;1.1!jms.jar
> [error] download failed: com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar
> [error] download failed: com.sun.jmx#jmxri;1.2.1!jmxri.jar
> [error] Total time: 3 s, completed Jul 13, 2013 1:55:36

[jira] [Updated] (KAFKA-974) can't use public release maven repo because of failure of downloaded dependency

[Joe Stein (JIRA)]

 [ 
https://issues.apache.org/jira/browse/KAFKA-974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joe Stein updated KAFKA-974:


Status: Patch Available  (was: Open)

> can't use public release maven repo because of failure of downloaded 
> dependency
> ---
>
> Key: KAFKA-974
> URL: https://issues.apache.org/jira/browse/KAFKA-974
> Project: Kafka
>  Issue Type: Bug
>Reporter: Joe Stein
> Fix For: 0.8
>
> Attachments: KAFKA-974.patch, KAFKA-974.v2.patch
>
>
> trying to use the 0.8.0-beta1 release from public maven
> name := "Stub"
> version := "1.0.0.0"
> scalaVersion := "2.9.2"
> mainClass := Some("Stub")
> libraryDependencies ++= Seq(
>   "org.apache.kafka" % "kafka_2.9.2" % "0.8.0-beta1"
> )
> results in
> Joes-MacBook-Air:stub joestein$ ./sbt compile
> [info] Set current project to default-63d5f2 (in build 
> file:/opt/medialets/SymanticManager/scala/stub/)
> [info] Updating 
> {file:/opt/medialets/SymanticManager/scala/stub/}default-63d5f2...
> [warn][NOT FOUND  ] javax.jms#jms;1.1!jms.jar (50ms)
> [warn]  public: tried
> [warn]   http://repo1.maven.org/maven2/javax/jms/jms/1.1/jms-1.1.jar
> [warn][NOT FOUND  ] com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar (12ms)
> [warn]  public: tried
> [warn]   
> http://repo1.maven.org/maven2/com/sun/jdmk/jmxtools/1.2.1/jmxtools-1.2.1.jar
> [warn][NOT FOUND  ] com.sun.jmx#jmxri;1.2.1!jmxri.jar (71ms)
> [warn]  public: tried
> [warn]   http://repo1.maven.org/maven2/com/sun/jmx/jmxri/1.2.1/jmxri-1.2.1.jar
> [warn]::
> [warn]::  FAILED DOWNLOADS::
> [warn]:: ^ see resolution messages for details  ^ ::
> [warn]::
> [warn]:: javax.jms#jms;1.1!jms.jar
> [warn]:: com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar
> [warn]:: com.sun.jmx#jmxri;1.2.1!jmxri.jar
> [warn]::
> [info] 
> [warn] :: problems summary ::
> [warn]  WARNINGS
> [warn][NOT FOUND  ] javax.jms#jms;1.1!jms.jar (50ms)
> [warn] public: tried
> [warn]  http://repo1.maven.org/maven2/javax/jms/jms/1.1/jms-1.1.jar
> [warn][NOT FOUND  ] com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar 
> (12ms)
> [warn] public: tried
> [warn]  
> http://repo1.maven.org/maven2/com/sun/jdmk/jmxtools/1.2.1/jmxtools-1.2.1.jar
> [warn][NOT FOUND  ] com.sun.jmx#jmxri;1.2.1!jmxri.jar (71ms)
> [warn] public: tried
> [warn]  
> http://repo1.maven.org/maven2/com/sun/jmx/jmxri/1.2.1/jmxri-1.2.1.jar
> [warn]::
> [warn]::  FAILED DOWNLOADS::
> [warn]:: ^ see resolution messages for details  ^ ::
> [warn]::
> [warn]:: javax.jms#jms;1.1!jms.jar
> [warn]:: com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar
> [warn]:: com.sun.jmx#jmxri;1.2.1!jmxri.jar
> [warn]::
> [info] 
> [info] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
> [error] 
> {file:/opt/medialets/SymanticManager/scala/stub/}default-63d5f2/*:update: 
> sbt.ResolveException: download failed: javax.jms#jms;1.1!jms.jar
> [error] download failed: com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar
> [error] download failed: com.sun.jmx#jmxri;1.2.1!jmxri.jar
> [error] Total time: 3 s, completed Jul 13, 2013 1:55:36 AM

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (KAFKA-974) can't use public release maven repo because of failure of downloaded dependency

[Joe Stein (JIRA)]

 [ 
https://issues.apache.org/jira/browse/KAFKA-974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joe Stein updated KAFKA-974:


Attachment: KAFKA-974.v2.patch

That last fix did work and attached patch

to use public maven

"org.apache.kafka" % "kafka_2.9.2" % "0.8.0-beta1" intransitive()

the key in this last patch was to include intransitive() so that SBT knows to 
not fetch the dependencies we specified in the pom 
http://www.scala-sbt.org/release/docs/Detailed-Topics/Library-Management#disable-transitivity

> can't use public release maven repo because of failure of downloaded 
> dependency
> ---
>
> Key: KAFKA-974
> URL: https://issues.apache.org/jira/browse/KAFKA-974
> Project: Kafka
>  Issue Type: Bug
>Reporter: Joe Stein
> Fix For: 0.8
>
> Attachments: KAFKA-974.patch, KAFKA-974.v2.patch
>
>
> trying to use the 0.8.0-beta1 release from public maven
> name := "Stub"
> version := "1.0.0.0"
> scalaVersion := "2.9.2"
> mainClass := Some("Stub")
> libraryDependencies ++= Seq(
>   "org.apache.kafka" % "kafka_2.9.2" % "0.8.0-beta1"
> )
> results in
> Joes-MacBook-Air:stub joestein$ ./sbt compile
> [info] Set current project to default-63d5f2 (in build 
> file:/opt/medialets/SymanticManager/scala/stub/)
> [info] Updating 
> {file:/opt/medialets/SymanticManager/scala/stub/}default-63d5f2...
> [warn][NOT FOUND  ] javax.jms#jms;1.1!jms.jar (50ms)
> [warn]  public: tried
> [warn]   http://repo1.maven.org/maven2/javax/jms/jms/1.1/jms-1.1.jar
> [warn][NOT FOUND  ] com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar (12ms)
> [warn]  public: tried
> [warn]   
> http://repo1.maven.org/maven2/com/sun/jdmk/jmxtools/1.2.1/jmxtools-1.2.1.jar
> [warn][NOT FOUND  ] com.sun.jmx#jmxri;1.2.1!jmxri.jar (71ms)
> [warn]  public: tried
> [warn]   http://repo1.maven.org/maven2/com/sun/jmx/jmxri/1.2.1/jmxri-1.2.1.jar
> [warn]::
> [warn]::  FAILED DOWNLOADS::
> [warn]:: ^ see resolution messages for details  ^ ::
> [warn]::
> [warn]:: javax.jms#jms;1.1!jms.jar
> [warn]:: com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar
> [warn]:: com.sun.jmx#jmxri;1.2.1!jmxri.jar
> [warn]::
> [info] 
> [warn] :: problems summary ::
> [warn]  WARNINGS
> [warn][NOT FOUND  ] javax.jms#jms;1.1!jms.jar (50ms)
> [warn] public: tried
> [warn]  http://repo1.maven.org/maven2/javax/jms/jms/1.1/jms-1.1.jar
> [warn][NOT FOUND  ] com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar 
> (12ms)
> [warn] public: tried
> [warn]  
> http://repo1.maven.org/maven2/com/sun/jdmk/jmxtools/1.2.1/jmxtools-1.2.1.jar
> [warn][NOT FOUND  ] com.sun.jmx#jmxri;1.2.1!jmxri.jar (71ms)
> [warn] public: tried
> [warn]  
> http://repo1.maven.org/maven2/com/sun/jmx/jmxri/1.2.1/jmxri-1.2.1.jar
> [warn]::
> [warn]::  FAILED DOWNLOADS::
> [warn]:: ^ see resolution messages for details  ^ ::
> [warn]::
> [warn]:: javax.jms#jms;1.1!jms.jar
> [warn]:: com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar
> [warn]:: com.sun.jmx#jmxri;1.2.1!jmxri.jar
> [warn]::
> [info] 
> [info] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
> [error] 
> {file:/opt/medialets/SymanticManager/scala/stub/}default-63d5f2/*:update: 
> sbt.ResolveException: download failed: javax.jms#jms;1.1!jms.jar
> [error] download failed: com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar
> [error] download failed: com.sun.jmx#jmxri;1.2.1!jmxri.jar
> [error] Total time: 3 s, completed Jul 13, 2013 1:55:36 AM

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

0.8.0-beta1 is now available in public maven

[Joe Stein]

With SBT you can use 0.8.1-beta built with any of these four Scala versions
in libraryDependencies now

"org.apache.kafka" % "kafka_2.9.2" % "0.8.0-beta1" intransitive()

or

"org.apache.kafka" % "kafka_2.9.1" % "0.8.0-beta1" intransitive()

or

"org.apache.kafka" % "kafka_2.8.2" % "0.8.0-beta1" intransitive()

or

"org.apache.kafka" % "kafka_2.8.0" % "0.8.0-beta1" intransitive()


/*
Joe Stein
http://www.linkedin.com/in/charmalloc
Twitter: @allthingshadoop 
*/

Re: 0.8.0-beta1 is now available in public maven

[Joe Stein]

SBT uses Maven Central as a default repository (local ivy too).

The artifacts are published to Maven Central so nothing you should have
to-do except to specify the libraryDependencies

In regards to 2.10.X support I took a really quick look at
https://issues.apache.org/jira/browse/KAFKA-717 (lots to go through in that
ticket it seems) will try some of the patch applys tomorrow and see how
they go.  I would be in favor of it being part of the 0.8.0 final if it all
gets through and looks good and committing it to the 0.8 branch and not
only trunk but lets see first what is involved building 2.10.0, 2.10.1 and
2.10.2 and what is going to take to get it working with the patches
submitted.



On Sun, Jul 14, 2013 at 9:44 PM, chetan conikee  wrote:

> Excellent
>
> What about the resolver ? sonatype, typeafe. maven artifactory ?
> Any plans for a 2.10+ compile as well
>
>
> On Sun, Jul 14, 2013 at 6:37 PM, Dima Gutzeit  wrote:
>
> > What about the "newer" (not so new anymore) scala version 2.10.0 and up ?
> > When will it be supported officially ?
> >
> >
> > Regards,
> > Dima Gutzeit.
> >
> >
> > On 15/7/13 9:32 AM, "Joe Stein"  wrote:
> >
> > >With SBT you can use 0.8.1-beta built with any of these four Scala
> > >versions
> > >in libraryDependencies now
> > >
> > >"org.apache.kafka" % "kafka_2.9.2" % "0.8.0-beta1" intransitive()
> > >
> > >or
> > >
> > >"org.apache.kafka" % "kafka_2.9.1" % "0.8.0-beta1" intransitive()
> > >
> > >or
> > >
> > >"org.apache.kafka" % "kafka_2.8.2" % "0.8.0-beta1" intransitive()
> > >
> > >or
> > >
> > >"org.apache.kafka" % "kafka_2.8.0" % "0.8.0-beta1" intransitive()
> > >
> > >
> > >/*
> > >Joe Stein
> > >http://www.linkedin.com/in/charmalloc
> > >Twitter: @allthingshadoop 
> > >*/
> >
> >
>



-- 

/*
Joe Stein
http://www.linkedin.com/in/charmalloc
Twitter: @allthingshadoop 
*/

[jira] [Commented] (KAFKA-717) scala 2.10 build support

[Joe Stein (JIRA)]

[ 
https://issues.apache.org/jira/browse/KAFKA-717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13708204#comment-13708204
 ] 

Joe Stein commented on KAFKA-717:
-

looking at the simple patch not sure changing the scalaVersion default from 
2.8.0 to 2.8.2 is a great idea and what the reasoning was behind it

will see if I can make any headway on trunk with the patches but would not 
commit the version change if I do get it working without some good reasoning 
for it.  the complex version appears to have a lot of unnecessary changes 
bleeding into the patch just for 2.10.X support ... will also go through the 
others for 2.9.3 might have to create one new patch that is clean for this 
ticket.. well see dunno yet

> scala 2.10 build support
> 
>
> Key: KAFKA-717
> URL: https://issues.apache.org/jira/browse/KAFKA-717
> Project: Kafka
>  Issue Type: Improvement
>  Components: packaging
>Affects Versions: 0.8
>Reporter: Viktor Taranenko
>  Labels: build
> Attachments: 0001-common-changes-for-2.10.patch, 
> 0001-common-changes-for-2.10.patch, 
> 0001-KAFKA-717-Convert-to-scala-2.10.patch, 
> 0002-java-conversions-changes.patch, 0002-java-conversions-changes.patch, 
> 0003-add-2.9.3.patch, 0003-add-2.9.3.patch, 
> 0004-Fix-cross-compile-of-tests-update-to-2.10.2-and-set-.patch, 
> KAFKA-717-complex.patch, KAFKA-717-simple.patch, kafka_scala_2.10.tar.gz
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Re: 0.8.0-beta1 is now available in public maven

[Jason Rosenberg]

Thanks for doing this!

I'm wondering whether there is a reason to prefer one version of scala over
another, if we don't have any other particular scala dependency in our
code.  Are the newer versions better/more efficient, some how?  We've
essentially been using 2.8.0 so far, which seems to be fine (so I'm not
particularly inclined to change, but I'm just curious).

One thing I notice, in the pom file, there are 2 dependencies listed for
zookeeper, one of which has an exclusion clause, the other does not.   I
assume this is not intended:



org.apache.zookeeper
zookeeper
3.3.4


log4j
log4j


jline
jline




and then



org.apache.zookeeper
zookeeper
3.3.4



On Sun, Jul 14, 2013 at 7:06 PM, Joe Stein  wrote:

> SBT uses Maven Central as a default repository (local ivy too).
>
> The artifacts are published to Maven Central so nothing you should have
> to-do except to specify the libraryDependencies
>
> In regards to 2.10.X support I took a really quick look at
> https://issues.apache.org/jira/browse/KAFKA-717 (lots to go through in
> that
> ticket it seems) will try some of the patch applys tomorrow and see how
> they go.  I would be in favor of it being part of the 0.8.0 final if it all
> gets through and looks good and committing it to the 0.8 branch and not
> only trunk but lets see first what is involved building 2.10.0, 2.10.1 and
> 2.10.2 and what is going to take to get it working with the patches
> submitted.
>
>
>
> On Sun, Jul 14, 2013 at 9:44 PM, chetan conikee  wrote:
>
> > Excellent
> >
> > What about the resolver ? sonatype, typeafe. maven artifactory ?
> > Any plans for a 2.10+ compile as well
> >
> >
> > On Sun, Jul 14, 2013 at 6:37 PM, Dima Gutzeit  wrote:
> >
> > > What about the "newer" (not so new anymore) scala version 2.10.0 and
> up ?
> > > When will it be supported officially ?
> > >
> > >
> > > Regards,
> > > Dima Gutzeit.
> > >
> > >
> > > On 15/7/13 9:32 AM, "Joe Stein"  wrote:
> > >
> > > >With SBT you can use 0.8.1-beta built with any of these four Scala
> > > >versions
> > > >in libraryDependencies now
> > > >
> > > >"org.apache.kafka" % "kafka_2.9.2" % "0.8.0-beta1" intransitive()
> > > >
> > > >or
> > > >
> > > >"org.apache.kafka" % "kafka_2.9.1" % "0.8.0-beta1" intransitive()
> > > >
> > > >or
> > > >
> > > >"org.apache.kafka" % "kafka_2.8.2" % "0.8.0-beta1" intransitive()
> > > >
> > > >or
> > > >
> > > >"org.apache.kafka" % "kafka_2.8.0" % "0.8.0-beta1" intransitive()
> > > >
> > > >
> > > >/*
> > > >Joe Stein
> > > >http://www.linkedin.com/in/charmalloc
> > > >Twitter: @allthingshadoop 
> > > >*/
> > >
> > >
> >
>
>
>
> --
>
> /*
> Joe Stein
> http://www.linkedin.com/in/charmalloc
> Twitter: @allthingshadoop 
> */
>