[jira] [Commented] (KAFKA-974) can't use public release maven repo because of failure of downloaded dependency

2013-07-13 Thread Joe Stein (JIRA)

[ 
https://issues.apache.org/jira/browse/KAFKA-974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707703#comment-13707703
 ] 

Joe Stein commented on KAFKA-974:
-

tried this, same error

diff --git a/project/Build.scala b/project/Build.scala
index bad93db..c758178 100644
--- a/project/Build.scala
+++ b/project/Build.scala
@@ -39,7 +39,21 @@ object KafkaBuild extends Build {
 http://www.apache.org/licenses/LICENSE-2.0.txt
 repo
   
-,
+
+
+  
+com.sun.jmx
+jmxri
+  
+  
+com.sun.jdmk
+jmxtools
+  
+  
+javax.jms
+jms
+  
+,
 scalacOptions ++= Seq("-deprecation", "-unchecked", "-g:none"),
 crossScalaVersions := Seq("2.8.0","2.8.2", "2.9.1", "2.9.2"),
 scalaVersion := "2.8.0",


> can't use public release maven repo because of failure of downloaded 
> dependency
> ---
>
> Key: KAFKA-974
> URL: https://issues.apache.org/jira/browse/KAFKA-974
> Project: Kafka
>  Issue Type: Bug
>Reporter: Joe Stein
> Fix For: 0.8
>
> Attachments: KAFKA-974.patch
>
>
> trying to use the 0.8.0-beta1 release from public maven
> name := "Stub"
> version := "1.0.0.0"
> scalaVersion := "2.9.2"
> mainClass := Some("Stub")
> libraryDependencies ++= Seq(
>   "org.apache.kafka" % "kafka_2.9.2" % "0.8.0-beta1"
> )
> results in
> Joes-MacBook-Air:stub joestein$ ./sbt compile
> [info] Set current project to default-63d5f2 (in build 
> file:/opt/medialets/SymanticManager/scala/stub/)
> [info] Updating 
> {file:/opt/medialets/SymanticManager/scala/stub/}default-63d5f2...
> [warn][NOT FOUND  ] javax.jms#jms;1.1!jms.jar (50ms)
> [warn]  public: tried
> [warn]   http://repo1.maven.org/maven2/javax/jms/jms/1.1/jms-1.1.jar
> [warn][NOT FOUND  ] com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar (12ms)
> [warn]  public: tried
> [warn]   
> http://repo1.maven.org/maven2/com/sun/jdmk/jmxtools/1.2.1/jmxtools-1.2.1.jar
> [warn][NOT FOUND  ] com.sun.jmx#jmxri;1.2.1!jmxri.jar (71ms)
> [warn]  public: tried
> [warn]   http://repo1.maven.org/maven2/com/sun/jmx/jmxri/1.2.1/jmxri-1.2.1.jar
> [warn]::
> [warn]::  FAILED DOWNLOADS::
> [warn]:: ^ see resolution messages for details  ^ ::
> [warn]::
> [warn]:: javax.jms#jms;1.1!jms.jar
> [warn]:: com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar
> [warn]:: com.sun.jmx#jmxri;1.2.1!jmxri.jar
> [warn]::
> [info] 
> [warn] :: problems summary ::
> [warn]  WARNINGS
> [warn][NOT FOUND  ] javax.jms#jms;1.1!jms.jar (50ms)
> [warn] public: tried
> [warn]  http://repo1.maven.org/maven2/javax/jms/jms/1.1/jms-1.1.jar
> [warn][NOT FOUND  ] com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar 
> (12ms)
> [warn] public: tried
> [warn]  
> http://repo1.maven.org/maven2/com/sun/jdmk/jmxtools/1.2.1/jmxtools-1.2.1.jar
> [warn][NOT FOUND  ] com.sun.jmx#jmxri;1.2.1!jmxri.jar (71ms)
> [warn] public: tried
> [warn]  
> http://repo1.maven.org/maven2/com/sun/jmx/jmxri/1.2.1/jmxri-1.2.1.jar
> [warn]::
> [warn]::  FAILED DOWNLOADS::
> [warn]:: ^ see resolution messages for details  ^ ::
> [warn]::
> [warn]:: javax.jms#jms;1.1!jms.jar
> [warn]:: com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar
> [warn]:: com.sun.jmx#jmxri;1.2.1!jmxri.jar
> [warn]::
> [info] 
> [info] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
> [error] 
> {file:/opt/medialets/SymanticManager/scala/stub/}default-63d5f2/*:update: 
> sbt.ResolveException: download failed: javax.jms#jms;1.1!jms.jar
> [error] download failed: com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar
> [error] download failed: com.sun.jmx#jmxri;1.2.1!jmxri.jar
> [error] Total time: 3 s, completed Jul 13, 2013 1:55:36 AM

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (KAFKA-656) Add Quotas to Kafka

2013-07-13 Thread Swapnil Ghike (JIRA)

[ 
https://issues.apache.org/jira/browse/KAFKA-656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707836#comment-13707836
 ] 

Swapnil Ghike commented on KAFKA-656:
-

Hey Prashanth/Jonathan, have you had the time to run with this? If you're busy, 
I would be interested in taking this up.

> Add Quotas to Kafka
> ---
>
> Key: KAFKA-656
> URL: https://issues.apache.org/jira/browse/KAFKA-656
> Project: Kafka
>  Issue Type: New Feature
>  Components: core
>Affects Versions: 0.8.1
>Reporter: Jay Kreps
>  Labels: project
>
> It would be nice to implement a quota system in Kafka to improve our support 
> for highly multi-tenant usage. The goal of this system would be to prevent 
> one naughty user from accidently overloading the whole cluster.
> There are several quantities we would want to track:
> 1. Requests pers second
> 2. Bytes written per second
> 3. Bytes read per second
> There are two reasonable groupings we would want to aggregate and enforce 
> these thresholds at:
> 1. Topic level
> 2. Client level (e.g. by client id from the request)
> When a request hits one of these limits we will simply reject it with a 
> QUOTA_EXCEEDED exception.
> To avoid suddenly breaking things without warning, we should ideally support 
> two thresholds: a soft threshold at which we produce some kind of warning and 
> a hard threshold at which we give the error. The soft threshold could just be 
> defined as 80% (or whatever) of the hard threshold.
> There are nuances to getting this right. If you measure second-by-second a 
> single burst may exceed the threshold, so we need a sustained measurement 
> over a period of time.
> Likewise when do we stop giving this error? To make this work right we likely 
> need to charge against the quota for request *attempts* not just successful 
> requests. Otherwise a client that is overloading the server will just flap on 
> and off--i.e. we would disable them for a period of time but when we 
> re-enabled them they would likely still be abusing us.
> It would be good to a wiki design on how this would all work as a starting 
> point for discussion.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (KAFKA-266) Kafka web console

2013-07-13 Thread Swapnil Ghike (JIRA)

[ 
https://issues.apache.org/jira/browse/KAFKA-266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707837#comment-13707837
 ] 

Swapnil Ghike commented on KAFKA-266:
-

Hey Andrea, Guy, did you make any head way on this? 

> Kafka web console
> -
>
> Key: KAFKA-266
> URL: https://issues.apache.org/jira/browse/KAFKA-266
> Project: Kafka
>  Issue Type: New Feature
>  Components: contrib
>Reporter: Evan Chan
>  Labels: project
>   Original Estimate: 672h
>  Remaining Estimate: 672h
>
> This issue is created to track a community-contributed Kafka Web UI.
> Here is an initial list of goals:
> - Be able to easily see which brokers are up
> - Be able to see lists of topics, connected producers, consumer groups, 
> connected consumers
> - Be able to see, for each consumer/partition, its offset, and more 
> importantly, # of bytes unconsumed (== largest offset for partition - current 
> offset)
> - (Wish list) have a graphical view of the offsets
> - (Wish list) be able to clean up consumer state, such as stale claimed 
> partitions
> List of challenges/questions:
> - Which framework?  Play! for Scala?
> - Is all the data available from JMX and ZK?  Hopefully, watching the files 
> on the filesystem can be avoided
> - How to handle large numbers of topics, partitions, consumers, etc. 
> efficiently

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira