[jira] [Commented] (KAFKA-974) can't use public release maven repo because of failure of downloaded dependency
[ https://issues.apache.org/jira/browse/KAFKA-974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707703#comment-13707703 ] Joe Stein commented on KAFKA-974: - tried this, same error diff --git a/project/Build.scala b/project/Build.scala index bad93db..c758178 100644 --- a/project/Build.scala +++ b/project/Build.scala @@ -39,7 +39,21 @@ object KafkaBuild extends Build { http://www.apache.org/licenses/LICENSE-2.0.txt repo -, + + + +com.sun.jmx +jmxri + + +com.sun.jdmk +jmxtools + + +javax.jms +jms + +, scalacOptions ++= Seq("-deprecation", "-unchecked", "-g:none"), crossScalaVersions := Seq("2.8.0","2.8.2", "2.9.1", "2.9.2"), scalaVersion := "2.8.0", > can't use public release maven repo because of failure of downloaded > dependency > --- > > Key: KAFKA-974 > URL: https://issues.apache.org/jira/browse/KAFKA-974 > Project: Kafka > Issue Type: Bug >Reporter: Joe Stein > Fix For: 0.8 > > Attachments: KAFKA-974.patch > > > trying to use the 0.8.0-beta1 release from public maven > name := "Stub" > version := "1.0.0.0" > scalaVersion := "2.9.2" > mainClass := Some("Stub") > libraryDependencies ++= Seq( > "org.apache.kafka" % "kafka_2.9.2" % "0.8.0-beta1" > ) > results in > Joes-MacBook-Air:stub joestein$ ./sbt compile > [info] Set current project to default-63d5f2 (in build > file:/opt/medialets/SymanticManager/scala/stub/) > [info] Updating > {file:/opt/medialets/SymanticManager/scala/stub/}default-63d5f2... > [warn][NOT FOUND ] javax.jms#jms;1.1!jms.jar (50ms) > [warn] public: tried > [warn] http://repo1.maven.org/maven2/javax/jms/jms/1.1/jms-1.1.jar > [warn][NOT FOUND ] com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar (12ms) > [warn] public: tried > [warn] > http://repo1.maven.org/maven2/com/sun/jdmk/jmxtools/1.2.1/jmxtools-1.2.1.jar > [warn][NOT FOUND ] com.sun.jmx#jmxri;1.2.1!jmxri.jar (71ms) > [warn] public: tried > [warn] http://repo1.maven.org/maven2/com/sun/jmx/jmxri/1.2.1/jmxri-1.2.1.jar > [warn]:: > [warn]:: FAILED DOWNLOADS:: > [warn]:: ^ see resolution messages for details ^ :: > [warn]:: > [warn]:: javax.jms#jms;1.1!jms.jar > [warn]:: com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar > [warn]:: com.sun.jmx#jmxri;1.2.1!jmxri.jar > [warn]:: > [info] > [warn] :: problems summary :: > [warn] WARNINGS > [warn][NOT FOUND ] javax.jms#jms;1.1!jms.jar (50ms) > [warn] public: tried > [warn] http://repo1.maven.org/maven2/javax/jms/jms/1.1/jms-1.1.jar > [warn][NOT FOUND ] com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar > (12ms) > [warn] public: tried > [warn] > http://repo1.maven.org/maven2/com/sun/jdmk/jmxtools/1.2.1/jmxtools-1.2.1.jar > [warn][NOT FOUND ] com.sun.jmx#jmxri;1.2.1!jmxri.jar (71ms) > [warn] public: tried > [warn] > http://repo1.maven.org/maven2/com/sun/jmx/jmxri/1.2.1/jmxri-1.2.1.jar > [warn]:: > [warn]:: FAILED DOWNLOADS:: > [warn]:: ^ see resolution messages for details ^ :: > [warn]:: > [warn]:: javax.jms#jms;1.1!jms.jar > [warn]:: com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar > [warn]:: com.sun.jmx#jmxri;1.2.1!jmxri.jar > [warn]:: > [info] > [info] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS > [error] > {file:/opt/medialets/SymanticManager/scala/stub/}default-63d5f2/*:update: > sbt.ResolveException: download failed: javax.jms#jms;1.1!jms.jar > [error] download failed: com.sun.jdmk#jmxtools;1.2.1!jmxtools.jar > [error] download failed: com.sun.jmx#jmxri;1.2.1!jmxri.jar > [error] Total time: 3 s, completed Jul 13, 2013 1:55:36 AM -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (KAFKA-656) Add Quotas to Kafka
[ https://issues.apache.org/jira/browse/KAFKA-656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707836#comment-13707836 ] Swapnil Ghike commented on KAFKA-656: - Hey Prashanth/Jonathan, have you had the time to run with this? If you're busy, I would be interested in taking this up. > Add Quotas to Kafka > --- > > Key: KAFKA-656 > URL: https://issues.apache.org/jira/browse/KAFKA-656 > Project: Kafka > Issue Type: New Feature > Components: core >Affects Versions: 0.8.1 >Reporter: Jay Kreps > Labels: project > > It would be nice to implement a quota system in Kafka to improve our support > for highly multi-tenant usage. The goal of this system would be to prevent > one naughty user from accidently overloading the whole cluster. > There are several quantities we would want to track: > 1. Requests pers second > 2. Bytes written per second > 3. Bytes read per second > There are two reasonable groupings we would want to aggregate and enforce > these thresholds at: > 1. Topic level > 2. Client level (e.g. by client id from the request) > When a request hits one of these limits we will simply reject it with a > QUOTA_EXCEEDED exception. > To avoid suddenly breaking things without warning, we should ideally support > two thresholds: a soft threshold at which we produce some kind of warning and > a hard threshold at which we give the error. The soft threshold could just be > defined as 80% (or whatever) of the hard threshold. > There are nuances to getting this right. If you measure second-by-second a > single burst may exceed the threshold, so we need a sustained measurement > over a period of time. > Likewise when do we stop giving this error? To make this work right we likely > need to charge against the quota for request *attempts* not just successful > requests. Otherwise a client that is overloading the server will just flap on > and off--i.e. we would disable them for a period of time but when we > re-enabled them they would likely still be abusing us. > It would be good to a wiki design on how this would all work as a starting > point for discussion. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (KAFKA-266) Kafka web console
[ https://issues.apache.org/jira/browse/KAFKA-266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707837#comment-13707837 ] Swapnil Ghike commented on KAFKA-266: - Hey Andrea, Guy, did you make any head way on this? > Kafka web console > - > > Key: KAFKA-266 > URL: https://issues.apache.org/jira/browse/KAFKA-266 > Project: Kafka > Issue Type: New Feature > Components: contrib >Reporter: Evan Chan > Labels: project > Original Estimate: 672h > Remaining Estimate: 672h > > This issue is created to track a community-contributed Kafka Web UI. > Here is an initial list of goals: > - Be able to easily see which brokers are up > - Be able to see lists of topics, connected producers, consumer groups, > connected consumers > - Be able to see, for each consumer/partition, its offset, and more > importantly, # of bytes unconsumed (== largest offset for partition - current > offset) > - (Wish list) have a graphical view of the offsets > - (Wish list) be able to clean up consumer state, such as stale claimed > partitions > List of challenges/questions: > - Which framework? Play! for Scala? > - Is all the data available from JMX and ZK? Hopefully, watching the files > on the filesystem can be avoided > - How to handle large numbers of topics, partitions, consumers, etc. > efficiently -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira