[Bug 574910] Re: High load averages on Lucid while idling

2011-08-24 Thread Scott Moser
I meant to add in comment 100. I am most certainly not saying that the linux-ec2 kernel running on EC2 is flawless, nor am I saying that -virtual is flawless, but the high load in /proc/loadavg was fixed. If you have other issues, with current images, please open bugs. -- You received this bug

[Bug 574910] Re: High load averages on Lucid while idling

2011-08-24 Thread Scott Moser
This bug is "Invalid" on "Ubuntu on EC2" where invalid means "not the correct project". Bugs found when running Ubuntu on EC2 should be filed against the Ubuntu project. The Ubuntu project bug, open against the 'linux' package is marked 'Fixed Released'. See comment 93. >From the bug summary, i

[Bug 574910] Re: High load averages on Lucid while idling

2011-08-24 Thread flaccid
Which actual AKI is this bug against and is it occurring with the latest images? Maybe it doesn't exist anymore in the latest with pvgrub AKI and AMI? Does LTS mean anything here? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https:/

[Bug 574910] Re: High load averages on Lucid while idling

2011-08-24 Thread Matthew Gregg
Why marked invalid, was this fixed? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/574910 Title: High load averages on Lucid while idling To manage notifications about this bug go to: https://bugs.l

[Bug 574910] Re: High load averages on Lucid while idling

2011-08-24 Thread Scott Moser
** Changed in: ubuntu-on-ec2 Status: New => Invalid -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/574910 Title: High load averages on Lucid while idling To manage notifications about this bu

[Bug 574910] Re: High load averages on Lucid while idling

2011-04-27 Thread jr
Hi - another person reporting in.. spent a couple days trying to troubleshoot what could possibly be bottlenecking our system to report such a high load. Finally found that it is a known bug. It looks like the fix is almost ready? > uname -a Linux ip-###.##-ec2 #9-Ubuntu SMP Thu Apr 15 08:05:38

[Bug 574910] Re: High load averages on Lucid while idling

2011-04-10 Thread DLHDavidLH
this bug affects others - High load average on Ubuntu 10.04 ...( 64 bit ) - Ubuntu 10.04 (64bit) - Linux kernel 2.6.32-30 - Gnome 2.30.2 -

[Bug 574910] Re: High load averages on Lucid while idling

2011-02-16 Thread Mads Martin Jørgensen
Is this fix present in 2.6.32-312-ec2? I'm seeing high loads on machines doing almost nothing after upgrading to the grub kernel (thanks for that, BTW!), and then -312. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launc

[Bug 574910] Re: High load averages on Lucid while idling

2010-11-28 Thread Peter Júnoš
When will be this fix released for x64 server kernel? I updated server ~week ago (kernel 2.6.32-25-server) and fix still isn't there. -- High load averages on Lucid while idling https://bugs.launchpad.net/bugs/574910 You received this bug notification because you are a member of Ubuntu Bugs, whic

[Bug 574910] Re: High load averages on Lucid while idling

2010-11-03 Thread Scott Moser
This was fix-released in linux-image-2.6.32-309-ec2 . That kernel is the default in uec images with serial 20101020. https://lists.ubuntu.com/archives/ubuntu-cloud/2010-October/000307.html ** Changed in: linux-ec2 (Ubuntu) Status: In Progress => Fix Released -- High load averages on Lucid

[Bug 574910] Re: High load averages on Lucid while idling

2010-10-18 Thread flaccid
I also confirm the new kernels fix the bug. Thanks Scott! Users keep in mind, that for existing images, you'll need to install the corresponding kernel modules (a reboot will usually kernel panic if they do not exist). -- High load averages on Lucid while idling https://bugs.launchpad.net/bug

[Bug 574910] Re: High load averages on Lucid while idling

2010-10-18 Thread Scott Moser
I ran ami-6407f20d (ubuntu-lucid-10.04-i386-server-20100923) with kernel aki-a2c236cb, and in almost an hour, the highest load shown is a spike to .15. I consider this bug fixed in the -proposed kernel. -- High load averages on Lucid while idling https://bugs.launchpad.net/bugs/574910 You receiv

[Bug 574910] Re: High load averages on Lucid while idling

2010-10-14 Thread Scott Moser
I've uploaded kernels to the following akis. Please test these (from lucid-proposed) and report back. x86_64 ubuntu-lucid-amd64-linux-image-2.6.32-309-ec2-v-2.6.32-309.17-kernel.img us-west-1 aki-70065635 us-east-1 aki-acc236c5 eu-west-1 aki-8c4174f8 ap-southeast-1 aki-320d7360 i386 ubuntu

[Bug 574910] Re: High load averages on Lucid while idling

2010-10-05 Thread Launchpad Bug Tracker
** Branch linked: lp:ubuntu/lucid-proposed/linux-ec2 -- High load averages on Lucid while idling https://bugs.launchpad.net/bugs/574910 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu

[Bug 574910] Re: High load averages on Lucid while idling

2010-09-27 Thread Scott Moser
@Rod The latest kernel attached to the latest set of images does not contain a fix for this bug. The kernel team is working on getting this fix [1] pulled in and uploaded to -proposed, hopefully early this week. At that point, this bug will have an automatic comment added to it indicating

[Bug 574910] Re: High load averages on Lucid while idling

2010-09-24 Thread Rod
My latest on this is that I haven't really had a problem since my last post here. Eric's suggestion to add an explicit XFS unfreeze after my regular snapshots may have fixed some of my load spike / lockup problems, even though it happened once soon after I added the unfreeze (as per my post above)

[Bug 574910] Re: High load averages on Lucid while idling

2010-09-24 Thread James Turk
John, I'm so frustrated with this that I'd be happy to try anything, including however many test kernels you throw at me. I'm curious though -- If you start up an EC2 instance of your own are you not seeing this behavior? After noticing the latest AMI release I decided I should try spinning up

[Bug 574910] Re: High load averages on Lucid while idling

2010-09-20 Thread Scott Moser
** Changed in: linux-meta (Ubuntu) Status: New => Invalid -- High load averages on Lucid while idling https://bugs.launchpad.net/bugs/574910 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@

[Bug 574910] Re: High load averages on Lucid while idling

2010-09-15 Thread Alexandre Bourget
Hello folks, just want to clarify, this might shed some light on my problem so I'm sharing it here. My Lucid system was in fact upgraded from a Karmic install on EC2, so the kernel that is running there is 2.6.31-302-ec2, the one distributed with Karmic. All the system was upgraded to Lucid, but

[Bug 574910] Re: High load averages on Lucid while idling

2010-09-11 Thread Chris
The just of it is this. Enterprise cloud stuff goes here. Everyone else in to the pool I just created unless there is a better one out there. -- High load averages on Lucid while idling https://bugs.launchpad.net/bugs/574910 You received this bug notification because you are a member of Ubuntu

[Bug 574910] Re: High load averages on Lucid while idling

2010-09-11 Thread Chris
I created bug id #635181 -- High load averages on Lucid while idling https://bugs.launchpad.net/bugs/574910 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.c

[Bug 574910] Re: High load averages on Lucid while idling

2010-09-08 Thread John Johansen
Alex, I appreciate both your frustration and your desire to help, the Lucid kernel has seen literally hundreds of patches since release (see https://edge.launchpad.net/ubuntu/+source/linux/2.6.32-25.43) for just the latest round of updates for the proposed kernel and more are already on the way.

[Bug 574910] Re: High load averages on Lucid while idling

2010-09-07 Thread John Johansen
James, thankyou for the report. Is there anymore data you can provide from the box that spiraled out of control? Also the Maverick report is interesting are you will to run a couple test kernels that I have if I make them available? -- High load averages on Lucid while idling https://bugs.laun

[Bug 574910] Re: High load averages on Lucid while idling

2010-09-07 Thread John Johansen
asasoft, I'll give you that Bug #524281 can and does affect load, however it certainly not the only issue that affects load, and it doesn't result in quite the same random phantom loads I was seeing. Unfortunately one persons phantom loads are different than another. I address one particular bug

[Bug 574910] Re: High load averages on Lucid while idling

2010-09-04 Thread Alex Howells
There are a lot of users here echoing my sentiments. I appreciate there is a way to file bugs and that Ubuntu addresses them per that policy. What you have is quite a significant number of users saying the Lucid Lynx kernel is flat out broken. I specifically tagged this bug to 'linux' (more gener

[Bug 574910] Re: High load averages on Lucid while idling

2010-09-04 Thread James Turk
Just echoing what others are saying here. This bug is definitely not resolved, I reported one of the original bugs (#575193) and just got a chance to try out the new lucid AMIs. After the machine was up for two days load spiraled out of control until we had to shut it down due to unresponsiveness

[Bug 574910] Re: High load averages on Lucid while idling

2010-09-04 Thread asasoft
@John Johansen "Outside of EC2 the high load average for an idle machine hasn't been generally reported as a problem" John I think this is the same as Bug #524281 , already mentioned in comment 15 -- High load averages on Lucid while idling https://bugs.launchpad.net/bugs/574910 You received t

[Bug 574910] Re: High load averages on Lucid while idling

2010-09-03 Thread Matthew Gregg
@john that does seem to look like my issue. I had that behavior, but never saw any iowait. -- High load averages on Lucid while idling https://bugs.launchpad.net/bugs/574910 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bug

[Bug 574910] Re: High load averages on Lucid while idling

2010-09-03 Thread John Johansen
Rod, Alexandre, Matthew: your problem maybe at least partially related to Bug #585092, which is actually a little more generic than just umount. Chris, something certainly isn't right with your system, but the fix from this bug isn't going to help you as it only applied to the -ec2 kernel. Outsi

[Bug 574910] Re: High load averages on Lucid while idling

2010-09-02 Thread Chris
After installing all of the most recent updates. Then fixing the botched patch roll out so that I could boot the system again. I still have wretched load averages. My host, violet 2.6.32-24-generic #42-Ubuntu SMP, is still experiencing load averages of > 1 after a reboot and waiting 5 min for i

[Bug 574910] Re: High load averages on Lucid while idling

2010-09-02 Thread Alexandre Bourget
My problems are similar to those of Rod, straight unresponsiveness including high loads in some intermitent moments. If anyone is looking for a solution to such a problem, they'll probably be driven to this thread. So should we open another bug and restart the conversation ? -- High load averag

[Bug 574910] Re: High load averages on Lucid while idling

2010-09-01 Thread Rod
No-go. I just had it happen again! This time it was at 45 mins past the hour so nowhere near my snapshot time. System was so unresponsive that it kicked me off my ssh session. I tried a forced instance restart and once I did that I could suddenly log in again even though it didn't restart, was s

[Bug 574910] Re: High load averages on Lucid while idling

2010-09-01 Thread Rod
Quite possible Eric, will try the explicit unfreeze and see if it makes a difference. Thanks for that! The summary from me is that the underlying high load average bug has been properly fixed for me since using the new kernel. My only remaining problem is this load spike issue, if it turns out to

[Bug 574910] Re: High load averages on Lucid while idling

2010-09-01 Thread Eric Hammond
Rod: I think you are probably experiencing something completely unrelated to the bug identified in this launchpad report. It might be worth moving the conversation to a different bug or a different venue. If you are using ec2-consistent-snapshot to initiate your EBS snapshots (freezing an XFS file

[Bug 574910] Re: High load averages on Lucid while idling

2010-09-01 Thread Rod
I didn't mean to imply that the occasional unresponsiveness was fixed by using the new test kernel, it was more of a hope. That hope was dashed a few days ago, while I was not around we experienced another spike that lasted for 1h 10 minutes during which the system was effectively externally unr

[Bug 574910] Re: High load averages on Lucid while idling

2010-09-01 Thread Marius Seritan
I have some Chef recipes that install nginx, ejabberd, monit, postfix and some ruby applications on a 32 bit system. I ran them on the latest Lucid image and the load went back to 12. I moved to Karmic and the load is 0. Unfortunately I need to release so I will just stay with Karmic until Maverick

[Bug 574910] Re: High load averages on Lucid while idling

2010-09-01 Thread Matthew
I've been experiencing times of high load reported when the machine is otherwise idle. I've also been experiencing sudden spikes in load (40+) when the machine is doing minimal work (CPU 50% idle), few processes running. Is anybody able to confirm whether or not the fix from 20100827 solves these

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-25 Thread Rod
I've been putting up with the high load averages for a few months now on our production system. I've also been experiencing what I thought was an unrelated problem but I've come to suspect is tied up with this bug: every now and again the system would appear to lock up and become unresponsive bu

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-24 Thread Matthew Gregg
When we switched to Lucid we had load averages go from 0.01, to 20+ and periods of time where the system would become unresponsive. Having moved back to Karmic with the same code base rebuilt on Karmic, load averages are back down. Our work load is heavy IO bound, both network and disk. -- High

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-24 Thread John Johansen
Matthew, What kind of work loads are you running, that may help us track down your issue. Al, sorry to hear that, note the code that causes the load average bug is now upstream so you may run into on any newer kernel if it has been built with CONFIG_NOHZ (tickless). We are still looking in

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-23 Thread slenova
@John Johansen, The new test kernel seems to have fixed the phantom load average bug for me. Here's two instances of my web server sitting idle: #1) Ubuntu 10.04 32-bit AMI with default kernel: up 1:22, 1 user, load average: 1.03, 1.02, 0.93 #2) Same AMI with new test kernel (aki-84b75ded): u

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-23 Thread Al Sutton
Just as a follow-on to my comment in #58. It's unlikely I'll be able to test this as we've now migrated everything away to a different distribution, so unfortunately I won't get a chance to try any new kernels. -- High load averages on Lucid while idling https://bugs.launchpad.net/bugs/574910 Yo

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-23 Thread Matthew Gregg
Lucid is still unusable on EC2 due to some real load issue. I still do not have time to properly help debug this, so for me to open other tickets won't be much help. -- High load averages on Lucid while idling https://bugs.launchpad.net/bugs/574910 You received this bug notification because you

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-23 Thread John Johansen
Just to be clear, The test kernel mentioned above fixes a bug with the way load is calculated on the -EC2 kernels in Lucid. The fix reverts a patch that was applied to Lucid for a different load accounting bug for tickless kernels. However the -EC2 kernels are not tickless and as such the accoun

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-22 Thread Marius Seritan
I am really eager to re-run my chef cookbooks on top of this fixed image. Where can we track the progress of the new EC2 AMIs? Marius -- High load averages on Lucid while idling https://bugs.launchpad.net/bugs/574910 You received this bug notification because you are a member of Ubuntu Bugs, whi

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-20 Thread John Johansen
I have submitted the fix for SRU and once it makes it through the SRU process we will have a new kernel. The fix is based on the patch in the test kernel previously posted and specifically addresses the phantom load reported in this bug. It does not address any other issue. If you are still expe

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-20 Thread John Johansen
** Description changed: + SRU Justification: + + Impact: + Fixes loadavg reporting on EC2. + + Fix: + This reverts commit 0d843425672f4d2dc99b9004409aae503ef4d39f which fixes a bug in load + accounting when a tickless (no idle HZ) kernel is used. However the Xen pa

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-13 Thread Al Sutton
I might give it a shot when I get some spare time next week. -- High load averages on Lucid while idling https://bugs.launchpad.net/bugs/574910 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@list

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-13 Thread Rod
Al, just before you posted about your lock-up, an instance of mine (not running one of these test kernels) was experiencing some difficulty in a US-EAST-1 availability zone, I think related to EBS, it had trouble accepting connections and running new processes for about 15 minutes and was magica

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-13 Thread Al Sutton
It was an AMI of our application which is based on the standard 10.04 LTS AMI and adds Tomcat6, Apache2, and PostgreSQL, and Suns Java 6 JDK. -- High load averages on Lucid while idling https://bugs.launchpad.net/bugs/574910 You received this bug notification because you are a member of Ubuntu Bu

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-13 Thread John Johansen
Al, which AMI where you using? -- High load averages on Lucid while idling https://bugs.launchpad.net/bugs/574910 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ub

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-13 Thread Al Sutton
It's been about 40 mins now and the end of the log for the instance just reads; init: plymouth main process (45) killed by SEGV signal cloud-init running: Fri, 13 Aug 2010 09:41:23 +. up 3.64 seconds mountall: Disconnected from Plymouth init: ureadahead-other main process (322) terminated wit

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-13 Thread Robert Coup
@Al: If you reboot it from the AWS console, updated system logs should show up 2-5 minutes later. Normally they have info on kernel panics and other badness. -- High load averages on Lucid while idling https://bugs.launchpad.net/bugs/574910 You received this bug notification because you are a mem

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-13 Thread Al Sutton
I tried the aki-84b75ded kernel on an EC2 instance running our AMI and it locked up within 10 mins. There's nothing in the EC2 system log to indicate why, and the instance became completely unresponsive to outside world so I couldn't use an existing session to look at the system logs. -- High lo

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-11 Thread Scott Moser
i386 kernels from jjohansen's kernel build of 2.6.32-308.14 are available now. ubuntu-lucid-i386-linux-image-2.6.32-308-ec2-v-2.6.32-308.14-kernel at: us-west-1 aki-92c594d7 us-east-1 aki-84b75ded eu-west-1 aki-e6d5ff92 ap-southeast-1 aki-af3f41fd -- High load averages on Lucid whi

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-11 Thread Alexandre Bourget
i386 would really be appreciated! thanks -- High load averages on Lucid while idling https://bugs.launchpad.net/bugs/574910 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https:/

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-11 Thread Al Sutton
Can you roll some 32 bit ones as well, we tend to use m1.small EC2 instances so I'd like to test in that environment -- High load averages on Lucid while idling https://bugs.launchpad.net/bugs/574910 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed t

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-11 Thread Scott Moser
I have 50 minutes of log from an otherwise idle instance running ubuntu- lucid-10.04-amd64-server-20100427.1 on aki-c8b258a1. $ while read loadavg < /proc/loadavg && echo "$(date): ${loadavg}" && sleep 10 ; do : ; done that shows highest load of 0.08 for a 1 minute period (the first field) and no

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-11 Thread John Johansen
There is a set of new test kernels for x86_64, if anyone is interested I can build them for i386 as well us-west-1 aki-06c59443 us-east-1 aki-c8b258a1 eu-west-1 aki-c0d4feb4 ap-southeast-1 aki-d13f4183 This kernel has so far been doing better for me. This does not mean you won'

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-11 Thread John Johansen
Chris, thanks for your comments and understanding, I am not going to speak particularly to tarnished image or how ready the 10.04 LTS was, I think those are some what relative. I can completely understand that bugs can be a W T F moment, and cause sever problems for some of our users. The fact i

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-09 Thread Chris
Al, John: Thanks for the information.I understand that people are trying to be helpful by posting the links on how load average is calculated. Using this information is like trying to back calculate interest, principal and term based on the last payment in an amortization schedule. If the *t

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-06 Thread John Johansen
So just some updates. Yes the code for calculating load averages has been checked and compared. Testing has been done to isolate where the bug is and Lucid without the Xen patchset is not exhibiting this behavior. I have been working towards a test kernel with an updated Xen patch set, hopefully

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-05 Thread Al Sutton
@Alex Maybe if the Ubuntu Cloud page didn't say; "Amazon EC2 fits perfectly with Ubuntu Enterprise Cloud's modularity, virtualisation capabilities, range of applications and optimised performance." people wouldn't get so passionate. http://www.ubuntu.com/cloud sets expectations of "optimised pe

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-05 Thread Alex Howells
I've spoken with John on IRC and the team are perfectly aware there is a problem. This is not in dispute. It takes time to track down these problems, and the time of a kernel developer is in high demand. I seriously doubt this is the only 'serious' bug affecting a decent number of users which is b

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-04 Thread flaccid
@Chris Thats not what I said at all. If you know how the load average is calculated, then you can look at what it is calculated from and then troubleshoot why the values are high. Work out the source of the bad performance. Do we actually know what this is yet? -- High load averages on Lucid w

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-04 Thread Josh Koenig
** Changed in: pantheon Importance: Critical => Medium -- High load averages on Lucid while idling https://bugs.launchpad.net/bugs/574910 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.u

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-04 Thread Chris
Load average is just a number. Aside from your "accounting errors" there are fundamental performance issues. How they relate I do not know. Since none of the "usual suspects" except for load average show up as issues (disk i/o, network i/o, memory swapping, etc) for me to troubleshoot (or kill

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-03 Thread flaccid
Has anyone looked at Ubuntu's code where the actual load average is calculated? If so where is this? Perhaps we should start from there, see http://en.wikipedia.org/wiki/Load_(computing)#Unix-style_load_calculation Testing is great, but we have already verified the incorrect averages. -- High l

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-03 Thread Chris
Jonas thank you for that information. I am aware of the resources to track down high load average. I have iftop/iotop/top/vmstat/iostat and sar installed. The article fails to mention vmstat and SAR at all. Iftop/top/iotop are useful only in that they all report that nothing is "hogging" the

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-03 Thread James Jonas
Hack and / - Linux Troubleshooting, Part I: High Load by Kyle Rankin Linux Journal http://www.linuxjournal.com/magazine/hack-and-linux-troubleshooting- part-i-high-load Just another resource for how to diagnose a high load on linux. James Jonas -- High load averages on Lucid while idling https

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-03 Thread Chris
IMHO, if the problem is exhibited without the EC2 code, then the EC2 code is just that much less code to interact with while debugging this issue. The act of 'adding it back in' is a distraction (more or less) at this point and effort should be placed on tracking down the high load average issue.

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-03 Thread SirFrankie
Same issue here, but maybe some intresting additionals. My note running 10.04 installed from CD (07.01), updated every time daily. Configuration: Dell Latitude E5400 4GB RAM, 2.5Ghz CPU, 250 GB HDD, 2 pcs ext4 fs, running sweet without any high load issue... This note has few installed Virtualbo

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-02 Thread Al Sutton
Scott, thanks for the update. As always I appreciate an open an honest answer. I can understand you can't predict how long it will take to fix the bug, but similarly we can't tell how long customers will continue to use the degraded service that is the best we could offer under 10.04 LTS, hence th

Re: [Bug 574910] Re: High load averages on Lucid while idling

2010-08-02 Thread Scott Moser
On Mon, 2 Aug 2010, Al Sutton wrote: > Can we have an update to confirm that; > > a) It's been agreed it's not "simply an accounting/reporting problem.", > and is something that impacts performance The ec2 issue definitely appears to not be simply accounting. Many of the comments on this bug are

[Bug 574910] Re: High load averages on Lucid while idling

2010-08-02 Thread Al Sutton
Can we have an update to confirm that; a) It's been agreed it's not "simply an accounting/reporting problem.", and is something that impacts performance and b) Details of whats being done to fix it So people, like myself, who are waiting for this to be resolved in order to switch back to 10.04

[Bug 574910] Re: High load averages on Lucid while idling

2010-07-29 Thread Chris
I should add: Note the change in kernel for my work host from my post on 7/27 to the one on 7/29. There is an improvement in retrograding kernels but it is still not like the 9.10 release. -- High load averages on Lucid while idling https://bugs.launchpad.net/bugs/574910 You received this bug

[Bug 574910] Re: High load averages on Lucid while idling

2010-07-29 Thread Chris
Not that this will do much to track down the issue, but I have some more case history. Today I was tidying up some vdi disks on my host system (work system running 10.04 w/ 2.6.31-17 on Core2 Duo E6750 2.66GHz 4GB ram). A disk to disk (two physical disks) copy of a 7.5GB vdi caused the load aver

[Bug 574910] Re: High load averages on Lucid while idling

2010-07-28 Thread Greg Coit
** Changed in: pantheon Status: Triaged => Confirmed -- High load averages on Lucid while idling https://bugs.launchpad.net/bugs/574910 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists

[Bug 574910] Re: High load averages on Lucid while idling

2010-07-28 Thread Greg Coit
** Changed in: pantheon Importance: Medium => Critical -- High load averages on Lucid while idling https://bugs.launchpad.net/bugs/574910 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.u

[Bug 574910] Re: High load averages on Lucid while idling

2010-07-27 Thread Chris
> John is working on trying to get this fixed. We believe, at this point, that it is simply an accounting/reporting problem. In a word: NO. With 10.04 as the base OS on the host and in a VB-vm the load average issues are tantamount to making the distribution unusable as shipped and only margina

[Bug 574910] Re: High load averages on Lucid while idling

2010-07-27 Thread Matthew Gregg
I unfortunately do not have the cycles currently to properly help debug this, but can only say we had significant load and performance issues with Lucid, that we did not have with Intrepid, nor do we have with Karmic(that we had to fall back to). -- High load averages on Lucid while idling https:

[Bug 574910] Re: High load averages on Lucid while idling

2010-07-27 Thread Alex Howells
That sounds unrelated to this bug and may be an issue with your software workload. I'm not seeing any fluctuation in memory usage beyond the fact it uses 15-20x more than a Karmic Koala kernel upon initial boot up. Are you able to post diagnostic output showing this isn't your workload causing the

[Bug 574910] Re: High load averages on Lucid while idling

2010-07-27 Thread Alexandre Bourget
I have the same problems. My load increases (to some really scary values, even as high as 45), and the number of processes too, and at some point, my MySQL server is being killed (but not always). I don't think it's just a reporting problem. -- High load averages on Lucid while idling https://b

[Bug 574910] Re: High load averages on Lucid while idling

2010-07-27 Thread Al Sutton
Thanks for the update. The performance of the EC2 10.04 images is noticeably slower than the 8.04 LTS ones we were running, so I'm pretty sure it's not just a case of the load being incorrectly reported, hence why I've been actively monitoring this issue. Given what you've said it seems unlikely t

Re: [Bug 574910] Re: High load averages on Lucid while idling

2010-07-27 Thread Scott Moser
On Tue, 27 Jul 2010, Al Sutton wrote: > John; Just so I'm clear, are you saying it's not going to be fixed until > 10.04.1 LTS (i.e. a few weeks away), or are we looking at several months > until 10.04.2? 10.04.1 is weeks away. It is not likely that a fix for this would make the cutoff for 10.04

[Bug 574910] Re: High load averages on Lucid while idling

2010-07-27 Thread Al Sutton
John; Just so I'm clear, are you saying it's not going to be fixed until 10.04.1 LTS (i.e. a few weeks away), or are we looking at several months until 10.04.2? -- High load averages on Lucid while idling https://bugs.launchpad.net/bugs/574910 You received this bug notification because you are a

[Bug 574910] Re: High load averages on Lucid while idling

2010-07-27 Thread John Johansen
Alex, I didn't expect it would make much of a difference either but was willing to try if for no other reason to rule it out. Al, the issue will persist until at least the next point release. -- High load averages on Lucid while idling https://bugs.launchpad.net/bugs/574910 You received this bug

[Bug 574910] Re: High load averages on Lucid while idling

2010-07-26 Thread flaccid
LTS only really applies to people that pay Canonical for support i.e. they only support LTS. Ubuntu also does not release bug fixes in package updates during a release. This basically means that LTS is worthless to the community and quite a big misnomer. -- High load averages on Lucid while idl

[Bug 574910] Re: High load averages on Lucid while idling

2010-07-26 Thread Chris
I too have problems with high load averages on "unloaded" systems. For a while I thought this was due to my running Ubuntu Lucid under Virtualbox. One of my hosts (violet) is a Virtuabox VM w/2.6.32-24-generic #38-Ubuntu SMP running. It has Firefox 3.6, Pigeon and a terminal window open . to

[Bug 574910] Re: High load averages on Lucid while idling

2010-07-24 Thread Al Sutton
For reference; I've just updated to linux-image-2.6.32-308-ec2 and the issue still persists. -- High load averages on Lucid while idling https://bugs.launchpad.net/bugs/574910 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bu

[Bug 574910] Re: High load averages on Lucid while idling

2010-07-23 Thread Alex Howells
Please note, as mentioned, I see exactly the same scheduler behaviour on my hardware with Karmic Koala - downgrading from the Lucid Lynx kernel fixes all my other issues though. Thus I'm not sure this is the actual problem. -- High load averages on Lucid while idling https://bugs.launchpad.net/bu

[Bug 574910] Re: High load averages on Lucid while idling

2010-07-23 Thread John Johansen
The bug isn't being ignored, but you are correct there is now official patch or solution to the problem. I am currently looking at building test kernels, which will include the scheduler patch referenced in https://bugs.edge.launchpad.net/ubuntu/+source/linux/+bug/524281 this will let us det

[Bug 574910] Re: High load averages on Lucid while idling

2010-07-21 Thread Al Sutton
This is getting silly. I currently have 2 Amazon EC2 instances running 10.04 LTS, both of which sit at around 1.0 load and can go to 4, and that's only serving a few users. They were "upgraded" from 8.04 LTS where the load rarely went above 0.5. I'm guessing as this hasn't been resolved for nearly

[Bug 574910] Re: High load averages on Lucid while idling

2010-07-19 Thread Alex Howells
Another bug over here is receiving more attention, and seems potentially linked -- https://bugs.edge.launchpad.net/ubuntu/+source/linux/+bug/524281 At the moment the only solution I've got is to revert to a Karmic Koala kernel, which is hardly ideal. Is there a reason this bug isn't receiving

[Bug 574910] Re: High load averages on Lucid while idling

2010-07-14 Thread vavrkok
** Also affects: linux Importance: Undecided Status: New -- High load averages on Lucid while idling https://bugs.launchpad.net/bugs/574910 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bug

[Bug 574910] Re: High load averages on Lucid while idling

2010-07-09 Thread Russell Branca
I'm running into the same issues on the Lucid 64bit EBS AMI, except with much higher load: $ uptime 18:06:22 up 18:31, 2 users, load average: 12.16, 13.54, 13.78 $ top -bn1 | head -20 top - 18:06:52 up 18:32, 2 users, load average: 11.53, 13.19, 13.65 Tasks: 108 total, 1 running, 107 slee