Re: Faster gecko builds with IceCC on Mac and Linux

2018-02-18 Thread Jean-Yves Avenard
Hi So I got this to work under all platforms (OS X , Ubuntu 17.10 and Windows 10) Stock speed, no OC of any type. macOS: 7m32s Windows 10: 12m20s Linux Ubuntu 17.10 (had to install kernel 4.15): 6m04s So not much better than the iMac Pro 10 cores… > On 2 Feb 2018, at 7:54 pm, Jean-Yves Avenar

Re: Faster gecko builds with IceCC on Mac and Linux

2018-02-02 Thread Jean-Yves Avenard
Hi > On 17 Jan 2018, at 12:38 am, Gregory Szorc wrote: > > On an EC2 c5.17xlarge (36+36 CPUs) running Ubuntu 17.10 and using Clang 5.0, > 9be7249e74fd does a clobber but configured `mach build` in 7:34. Rust is very > obviously the long pole in this build, with C++ compilation (not linking) >

Re: Faster gecko builds with IceCC on Mac and Linux

2018-01-31 Thread Randell Jesup
>On 1/16/18 2:59 PM, smaug wrote: >Would it be possible that when I do an hg pull of mozilla-central or >mozilla-inbound, I can also choose to download the object files from the >most recent ancestor that had an automation build? (It could be a separate >command, or ./mach pull.) They would go int

Re: Faster gecko builds with IceCC on Mac and Linux

2018-01-24 Thread Nicholas Alexander
> Would it be possible that when I do an hg pull of mozilla-central or > mozilla-inbound, I can also choose to download the object files from the > most recent ancestor that had an automation build? (It could be a separate > command, or ./mach pull.) They would go into a local ccache (or probabl

Re: Faster gecko builds with IceCC on Mac and Linux

2018-01-17 Thread Jeff Gilbert
It's way cheaper to get build clusters rolling than to get beefy hardware for every desk. Distributed compilation or other direct build optimizations also allow continued use of laptops for most devs, which definitely has value. On Wed, Jan 17, 2018 at 11:22 AM, Jean-Yves Avenard wrote: > > >> On

Re: Faster gecko builds with IceCC on Mac and Linux

2018-01-17 Thread Jean-Yves Avenard
> On 17 Jan 2018, at 8:14 pm, Ralph Giles wrote: > > Something simple with the jobserver logic might work here, but I think we > want to complete the long-term project of getting a complete dependency > graph available before looking at that kind of optimization. Just get every person needing

Re: Faster gecko builds with IceCC on Mac and Linux

2018-01-17 Thread Ralph Giles
On Wed, Jan 17, 2018 at 10:27 AM, Steve Fink wrote: > Would it be possible that when I do an hg pull of mozilla-central or > mozilla-inbound, I can also choose to download the object files from the > most recent ancestor that had an automation build? You mention 'artifact builds' so I assume y

Re: Faster gecko builds with IceCC on Mac and Linux

2018-01-17 Thread Simon Sapin
On 17/01/18 19:27, Steve Fink wrote: Would it be possible that when I do an hg pull of mozilla-central or mozilla-inbound, I can also choose to download the object files from the most recent ancestor that had an automation build? (It could be a separate command, or ./mach pull.) They would go int

Re: Faster gecko builds with IceCC on Mac and Linux

2018-01-17 Thread Steve Fink
On 1/16/18 2:59 PM, smaug wrote: On 01/16/2018 11:41 PM, Mike Hommey wrote: On Tue, Jan 16, 2018 at 10:02:12AM -0800, Ralph Giles wrote: On Tue, Jan 16, 2018 at 7:51 AM, Jean-Yves Avenard wrote: But I would be interested in knowing how long that same Lenovo P710 takes to compile *today*…

Re: Faster gecko builds with IceCC on Mac and Linux

2018-01-16 Thread Gregory Szorc
On Tue, Jan 16, 2018 at 1:42 PM, Ted Mielczarek wrote: > On Tue, Jan 16, 2018, at 10:51 AM, Jean-Yves Avenard wrote: > > Sorry for resuming an old thread. > > > > But I would be interested in knowing how long that same Lenovo P710 > > takes to compile *today*….> In the past 6 months, compilation

Re: Faster gecko builds with IceCC on Mac and Linux

2018-01-16 Thread smaug
On 01/16/2018 11:41 PM, Mike Hommey wrote: On Tue, Jan 16, 2018 at 10:02:12AM -0800, Ralph Giles wrote: On Tue, Jan 16, 2018 at 7:51 AM, Jean-Yves Avenard wrote: But I would be interested in knowing how long that same Lenovo P710 takes to compile *today*…. On my Lenovo P710 (2x2x6 core Xeo

Re: Faster gecko builds with IceCC on Mac and Linux

2018-01-16 Thread Ted Mielczarek
On Tue, Jan 16, 2018, at 10:51 AM, Jean-Yves Avenard wrote: > Sorry for resuming an old thread. > > But I would be interested in knowing how long that same Lenovo P710 > takes to compile *today*….> In the past 6 months, compilation times have > certainly increased > massively.> > Anyhow, I’ve re

Re: Faster gecko builds with IceCC on Mac and Linux

2018-01-16 Thread Mike Hommey
On Tue, Jan 16, 2018 at 10:02:12AM -0800, Ralph Giles wrote: > On Tue, Jan 16, 2018 at 7:51 AM, Jean-Yves Avenard > wrote: > > But I would be interested in knowing how long that same Lenovo P710 takes > > to compile *today*…. > > > > On my Lenovo P710 (2x2x6 core Xeon E5-2643 v4), Fedora 27 Linu

Re: Faster gecko builds with IceCC on Mac and Linux

2018-01-16 Thread Jean-Yves Avenard
> On 16 Jan 2018, at 8:19 pm, Jean-Yves Avenard wrote: > > > >> On 16 Jan 2018, at 7:02 pm, Ralph Giles > > wrote: >> >> On my Lenovo P710 (2x2x6 core Xeon E5-2643 v4), Fedora 27 Linux >> >> debug -Og build with gcc: 12:34 >> debug -Og build with clang: 12:55 >> op

Re: Faster gecko builds with IceCC on Mac and Linux

2018-01-16 Thread Gregory Szorc
Yes, most of the build time regressions in 2017 came from Rust. Leaning more heavily on C++ features that require more processing or haven't been optimized as much as C++ features that have been around for years is likely also contributing. Enabling sccache allows Rust compilations to be cached, w

Re: Faster gecko builds with IceCC on Mac and Linux

2018-01-16 Thread Ralph Giles
On Tue, Jan 16, 2018 at 11:19 AM, Jean-Yves Avenard wrote: 12 minutes sounds rather long, it’s about what the macpro is currently > doing. I typically get compilation times similar to mac... > Yes, I'd like to see 7 minute build times again too! The E5-2643 has a higher clock speed than the Xeon

Re: Faster gecko builds with IceCC on Mac and Linux

2018-01-16 Thread Jean-Yves Avenard
> On 16 Jan 2018, at 7:02 pm, Ralph Giles wrote: > > On my Lenovo P710 (2x2x6 core Xeon E5-2643 v4), Fedora 27 Linux > > debug -Og build with gcc: 12:34 > debug -Og build with clang: 12:55 > opt build with clang: 11:51 I didn’t succeed in booting linux unfortunately. so I can’t compare… 12 mi

Re: Faster gecko builds with IceCC on Mac and Linux

2018-01-16 Thread Ralph Giles
On Tue, Jan 16, 2018 at 7:51 AM, Jean-Yves Avenard wrote: But I would be interested in knowing how long that same Lenovo P710 takes > to compile *today*…. > On my Lenovo P710 (2x2x6 core Xeon E5-2643 v4), Fedora 27 Linux debug -Og build with gcc: 12:34 debug -Og build with clang: 12:55 opt buil

Re: Faster gecko builds with IceCC on Mac and Linux

2018-01-16 Thread Jean-Yves Avenard
Sorry for resuming an old thread. But I would be interested in knowing how long that same Lenovo P710 takes to compile *today*…. In the past 6 months, compilation times have certainly increased massively. Anyhow, I’ve received yesterday the iMac Pro I ordered early December. It’s a 10 cores Xeo

Re: Bigger hard drives wanted (was Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux))

2017-11-10 Thread Randell Jesup
>On 11/7/17 4:13 PM, Sophana "Soap" Aik wrote: >For the work I do (e.g. backporting security fixes every so often) I need a >release tree, a beta tree, and ESR tree, and at least 3 tip trees. That's >at least 150GB. If I want to have an effective ccache, that's about >20-30GB (recall that each ob

Re: Bigger hard drives wanted (was Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux))

2017-11-08 Thread Gregory Szorc
This thread is good feedback. I think changing the default to a 1TB SSD is a reasonable request. Please send any future comments regarding hardware to Sophana ( s...@mozilla.com) to increase the chances that feedback is acted on. On Wed, Nov 8, 2017 at 9:09 AM, Julian Seward wrote: > On 08/11/1

Re: Bigger hard drives wanted (was Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux))

2017-11-08 Thread Julian Seward
On 08/11/17 17:28, Boris Zbarsky wrote: > The last desktop I was shipped came with a 512 GB drive. [..] > > In practice, I routinely run out of disk space and have to delete > objdirs and rebuild them the next day, because I have to build > something else in a different srcdir... I totally agree

Re: Bigger hard drives wanted (was Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux))

2017-11-08 Thread Michael de Boer
I’d like to add the VM multiplier: I’m working mainly on OSX and run a Windows and a Linux VM in there with their own checkouts and objdirs. Instead of allocating a comfortable size virtual disks, I end up resizing them quite frequently to avoid running out of space to save as much as possible f

Bigger hard drives wanted (was Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux))

2017-11-08 Thread Boris Zbarsky
On 11/7/17 4:13 PM, Sophana "Soap" Aik wrote: Nothing is worse than hearing IT picked or chose hardware that nobody actually wanted or will use. If I could interject with a comment about the hardware we pick... The last desktop I was shipped came with a 512 GB drive. One of our srcdirs is ab

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-11-08 Thread Sophana "Soap" Aik
Thanks Jeff, I understand your reasoning. 14 cores vs 10 is definitely huge. I will also add, there isn't anything to stop us to having more than one config, just like we do with laptops. I'm fortunate to be in this situation to finally help you all have influence on the type of hardware that mak

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-11-08 Thread Sophana "Soap" Aik
Kris has touched on the many advantages of having a standard model. From what I am seeing with most people's use case scenario, only the GPU is what will determine what the machine is used for. IE: VR Research team may end up only needing a GPU upgrade. Fortunately the new W-Series Xeon's seem to

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-11-08 Thread Jean-Yves Avenard
With all this talk… I’m eagerly waiting for the iMac Pro. Best of all worlds really: - High core count - ECC RAM - 5K 27” display - Great graphic card - Super silent… I’ve been using a Mac Pro 2013 (the trash can one), Xeon E5 8 cores, 32 GB ECC RAM, connected to two 27” screens (one 5K with DP

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-11-08 Thread Jean-Yves Avenard
With all this talk… I’m eagerly waiting for the iMac Pro. Best of all worlds really: - High core count - ECC RAM - 5K 27” display - Great graphic card - Super silent… I’ve been using a Mac Pro 2013 (the trash can one), Xeon E5 8 cores, 32 GB ECC RAM, connected to two 27” screens (one 5K with DP

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-11-08 Thread Mike Hommey
On Wed, Nov 08, 2017 at 09:43:29AM +0200, Henri Sivonen wrote: > I agree that workstation GPUs should be avoided. Even if they were as > well supported by Linux distro-provided Open Source drivers as > consumer GPUs, it's at the very least more difficult to find > information about what's true abou

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-11-07 Thread Henri Sivonen
I agree that workstation GPUs should be avoided. Even if they were as well supported by Linux distro-provided Open Source drivers as consumer GPUs, it's at the very least more difficult to find information about what's true about them. We don't need the GPU to be at max spec like we need the CPU t

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-11-07 Thread Jeff Muizelaar
The Core i9s are a quite a bit cheaper than the Xeon Ws: https://ark.intel.com/products/series/125035/Intel-Xeon-Processor-W-Family vs https://ark.intel.com/products/126695 I wouldn't want to trade ECC for 4 cores. -Jeff On Tue, Nov 7, 2017 at 3:51 PM, Sophana "Soap" Aik wrote: > Kris has touch

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-11-07 Thread Jeff Gilbert
If you don't want to get into the weeds on ECC again, please do not reinitiate discussion. I do not agree that "the additional cost of ECC is very low compared to the cost of developer time over the two years that they're expected to use it", but I will restrict my disagreement to the forked thread

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-11-07 Thread Kris Maglione
On Tue, Nov 07, 2017 at 03:07:55PM -0500, Jeff Muizelaar wrote: On Mon, Nov 6, 2017 at 1:32 PM, Sophana "Soap" Aik wrote: Hi All, I'm in the middle of getting another evaluation machine with a 10-core W-Series Xeon Processor (that is similar to the 7900X in terms of clock speed and performance

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-11-07 Thread Jeff Gilbert
Avoid workstation GPUs if you can. At best, they're just a more expensive consumer GPU. At worst, they may sacrifice performance we care about in their optimization for CAD and modelling workloads, in addition to moving us further away from testing what our users use. We have no need for workstatio

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-11-07 Thread Jeff Muizelaar
On Mon, Nov 6, 2017 at 1:32 PM, Sophana "Soap" Aik wrote: > Hi All, > > I'm in the middle of getting another evaluation machine with a 10-core > W-Series Xeon Processor (that is similar to the 7900X in terms of clock > speed and performance) but with ECC memory support. > > I'm trying to make sure

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-11-07 Thread Sophana "Soap" Aik
Hi All, I'm in the middle of getting another evaluation machine with a 10-core W-Series Xeon Processor (that is similar to the 7900X in terms of clock speed and performance) but with ECC memory support. I'm trying to make sure this is a "one size fits all" machine as much as possible. Also there

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-11-06 Thread Jeff Gilbert
My understanding of current policy is that ECC is not required. (and not even an option with MacBook Pros) Given the volume of development that happens unhindered on our developers' many, many non-ECC machines, I believe the burden of proof-of-burden is on the pro-ECC argument to show that it's lik

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-11-06 Thread Gabriele Svelto
On 06/11/2017 22:44, Jeff Gilbert wrote: > Price matters, since every dollar we spend chasing ECC would be a > dollar we can't allocate towards perf improvements, hardware refresh > rate, or simply more machines for any build clusters we may want. And every day our developers or IT staff waste cha

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-11-06 Thread Jeff Gilbert
Price matters, since every dollar we spend chasing ECC would be a dollar we can't allocate towards perf improvements, hardware refresh rate, or simply more machines for any build clusters we may want. The paper linked above addresses massive compute clusters, which seems to have limited implicatio

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-11-06 Thread Gregory Szorc
> On Nov 6, 2017, at 05:19, Gabriele Svelto wrote: > >> On 04/11/2017 01:10, Jeff Gilbert wrote: >> Clock speed and core count matter much more than ECC. I wouldn't chase >> ECC support for general dev machines. > > The Xeon-W SKUs I posted in the previous thread all had identical or > higher

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-11-06 Thread Gabriele Svelto
On 04/11/2017 01:10, Jeff Gilbert wrote: > Clock speed and core count matter much more than ECC. I wouldn't chase > ECC support for general dev machines. The Xeon-W SKUs I posted in the previous thread all had identical or higher clock speeds than equivalent Core i9 SKUs and ECC support with the s

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-11-06 Thread Henri Sivonen
Thank you for including an AMD card among the ones to be tested. - - The Radeon RX 460 mentioned earlier in this thread arrived. There was again enough weirdness that I think it's worth sharing in case it saves time for someone else: Initially, for multiple rounds of booting with different cable

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-11-03 Thread Jeff Gilbert
Clock speed and core count matter much more than ECC. I wouldn't chase ECC support for general dev machines. On Thu, Nov 2, 2017 at 6:46 PM, Gregory Szorc wrote: > On Thu, Nov 2, 2017 at 3:43 PM, Nico Grunbaum wrote: > >> For rr I have an i7 desktop with a base clock of 4.0 Ghz, and for building

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-11-02 Thread Gregory Szorc
On Thu, Nov 2, 2017 at 3:43 PM, Nico Grunbaum wrote: > For rr I have an i7 desktop with a base clock of 4.0 Ghz, and for building > I use icecc to distribute the load (or rather I will be again when bug > 1412240[0] is closed). The i9 series has lower base clocks (2.8 Ghz, and > 2.6Ghz for the t

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-11-02 Thread Nico Grunbaum
For rr I have an i7 desktop with a base clock of 4.0 Ghz, and for building I use icecc to distribute the load (or rather I will be again when bug 1412240[0] is closed).  The i9 series has lower base clocks (2.8 Ghz, and 2.6Ghz for the top SKUs)[1], but high boost clocks of 4.2 Ghz.  If I were t

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-10-28 Thread Sophana "Soap" Aik
Thanks Gabriele, that poses a problem then for the system build we have in mind here as the i9's do not support ECC memory. That may have to be a separate system with a Xeon. On Fri, Oct 27, 2017 at 3:58 PM, Gabriele Svelto wrote: > On 27/10/2017 01:02, Gregory Szorc wrote: > > Sophana (CCd) is

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-10-28 Thread Sophana "Soap" Aik
Thank you Henri for the feedback. How about this, we can order some graphics cards and put them in the evaluation/test machine that is with Greg, to make sure it has good compatibility. We could do: Nvidia GTX 1060 3GB AMD Radeon RX570 These two options will ensure it can drive multi displays.

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-10-28 Thread Sophana "Soap" Aik
Hello everyone, great feedback that I will keep in mind and continue to work with our vendors to find the best solution with. One of the cards that I was looking at is fairly cheap and can at least drive multi-displays (even 4K 60hz) was the Nvidia Quadro P600. I feel especially based on the work t

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-10-27 Thread Robert O'Callahan
BTW can someone forward this entire thread to their friends at AMD so AMD will fix their CPUs to run rr? They're tantalizingly close :-/. Rob -- lbir ye,ea yer.tnietoehr rdn rdsme,anea lurpr edna e hnysnenh hhe uresyf toD selthor stor edna siewaoeodm or v sstvr esBa kbvted,t rdsme,aoreseo

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-10-27 Thread Gabriele Svelto
On 28/10/2017 01:08, Sophana "Soap" Aik wrote: > Thanks Gabriele, that poses a problem then for the system build we have > in mind here as the i9's do not support ECC memory. That may have to be > a separate system with a Xeon. Xeon-W processors are identical to the i9 but come with more workstati

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-10-27 Thread Gregory Szorc
Yeah. Only the Xeons and ThreadRipper (as our potential high core count machines) support ECC. rr, ECC, or reasonable costs: pick at most two :/ On Fri, Oct 27, 2017 at 4:08 PM, Sophana "Soap" Aik wrote: > Thanks Gabriele, that poses a problem then for the system build we have in > mind here as

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-10-27 Thread Gabriele Svelto
On 27/10/2017 01:02, Gregory Szorc wrote: > Sophana (CCd) is working on a new system build right now. It will be based > on the i9's instead of dual socket Xeons and should be faster and cheaper. ... and lacking ECC memory. Please whatever CPU is chosen make sure it has ECC support and the machine

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-10-27 Thread Steve Fink
Not necessarily relevant to this specific discussion, but I'm on a Lenovo P50 running Linux, and wanted to offer up my setup as a datapoint. (It's not quite either a recommendation or a word of warning. A combination.) I use Linux (Fedora 25) as the host OS, with two external monitors plus th

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-10-27 Thread Robert O'Callahan
On Fri, Oct 27, 2017 at 2:34 AM, Henri Sivonen wrote: > And the downsides don't even end there. rr didn't work. Plus other > stuff not worth mentioning here. > Turns out that rr not working with Nvidia on Ubuntu 17.10 was actually an rr issue triggered by the Ubuntu libc upgrade, not Nvidia's fa

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-10-26 Thread Henri Sivonen
On Fri, Oct 27, 2017 at 4:48 AM, Sophana "Soap" Aik wrote: > Hello everyone, great feedback that I will keep in mind and continue to work > with our vendors to find the best solution with. One of the cards that I was > looking at is fairly cheap and can at least drive multi-displays (even 4K > 60h

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-10-26 Thread Gregory Szorc
On Thu, Oct 26, 2017 at 4:31 PM, Mike Hommey wrote: > On Thu, Oct 26, 2017 at 04:02:20PM -0700, Gregory Szorc wrote: > > Also, the machines come with Windows by default. That's by design: that's > > where the bulk of Firefox users are. We will develop better products if > the > > machines we use

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-10-26 Thread Mike Hommey
On Thu, Oct 26, 2017 at 04:02:20PM -0700, Gregory Szorc wrote: > Also, the machines come with Windows by default. That's by design: that's > where the bulk of Firefox users are. We will develop better products if the > machines we use every day resemble what actual users use. I would encourage > de

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-10-26 Thread Jeff Muizelaar
On Thu, Oct 26, 2017 at 7:02 PM, Gregory Szorc wrote: > I also share your desire to not issue fancy video cards in these machines > by default. If there are suggestions for a default video card, now is the > time to make noise :) Intel GPUs are the best choice if you want to be like bulk of our u

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-10-26 Thread Jeff Muizelaar
On Thu, Oct 26, 2017 at 7:02 PM, Gregory Szorc wrote: > Unless you have requirements that prohibit using a > VM, I encourage using this setup. rr doesn't work in hyper-v. AFAIK the only Windows VM it works in is VMWare -Jeff ___ dev-platform mailing li

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-10-26 Thread Gregory Szorc
On Thu, Oct 26, 2017 at 6:34 AM, Henri Sivonen wrote: > On Thu, Oct 26, 2017 at 9:15 AM, Henri Sivonen > wrote: > > There's a huge downside, though: > > If the screen stops consuming the DisplayPort data stream, the > > graphical session gets killed! So if you do normal things like turn > > the

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-10-26 Thread Thomas Daede
On 10/26/2017 06:34 AM, Henri Sivonen wrote: > As for the computer at hand, I want to put an end to this Nvidia > obstacle to getting stuff done. It's been suggested to me that Radeon > RX 560 would be well supported by distro-provided drivers, but the > "*2" footnote at https://help.ubuntu.com/com

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-10-26 Thread Nathan Froyd
On Thu, Oct 26, 2017 at 9:34 AM, Henri Sivonen wrote: > As for the computer at hand, I want to put an end to this Nvidia > obstacle to getting stuff done. It's been suggested to me that Radeon > RX 560 would be well supported by distro-provided drivers, but the > "*2" footnote at https://help.ubun

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-10-26 Thread Jeff Muizelaar
Yeah. I'd suggest anyone who's running Linux on these machines just go out and buy a $100 AMD GPU to replace the Quadro. Even if you don't expense the new GPU and just throw the Quadro in the trash you'll probably be happier. -Jeff On Thu, Oct 26, 2017 at 9:34 AM, Henri Sivonen wrote: > On Thu,

Re: More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-10-26 Thread Henri Sivonen
On Thu, Oct 26, 2017 at 9:15 AM, Henri Sivonen wrote: > There's a huge downside, though: > If the screen stops consuming the DisplayPort data stream, the > graphical session gets killed! So if you do normal things like turn > the screen off or switch input on a multi-input screen, your graphical >

More ThinkStation P710 Nvidia tips (was Re: Faster gecko builds with IceCC on Mac and Linux)

2017-10-25 Thread Henri Sivonen
On Thu, Mar 23, 2017 at 3:43 PM, Henri Sivonen wrote: > On Wed, Jul 6, 2016 at 2:42 AM, Gregory Szorc wrote: >> The Lenovo ThinkStation P710 is a good starting point ( >> http://shop.lenovo.com/us/en/workstations/thinkstation/p-series/p710/). > > To help others who follow the above advice save so

Re: Faster gecko builds with IceCC on Mac and Linux

2017-03-24 Thread Ted Mielczarek
On Fri, Mar 24, 2017, at 12:10 AM, Jeff Muizelaar wrote: > I have a Ryzen 7 1800 X and it does a Windows clobber builds in ~20min > (3 min of that is configure which seems higher than what I've seen on > other machines). This compares pretty favorably to the Lenovo p710 > machines that people are g

Re: Faster gecko builds with IceCC on Mac and Linux

2017-03-24 Thread Gabriele Svelto
On 24/03/2017 05:39, Gregory Szorc wrote: > The introduction of Ryzen has literally changed the landscape > and the calculus that determines what hardware engineers should have. > Before I disappeared for ~1 month, I was working with IT and management to > define an optimal hardware load out for Fi

Re: Faster gecko builds with IceCC on Mac and Linux

2017-03-23 Thread Gregory Szorc
On Thu, Mar 23, 2017 at 9:10 PM, Jeff Muizelaar wrote: > I have a Ryzen 7 1800 X and it does a Windows clobber builds in ~20min > (3 min of that is configure which seems higher than what I've seen on > other machines). Make sure your power settings are aggressive. Configure and its single-core

Re: Faster gecko builds with IceCC on Mac and Linux

2017-03-23 Thread Jeff Muizelaar
On Thu, Mar 23, 2017 at 11:42 PM, Robert O'Callahan wrote: > On Fri, Mar 24, 2017 at 1:12 PM, Ehsan Akhgari > wrote: >> On Thu, Mar 23, 2017 at 7:51 PM, Jeff Gilbert wrote: >> >>> I'm interested to find out how the new Ryzen chips do. It should fit >>> their niche well. I have one at home now,

Re: Faster gecko builds with IceCC on Mac and Linux

2017-03-23 Thread Jeff Muizelaar
I have a Ryzen 7 1800 X and it does a Windows clobber builds in ~20min (3 min of that is configure which seems higher than what I've seen on other machines). This compares pretty favorably to the Lenovo p710 machines that people are getting which do 18min clobber builds and cost more than twice the

Re: Faster gecko builds with IceCC on Mac and Linux

2017-03-23 Thread Robert O'Callahan
On Fri, Mar 24, 2017 at 1:12 PM, Ehsan Akhgari wrote: > On Thu, Mar 23, 2017 at 7:51 PM, Jeff Gilbert wrote: > >> I'm interested to find out how the new Ryzen chips do. It should fit >> their niche well. I have one at home now, so I'll test when I get a >> chance. >> > > Ryzen currently on Linux

Re: Faster gecko builds with IceCC on Mac and Linux

2017-03-23 Thread Ehsan Akhgari
On Thu, Mar 23, 2017 at 7:51 PM, Jeff Gilbert wrote: > I'm interested to find out how the new Ryzen chips do. It should fit > their niche well. I have one at home now, so I'll test when I get a > chance. > Ryzen currently on Linux implies no rr, so beware of that. > On Wed, Jul 6, 2016 at 12:0

Re: Faster gecko builds with IceCC on Mac and Linux

2017-03-23 Thread Jeff Gilbert
They're basically out of stock now, but if you can find them, old refurbished 2x Intel Xeon E5-2670 (2.6GHz Eight Core) machines were bottoming out under $1000/ea. It happily does GCC builds in 8m, and I have clang builds down to 5.5. As the v2s leave warranty, similar machines may hit the market a

Re: Faster gecko builds with IceCC on Mac and Linux

2017-03-23 Thread Henri Sivonen
On Wed, Jul 6, 2016 at 2:42 AM, Gregory Szorc wrote: > The Lenovo ThinkStation P710 is a good starting point ( > http://shop.lenovo.com/us/en/workstations/thinkstation/p-series/p710/). To help others who follow the above advice save some time: Xeons don't have Intel integrated GPUs, so one has t

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-06 Thread Trevor Saunders
On Tue, Jul 05, 2016 at 04:42:09PM -0700, Gregory Szorc wrote: > On Tue, Jul 5, 2016 at 3:58 PM, Ralph Giles wrote: > > > On Tue, Jul 5, 2016 at 3:36 PM, Gregory Szorc wrote: > > > > > * `mach build binaries` (touch network/dns/DNS.cpp): 14.1s > > > > 24s here. So faster link times and significa

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-06 Thread Chris H-C
> We're actively looking into a Telemetry-like system for mach and the build system. I heartily endorse this event or product and would like to subscribe to your newsletter. Chris On Wed, Jul 6, 2016 at 2:41 PM, Gregory Szorc wrote: > We're actively looking into a Telemetry-like system for mac

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-06 Thread Gregory Szorc
We're actively looking into a Telemetry-like system for mach and the build system. On Wed, Jul 6, 2016 at 9:00 AM, Chris H-C wrote: > Are there any scripts for reporting, analysing build times reported by > mach? I think this would be really useful data to have, especially to track > build syste

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-06 Thread Chris H-C
Are there any scripts for reporting, analysing build times reported by mach? I think this would be really useful data to have, especially to track build system improvements (and regressions) as well as poorly-supported configurations. Chris On Tue, Jul 5, 2016 at 7:42 PM, Gregory Szorc wrote: >

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-05 Thread Gregory Szorc
On Tue, Jul 5, 2016 at 3:58 PM, Ralph Giles wrote: > On Tue, Jul 5, 2016 at 3:36 PM, Gregory Szorc wrote: > > > * `mach build binaries` (touch network/dns/DNS.cpp): 14.1s > > 24s here. So faster link times and significantly faster clobber times. I'm > sold! > > Any motherboard recommendations? I

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-05 Thread Lawrence Mandel
On Tue, Jul 5, 2016 at 6:58 PM, Ralph Giles wrote: > On Tue, Jul 5, 2016 at 3:36 PM, Gregory Szorc wrote: > > > * `mach build binaries` (touch network/dns/DNS.cpp): 14.1s > > 24s here. So faster link times and significantly faster clobber times. I'm > sold! > > Any motherboard recommendations? I

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-05 Thread Xidorn Quan
On Wed, Jul 6, 2016, at 05:12 AM, Gregory Szorc wrote: > On Tue, Jul 5, 2016 at 11:08 AM, Steve Fink wrote: > > > I work remotely, normally from my laptop, and I have a single (fairly > > slow) desktop usable as a compile server. > > Gecko developers should have access to 8+ modern cores to comp

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-05 Thread Ralph Giles
On Tue, Jul 5, 2016 at 3:36 PM, Gregory Szorc wrote: > * `mach build binaries` (touch network/dns/DNS.cpp): 14.1s 24s here. So faster link times and significantly faster clobber times. I'm sold! Any motherboard recommendations? If we want developers to use machines like this, maintaining a curr

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-05 Thread Gregory Szorc
On Tue, Jul 5, 2016 at 2:37 PM, Ralph Giles wrote: > On Tue, Jul 5, 2016 at 12:12 PM, Gregory Szorc wrote: > > > I recommend 2x Xeon E5-2637v4 or E5-2643v4. > > For comparison's sake, what kind of routine and clobber build times do > you see on a system like this? How much does the extra cache

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-05 Thread Gregory Szorc
On Tue, Jul 5, 2016 at 2:27 PM, Chris Pearce wrote: > It would be cool if, once distributed compilation is reliable, if `./mach > mercurial-setup` could 1. prompt you enable using the local network's > infrastructure for compilation, and 2. prompt you to enable sharing your > CPUs with the local

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-05 Thread Gregory Szorc
On Tue, Jul 5, 2016 at 2:33 PM, Masatoshi Kimura wrote: > Oh, my laptop has only 4 core and I won't buy a machine or a compiler > farm account only to develope Gecko because my machine works perfectly > for all my other puoposes. > > This is not the first time you blame my poor hardware. Mozilla

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-05 Thread Ralph Giles
On Tue, Jul 5, 2016 at 12:12 PM, Gregory Szorc wrote: > I recommend 2x Xeon E5-2637v4 or E5-2643v4. For comparison's sake, what kind of routine and clobber build times do you see on a system like this? How much does the extra cache on Xeon help vs something like a 4 GHz i7? My desktop machine

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-05 Thread Masatoshi Kimura
Oh, my laptop has only 4 core and I won't buy a machine or a compiler farm account only to develope Gecko because my machine works perfectly for all my other puoposes. This is not the first time you blame my poor hardware. Mozilla (you are a Mozilla employee, aren't you?) does not want my contribu

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-05 Thread Chris Pearce
It would be cool if, once distributed compilation is reliable, if `./mach mercurial-setup` could 1. prompt you enable using the local network's infrastructure for compilation, and 2. prompt you to enable sharing your CPUs with the local network for compilation. Distributing a Windows-friendly v

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-05 Thread Gregory Szorc
On Tue, Jul 5, 2016 at 11:08 AM, Steve Fink wrote: > I work remotely, normally from my laptop, and I have a single (fairly > slow) desktop usable as a compile server. > Gecko developers should have access to 8+ modern cores to compile Gecko. Full stop. The cores can be local (from a home office)

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-05 Thread Steve Fink
I work remotely, normally from my laptop, and I have a single (fairly slow) desktop usable as a compile server. (Which I normally leave off, but when I'm doing a lot of compiling I'll turn it on. It's old and power-hungry.) I used distcc for a long time, but more recently have switched to icec

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-05 Thread Gregory Szorc
On Tue, Jul 5, 2016 at 7:07 AM, Michael Layzell wrote: > I'm certain it's possible to get a windows build working, the problem is > that: > > a) We would need to modify the client to understand cl-style flags (I don't > think it does right now) > b) We would need to create the environment tarball

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-05 Thread Michael Layzell
I'm certain it's possible to get a windows build working, the problem is that: a) We would need to modify the client to understand cl-style flags (I don't think it does right now) b) We would need to create the environment tarball c) We would need to make sure everything runs on windows None of t

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-04 Thread Xidorn Quan
I hope it could support MSVC one day as well, and support distribute any job to macOS machines as well. In my case, I use Windows as my main development environment, and I have a personally powerful enough MacBook Pro. (Actually I additionally have a retired MBP which should still work.) And if it

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-04 Thread Benoit Girard
In my case I'm noticing an improvement with my mac distributing jobs to a single Ubuntu machine but not compiling itself (Right now we don't support distributing mac jobs to other mac, primarily because we just want to maintain one homogeneous cluster). On Mon, Jul 4, 2016 at 5:12 PM, Gijs Kruitbo

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-04 Thread Michael Layzell
I'm pretty sure he means one extra machine. For example, if you have a laptop and a desktop, just adding the desktop into the network at home will still dramatically improve build times (I think). On Mon, Jul 4, 2016 at 5:12 PM, Gijs Kruitbosch wrote: > On 04/07/2016 22:06, Benoit Girard wrote:

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-04 Thread Gijs Kruitbosch
On 04/07/2016 22:06, Benoit Girard wrote: So to emphasize, if you compile a lot and only have one or two machines on your 100mps or 1gbps LAN you'll still see big benefits. I don't understand how this benefits anyone with just one machine (that's compatible...) - there's no other machines to

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-04 Thread Benoit Girard
This barely works in a office with 10MB/sec wireless uplink. Ideally you want machines to be accessible on a gigabit LAN. It's more about bandwidth throughput than latency AFAIK. i.e. can you *upload* dozens of 2-4MB compressed pre-processed file faster than you compile it? I'd imagine unless you c

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-04 Thread David Burns
Yes! Part of the build project work that I regularly email this list[1] we have it on our roadmap to have the same distributed cache that we use in automation available for engineers who are working on C++ code. We have completed our rewrite and will be putting the initial work through try over th

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-04 Thread Ralph Giles
On Mon, Jul 4, 2016 at 1:39 PM, Gijs Kruitbosch wrote: > What about people not lucky enough to (regularly) work in an office, > including but not limited to our large number of volunteers? Do we intend to > set up something public for people to use? By all accounts, the available distributed com

Re: Faster gecko builds with IceCC on Mac and Linux

2016-07-04 Thread Gijs Kruitbosch
What about people not lucky enough to (regularly) work in an office, including but not limited to our large number of volunteers? Do we intend to set up something public for people to use? ~ Gijs On 04/07/2016 20:09, Michael Layzell wrote: If you saw the platform lightning talk by Jeff and Eh

  1   2   >