Re: Google and Python

On Sep 24, 10:40 am, [EMAIL PROTECTED] (Alex Martelli) wrote: > > Good motto. So is most of Google's code base now in > > Python? About what is the ratio of Python code to C++ > > code? Of course lines of code is kine of a bogus measure. > > Of all those cycles Google executes, about what portion >

Load balancing and passing sockets; was: Re: Google and Python

Hendrik van Rooyen wrote: > "Nick Craig-Wood" wrote: [about passing sockets between processes] >> It is trivial to pass a socket to a new thread or a forked child - you >> don't need this mechanism for that. It doesn't work on different >> machines though - it has to be on the same machine. > >

Re: Google and Python

> > It is trivial to pass a socket to a new thread or a forked child - you > > don't need this mechanism for that. It doesn't work on different > > machines though - it has to be on the same machine. > > 8< - nice explanation by Nick--- > > How does a very large vol

Re: Google and Python

"Nick Craig-Wood" wrote: > Hendrik van Rooyen wrote: > > "Paul Rubin" wrote: > > > > > "Hendrik van Rooyen" writes: > > Ok got it - so instead of starting a thread, as is current practice, you fork > > a process (possibly on another machine) and "hand over" the clie

Re: Google and Python

Hendrik van Rooyen <[EMAIL PROTECTED]> wrote: > "Paul Rubin" wrote: > > > "Hendrik van Rooyen" writes: > > > What is the advantage of passing the open file rather than just the > > > fully qualified file name and having the other process open the > > > file itself? > > > > The idea

Re: Google and Python

"Paul Rubin" wrote: > "Hendrik van Rooyen" writes: > > What is the advantage of passing the open file rather than just the > > fully qualified file name and having the other process open the > > file itself? > > The idea is that the application is a web server. The socket listener >

Re: Google and Python

Paul Rubin wrote: > You can also pass the open sockets around between processes instead of > reverse proxying, using the SCM_RIGHTS message on Unix domain sockets > under Linux, or some similar mechanism under other Unixes (no idea > about Windows). Python does not currently support this but one o

Re: Google and Python

Alex Martelli wrote: > Bryan Olson <[EMAIL PROTECTED]> wrote: >... >>> YouTube (one of Google's most valuable properties) is essentially >>> all-Python (except for open-source infrastructure components such as >>> lighttpd). Also, at Google I'm specifically "Uber Tech Lead, Production >>> Syst

Re: Google and Python

Hendrik van Rooyen wrote: > "Nick Craig-Wood" wrote: > >> Passing file descriptors between processes is one of those things I've >> always meant to have a go with, but the amount of code (in Advanced >> Programming in the Unix Environment) needed to implement it is rather >> disconcerting! A pyt

Re: Google and Python

"Hendrik van Rooyen" <[EMAIL PROTECTED]> writes: > What is the advantage of passing the open file rather than just the > fully qualified file name and having the other process open the > file itself? The idea is that the application is a web server. The socket listener accepts connections and han

Re: Google and Python

"Nick Craig-Wood" wrote: > Passing file descriptors between processes is one of those things I've > always meant to have a go with, but the amount of code (in Advanced > Programming in the Unix Environment) needed to implement it is rather > disconcerting! A python module to do it would be great

Re: Google and Python

Bryan Olson <[EMAIL PROTECTED]> wrote: ... > > YouTube (one of Google's most valuable properties) is essentially > > all-Python (except for open-source infrastructure components such as > > lighttpd). Also, at Google I'm specifically "Uber Tech Lead, Production > > Systems": while I can't discu

Re: Google and Python

Paul Rubin wrote: > David <[EMAIL PROTECTED]> writes: > > Another method is for the apps to run continuously and serve on non-80 > > port (or on 80 from another host), and your main web server on port 80 > > reverse proxies to it when appropriate. > > You can also pass the open sockets around b

Re: Google and Python

Alex Martelli wrote: > Bryan Olson wrote: [...] >> How does Google use Python? As their scripting-language >> of choice. A fine choice, but just a tiny little piece. >> >> Maybe Alex will disagree with me. In my short time at >> Google, I was uber-nobody. > > YouTube (one of Google's most valuable

Re: Google and Python

David <[EMAIL PROTECTED]> writes: > Another method is for the apps to run continuously and serve on non-80 > port (or on 80 from another host), and your main web server on port 80 > reverse proxies to it when appropriate. You can also pass the open sockets around between processes instead of rever

Re: Google and Python

> OK, thanks. Would you know what technique the custom web server uses > to invoke a C++ app (ditto for Java and Python) CGI is supposed to be > too slow for large sites. For large sites you would have modules loaded into your web server so that executables don't have to be shelled for each reques

Re: Google and Python

Bryan Olson <[EMAIL PROTECTED]> wrote: ... > TheFlyingDutchman asked of someone: > > Would you know what technique the custom web server uses > > to invoke a C++ app > > No, I expect he would not know that. I can tell you > that GWS is just for Google, and anyone else is almost > certainly bet

Re: Google and Python

TheFlyingDutchman asked of someone: > Would you know what technique the custom web server uses > to invoke a C++ app No, I expect he would not know that. I can tell you that GWS is just for Google, and anyone else is almost certainly better off with Apache. > (ditto for Java and Python) CGI is s

Re: Google and Python

"TheFlyingDutchman" <[EMAIL PROTECTED]> wrote: > Around 2000 I heard that Google was using Python to some extent. Now I > see that Guido Van Rossum works for them as well as Alex Martellis 8< - - It seems that s

Re: Google and Python

On Sep 19, 2007, at 4:01 PM, TheFlyingDutchman wrote: > On Sep 19, 1:02 pm, Erik Jones <[EMAIL PROTECTED]> wrote: >> is usually Apache at most sites? >> >> No an http server and application server are two different things. >> An http server services requests of a web server those requests can >> b

Re: Google and Python

On Sep 19, 1:02 pm, Erik Jones <[EMAIL PROTECTED]> wrote: > is usually Apache at most sites? > > No an http server and application server are two different things. > An http server services requests of a web server those requests can > be for static files or for services of a local application

Re: Google and Python

On Sep 19, 2007, at 2:44 PM, TheFlyingDutchman wrote: > >> Have you tried Google "google python". Turns up a lot of links >> for me. >> > I had done it on this newsgroup, but not google. I did find a pretty > good link: > > http://panela.blog-city.com/python_at_google_greg_stein__sdforum.htm >

Re: Google and Python

> Have you tried Google "google python". Turns up a lot of links for me. > I had done it on this newsgroup, but not google. I did find a pretty good link: http://panela.blog-city.com/python_at_google_greg_stein__sdforum.htm Which says: "A few services including code.google.com and google groups

Re: Google and Python

TheFlyingDutchman wrote: > Around 2000 I heard that Google was using Python to some extent. Now I > see that Guido Van Rossum works for them as well as Alex Martellis who > has the title "Uber Technical Lead" which seems to imply some fairly > heavy Python usage there. I was wondering what is done

Google and Python

Around 2000 I heard that Google was using Python to some extent. Now I see that Guido Van Rossum works for them as well as Alex Martellis who has the title "Uber Technical Lead" which seems to imply some fairly heavy Python usage there. I was wondering what is done at Google with Python and which P