Hi,
I am hoping someone is able to help me.
Is there a way to pull as much raw data from a website as possible. The webpage
that I am looking for is as follows:
http://www.homepriceguide.com.au/Research/ResearchSeeFullList.aspx?LocationType=LGA&State=QLD&LgaID=632
The main variable that is i
On 08/19/2016 06:11 PM, Wildman via Python-list wrote:
Since I am fairly new to Python, I realize there is much that I
still don't know but I don't understand how Windows can have
reserved names on a Linux system. What am I missing?
A PureWindowsPath (and PurePosixPath and PurePath) is a theo
On 2016-08-22, Larry Martell wrote:
> On Mon, Aug 22, 2016 at 1:25 PM, Jon Ribbens
> wrote:
>> On 2016-08-22, Larry Martell wrote:
>>> (Pdb) type(request.POST[key])
>>>
>>> (Pdb) request.encoding = "iso-8859-1"
>>> (Pdb) type(request.POST[key])
>>> *** MultiValueDictKeyError:
>>> "u'right-carot
On Mon, Aug 22, 2016 at 1:25 PM, Jon Ribbens wrote:
> On 2016-08-22, Larry Martell wrote:
>> On Sun, Aug 21, 2016 at 5:24 PM, Jon Ribbens
>> wrote:
>>> On 2016-08-19, Larry Martell wrote:
fd.write(request.POST[key])
>>>
>>> You could try:
>>>
>>> request.encoding = "iso-8859-1"
>>> fd
On Mon, Aug 22, 2016, at 16:21, Malcolm Greene wrote:
> Python 3.5: Is there a way to dynamically import specific names from a
> module vs importing the full module?
>
> By dynamic I mean via some form of importlib machinery, eg. I'm looking
> for the dynamic "from import " equivalent of "import
On Monday, August 22, 2016 at 4:22:09 PM UTC-4, Malcolm Greene wrote:
> Python 3.5: Is there a way to dynamically import specific names from a
> module vs importing the full module?
>
> By dynamic I mean via some form of importlib machinery, eg. I'm looking
> for the dynamic "from import " equiva
Python 3.5: Is there a way to dynamically import specific names from a
module vs importing the full module?
By dynamic I mean via some form of importlib machinery, eg. I'm looking
for the dynamic "from import " equivalent of "import
"'s importlib.import_module.
Thank you,
Malcolm
--
https://mai
On Mon, 22 Aug 2016 13:21:43 -0400, Larry Martell wrote:
> On Fri, Aug 19, 2016 at 4:51 PM, Lawrence D’Oliveiro
> wrote:
>> On Saturday, August 20, 2016 at 6:03:53 AM UTC+12, Terry Reedy wrote:
>>>
>>> An 'octet' is a byte of 8 bits.
>>
>> Is there any other size of byte?
>
> Many, many years ag
On Mon, 22 Aug 2016 17:27:13 +, Jon Ribbens wrote:
> On 2016-08-22, Chris Angelico wrote:
>> I tried things like "con.txt" and it simply failed (no such file or
>> directory), without printing anything to the console.
>
> I'm not sure how you got that to fail, but writing to "con.txt"
> cert
On Tuesday, December 6, 2005 at 11:10:56 AM UTC+3:30, aum wrote:
> Hi all,
>
> I looked at a few genetic algorithms/genetic programming packages for
> Python, and found them somewhat convoluted, complicated and
> counter-intuitive to use.
>
> So I've written a genetic algorithms package which I h
On Tue, Aug 23, 2016 at 3:58 AM, Larry Martell wrote:
> On Mon, Aug 22, 2016 at 1:52 PM, Gary Sublett wrote:
>> I have to go out for a while, so for DED processing two options from
>> my end:
>>
>> 1. Process as you all have been in the past for now. If you all do
>> this, the records that have
On 2016-08-22, Steve D'Aprano wrote:
> I'm not really sure what the question is -- we've established that there's a
> bug in the non-Windows implementation that tries to emulate Window's
> behaviour. What else is there to argue about?
It doesn't seem to be "the non-Windows implementation", it see
On Tue, 23 Aug 2016 03:13 am, eryk sun wrote:
> But if they open files
> like "C:\Users\JoeUser\Documents\Nul.20160822.doc", I want to make
> sure they know that they just asked to save to "\\.\NUL". It's not a
> common problem. I just find the system'
even though I try to upgrade PIP[cid:beb9e7c5-7d98-4506-ba67-9e67890edec1]
From: Wentao Liang
Sent: Sunday, 21 August 2016 4:35:31 PM
To: python-list@python.org
Subject: Something wrong with the PIP, lots of friend have the same problem
[cid:1c20248f-a678-40c0-95
On Mon, Aug 22, 2016 at 1:52 PM, Gary Sublett wrote:
> I have to go out for a while, so for DED processing two options from
> my end:
>
> 1. Process as you all have been in the past for now. If you all do
> this, the records that have not been mailed prior to the latest list
> are contained in a
I have to go out for a while, so for DED processing two options from
my end:
1. Process as you all have been in the past for now. If you all do
this, the records that have not been mailed prior to the latest list
are contained in a MailManage Job name DED_master. If you chose to
process as in th
On Tue, Aug 23, 2016 at 3:32 AM, Tim Chase
wrote:
> On 2016-08-23 02:20, Chris Angelico wrote:
>> It generally will (or rather, only if the file has one of a
>> particular set of extensions). Automatic thumbnailing is usually
>> done only for certain file names. I don't know of anything that
>> op
On 2016-08-22, Steve D'Aprano wrote:
> On Mon, 22 Aug 2016 09:50 pm, Jon Ribbens wrote:
>> I don't know what purpose you are envisaging this function being used
>> for, but the only one I can think of is input sanitisation. e.g. a web
>> form where you receive a file from the Internet and store it
On 2016-08-22 22:39, Chris Angelico wrote:
> Nope. On Windows, you would try/except it. There are myriad other
> ways something could fail, and the only correct action is to
> attempt it. Most of the reserved names will simply give an error;
The problem is that when opening such a pseudo-file, you
On 2016-08-23 02:20, Chris Angelico wrote:
> It generally will (or rather, only if the file has one of a
> particular set of extensions). Automatic thumbnailing is usually
> done only for certain file names. I don't know of anything that
> opens every single file to see if it has a JFIF signature (
On 2016-08-22, Larry Martell wrote:
> On Sun, Aug 21, 2016 at 5:24 PM, Jon Ribbens
> wrote:
>> On 2016-08-19, Larry Martell wrote:
>>> fd.write(request.POST[key])
>>
>> You could try:
>>
>> request.encoding = "iso-8859-1"
>> fd.write(request.POST[key].encode("iso-8859-1"))
>>
>> It's hacky
On 2016-08-22, Chris Angelico wrote:
> I tried things like "con.txt" and it simply failed (no such file or
> directory), without printing anything to the console.
I'm not sure how you got that to fail, but writing to "con.txt"
certainly does write to the console in Windows 10 - I just tried it:
On Tue, Aug 23, 2016 at 3:13 AM, eryk sun wrote:
> On Mon, Aug 22, 2016 at 4:18 PM, Chris Angelico wrote:
>>
>>> The CON device should work if the process is attached to a console
>>> (i.e. a conhost.exe instance).
>>
>> No, I used Pike (to avoid any specifically-Python issues or
>> protections)
On Fri, Aug 19, 2016 at 4:51 PM, Lawrence D’Oliveiro
wrote:
> On Saturday, August 20, 2016 at 6:03:53 AM UTC+12, Terry Reedy wrote:
>>
>> An 'octet' is a byte of 8 bits.
>
> Is there any other size of byte?
Many, many years ago, probably c. 1982 my Dad came into my house and
saw a Byte Magazine l
e to a (possibly hidden) console or NUL device
is not the same thing as failing with an error. If users explicitly
open "NUL" or "\\.\NUL", I can detect that, and I have no problem with
it (with some reservations about the former). But if they open files
like "C:\Users\JoeUser\Do
On Mon, Aug 22, 2016 at 10:36 AM, Larry Martell wrote:
> On Fri, Aug 19, 2016 at 4:24 PM, Chris Kaynor
> wrote:
>> On Fri, Aug 19, 2016 at 12:00 PM, Larry Martell
>> wrote:
>>
>>> On Fri, Aug 19, 2016 at 1:24 PM, Chris Angelico wrote:
>>> > On Sat, Aug 20, 2016 at 3:10 AM, Larry Martell
>>> w
On Tue, Aug 23, 2016 at 2:08 AM, Marko Rauhamaa wrote:
> Random832 :
>
>> On Mon, Aug 22, 2016, at 11:40, Chris Angelico wrote:
>>> Windows has some other issues, including that arbitrary files can
>>> become executable very easily (eg if %PATHEXT% includes its file
>>> extension), and since the c
On Mon, Aug 22, 2016 at 3:40 PM, Chris Angelico wrote:
> Windows has some other issues, including that arbitrary files can
> become executable very easily (eg if %PATHEXT% includes its file
> extension),
cmd uses PATHEXT to augment its search by appending each extension in
the list, in addition t
On Tue, Aug 23, 2016 at 1:56 AM, Random832 wrote:
>> And any GUI that automatically calculates thumbnails from
>> image files (this includes Windows, Mac OS, and more than one Linux
>> window manager) could potentially be attacked via a malformed file,
>> simply by having it appear on the file sys
On Tue, Aug 23, 2016 at 1:54 AM, eryk sun wrote:
> On Mon, Aug 22, 2016 at 1:17 PM, Chris Angelico wrote:
>> I tried things like "con.txt" and it simply failed (no such file or
>> directory), without printing anything to the console.
>
> Are you using IDLE or some other IDE that uses pythonw.exe
Random832 :
> On Mon, Aug 22, 2016, at 11:40, Chris Angelico wrote:
>> Windows has some other issues, including that arbitrary files can
>> become executable very easily (eg if %PATHEXT% includes its file
>> extension), and since the current directory is always at the
>> beginning of your path, th
On Mon, Aug 22, 2016, at 11:40, Chris Angelico wrote:
> Windows has some other issues, including that arbitrary files can
> become executable very easily (eg if %PATHEXT% includes its file
> extension), and since the current directory is always at the beginning
> of your path, this can easily turn
On Mon, Aug 22, 2016 at 1:17 PM, Chris Angelico wrote:
> I tried things like "con.txt" and it simply failed (no such file or
> directory), without printing anything to the console.
Are you using IDLE or some other IDE that uses pythonw.exe instead of
python.exe? If so, first use ctypes to allocat
On Tue, Aug 23, 2016 at 12:21 AM, Ben Finney wrote:
>
> So yes, filenames from arbitrary sources should be *completely*
> untrusted, and never used to access any file on the system. Throw the
> entire filename away and make a filename locally, without using any part
> of the original name.
Oh, an
On Tue, Aug 23, 2016 at 12:34 AM, Random832 wrote:
> On Mon, Aug 22, 2016, at 10:21, Ben Finney wrote:
>> So yes, filenames from arbitrary sources should be *completely*
>> untrusted, and never used to access any file on the system. Throw the
>> entire filename away and make a filename locally, wi
On 2016-08-23 00:21, Ben Finney wrote:
> So yes, filenames from arbitrary sources should be *completely*
> untrusted, and never used to access any file on the system. Throw
> the entire filename away and make a filename locally, without using
> any part of the original name.
Sadly, this ideal advi
On Tue, Aug 23, 2016 at 12:29 AM, Random832 wrote:
> On Mon, Aug 22, 2016, at 09:21, Steve D'Aprano wrote:
>> Rather, you just use the features you rely on, document the minimum
>> supported version, and if somebody is silly enough to try running your
>> code
>> under Python 1.4, they'll get a Syn
On Fri, Aug 19, 2016 at 4:24 PM, Chris Kaynor wrote:
> On Fri, Aug 19, 2016 at 12:00 PM, Larry Martell
> wrote:
>
>> On Fri, Aug 19, 2016 at 1:24 PM, Chris Angelico wrote:
>> > On Sat, Aug 20, 2016 at 3:10 AM, Larry Martell
>> wrote:
>> >> I have some python code (part of a django app) that pro
On Sun, Aug 21, 2016 at 5:24 PM, Jon Ribbens wrote:
> On 2016-08-19, Larry Martell wrote:
>> fd.write(request.POST[key])
>
> You could try:
>
> request.encoding = "iso-8859-1"
> fd.write(request.POST[key].encode("iso-8859-1"))
>
> It's hacky and nasty and there might be a better "official" me
On Mon, Aug 22, 2016, at 10:21, Ben Finney wrote:
> So yes, filenames from arbitrary sources should be *completely*
> untrusted, and never used to access any file on the system. Throw the
> entire filename away and make a filename locally, without using any part
> of the original name.
To be fair,
On Mon, Aug 22, 2016, at 09:21, Steve D'Aprano wrote:
> Rather, you just use the features you rely on, document the minimum
> supported version, and if somebody is silly enough to try running your
> code
> under Python 1.4, they'll get a SyntaxError or an exception when you try
> to
> do something
Chris Angelico writes:
> […] to be honest, I wouldn't accept file names from untrusted sources
> on *any* system […]
That's one of the wiser things said in this whole thread.
> I'd use arbitrary numbers or hashes as the file names, and store the
> originally-submitted file name in some sort of
On Mon, 22 Aug 2016 10:56 pm, Random832 wrote:
> On Mon, Aug 22, 2016, at 08:39, Chris Angelico wrote:
>> Nope. On Windows, you would try/except it.
>
> No, you can't, because the failure mode often isn't "file refuses to
> open" but "data is written to a serial port".
Ah, that's a good point. I
On Mon, 22 Aug 2016 10:52 pm, Random832 wrote:
> On Mon, Aug 22, 2016, at 08:44, Chris Angelico wrote:
>> However, I don't think it's particularly necessary. Explicit version
>> number checks should be very rare, and shouldn't be encouraged.
>> Instead, encourage feature checks, as Steve gave some
On Mon, 22 Aug 2016 09:50 pm, Jon Ribbens wrote:
> On 2016-08-22, Chris Angelico wrote:
>> On Mon, Aug 22, 2016 at 8:33 PM, Jon Ribbens
>> wrote:
>>> On 2016-08-22, Steve D'Aprano wrote:
On Mon, 22 Aug 2016 10:38 am, eryk sun wrote:
> To me it's scary that this check misses cases becau
On Monday, August 22, 2016 at 7:00:36 PM UTC+5:30, Steve D'Aprano wrote:
> Realistically, by the time you convince people this is a useful feature,
> write a patch and have the patch reviewed, you'll be looking at Python 3.7.
> So 3.7 will have this new syntax "use version", and *no other version*.
On Mon, 22 Aug 2016 08:32 pm, rocky wrote:
> On Monday, August 22, 2016 at 1:36:07 AM UTC-4, Steven D'Aprano wrote:
[...]
>> But... I don't understand what this proposal actually is. We already have
>> a uniform way to indicate the Python language version: check sys.version,
>> or sys.version_info
On Mon, Aug 22, 2016 at 10:56 PM, Random832 wrote:
>> Most of the reserved names will simply give an error; the only way
>> you'd actually get incorrect behaviour is if the file name, including
>> extension, is exactly a device name.
>
> I think the reason you believe this can be traced back to th
Random832 :
> The problem is when you want to write a large body of code that just
> *uses* lots of features (including syntactic features), *without*
> checking for them.
Ordinarily, that's the job of package management. The installer will
perform the necessary checks for you.
Marko
--
https:/
On Mon, Aug 22, 2016 at 12:39 PM, Chris Angelico wrote:
>
> Nope. On Windows, you would try/except it. There are myriad other ways
No, I would not rely on exceptions in this case. Both \\.\CON and
\\.\NUL can be opened for both reading and writing, so you may not
detect the problem.
I think it's
On Mon, Aug 22, 2016, at 08:39, Chris Angelico wrote:
> Nope. On Windows, you would try/except it.
No, you can't, because the failure mode often isn't "file refuses to
open" but "data is written to a serial port".
There are myriad other ways
> something could fail, and the only correct action is
On Monday, August 22, 2016 at 8:45:05 AM UTC-4, Chris Angelico wrote:
> On Mon, Aug 22, 2016 at 10:05 PM, Marko Rauhamaa wrote:
> > rocky :
> >
> >> A slightly different but related problem is noting the Python dialect
> >> at the package-level.
> >
> > I don't know what if anything is needed supp
On Mon, Aug 22, 2016, at 08:44, Chris Angelico wrote:
> However, I don't think it's particularly necessary. Explicit version
> number checks should be very rare, and shouldn't be encouraged.
> Instead, encourage feature checks, as Steve gave some examples of.
The problem is when you want to write
On Monday, August 22, 2016 at 8:05:15 AM UTC-4, Marko Rauhamaa wrote:
> rocky :
>
> > A slightly different but related problem is noting the Python dialect
> > at the package-level.
>
> I don't know what if anything is needed support this idea, but one
> option would be to just use "import":
>
>
On Mon, Aug 22, 2016 at 10:05 PM, Marko Rauhamaa wrote:
> rocky :
>
>> A slightly different but related problem is noting the Python dialect
>> at the package-level.
>
> I don't know what if anything is needed support this idea, but one
> option would be to just use "import":
>
> import python
On Mon, Aug 22, 2016 at 9:50 PM, Jon Ribbens wrote:
> On 2016-08-22, Chris Angelico wrote:
>> On Mon, Aug 22, 2016 at 8:33 PM, Jon Ribbens
>> wrote:
>>> On 2016-08-22, Steve D'Aprano wrote:
On Mon, 22 Aug 2016 10:38 am, eryk sun wrote:
> To me it's scary that this check misses cases b
On Mon, 22 Aug 2016 08:33 pm, Jon Ribbens wrote:
> On 2016-08-22, Steve D'Aprano wrote:
>> On Mon, 22 Aug 2016 10:38 am, eryk sun wrote:
>>> To me it's scary that this check misses cases because it's trying to
>>> be cross-platform instead of simply relying on GetFullPathName to do
>>> the work.
rocky :
> A slightly different but related problem is noting the Python dialect
> at the package-level.
I don't know what if anything is needed support this idea, but one
option would be to just use "import":
import python3_5_17
That would require Python and modules to install such empty mo
On 2016-08-22, Chris Angelico wrote:
> On Mon, Aug 22, 2016 at 8:33 PM, Jon Ribbens
> wrote:
>> On 2016-08-22, Steve D'Aprano wrote:
>>> On Mon, 22 Aug 2016 10:38 am, eryk sun wrote:
To me it's scary that this check misses cases because it's trying to
be cross-platform instead of simp
On Monday, August 22, 2016 at 12:33:53 AM UTC-4, Chris Angelico wrote:
> On Mon, Aug 22, 2016 at 1:37 PM, rocky wrote:
> > Sorry should have been:
> >
> > assert sys.version_info >= (3,0)
>
> The next question is: How common is code like this? I don't put
> version checks in any of my modules. A
On Mon, Aug 22, 2016 at 8:33 PM, Jon Ribbens wrote:
> On 2016-08-22, Steve D'Aprano wrote:
>> On Mon, 22 Aug 2016 10:38 am, eryk sun wrote:
>>> To me it's scary that this check misses cases because it's trying to
>>> be cross-platform instead of simply relying on GetFullPathName to do
>>> the wor
On Monday, August 22, 2016 at 6:44:43 AM UTC-4, Rustom Mody wrote:
> On Monday, August 22, 2016 at 3:53:27 PM UTC+5:30, rocky wrote:
> > On Monday, August 22, 2016 at 2:04:39 AM UTC-4, Random832 wrote:
> > > On Mon, Aug 22, 2016, at 01:35, Steven D'Aprano wrote:
> > > > Could somebody (the OP?) ple
On Monday, August 22, 2016 at 3:53:27 PM UTC+5:30, rocky wrote:
> On Monday, August 22, 2016 at 2:04:39 AM UTC-4, Random832 wrote:
> > On Mon, Aug 22, 2016, at 01:35, Steven D'Aprano wrote:
> > > Could somebody (the OP?) please explain what is the purpose of this
> > > proposal, what it does, how i
On Monday, August 22, 2016 at 1:36:07 AM UTC-4, Steven D'Aprano wrote:
> On Monday 22 August 2016 14:33, Chris Angelico wrote:
>
> > On Mon, Aug 22, 2016 at 1:37 PM, rocky wrote:
> >> Sorry should have been:
> >>
> >> assert sys.version_info >= (3,0)
> >
> > The next question is: How common is
On 2016-08-22, Steve D'Aprano wrote:
> On Mon, 22 Aug 2016 10:38 am, eryk sun wrote:
>> To me it's scary that this check misses cases because it's trying to
>> be cross-platform instead of simply relying on GetFullPathName to do
>> the work. For example, it misses at least the following cases:
>
>
On Monday, August 22, 2016 at 2:04:39 AM UTC-4, Random832 wrote:
> On Mon, Aug 22, 2016, at 01:35, Steven D'Aprano wrote:
> > Could somebody (the OP?) please explain what is the purpose of this
> > proposal, what it does, how it works, and when would people use it?
>
> I think what he wants is a w
66 matches
Mail list logo
