[Python-Dev] Unicode 8.0 and 3.5

2015-06-18 Thread Terry Reedy
Unicode 8.0 was just released.  Can we have unicodedata updated to match 
in 3.5?


--
Terry Jan Reedy

___
Python-Dev mailing list
[email protected]
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] Unicode 8.0 and 3.5

2015-06-18 Thread Larry Hastings

On 06/18/2015 11:27 AM, Terry Reedy wrote:
Unicode 8.0 was just released.  Can we have unicodedata updated to 
match in 3.5?




What does this entail?  Data changes, code changes, both?


//arry/
___
Python-Dev mailing list
[email protected]
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] Unicode 8.0 and 3.5

2015-06-18 Thread MRAB

On 2015-06-18 19:33, Larry Hastings wrote:

On 06/18/2015 11:27 AM, Terry Reedy wrote:

Unicode 8.0 was just released.  Can we have unicodedata updated to
match in 3.5?



What does this entail?  Data changes, code changes, both?


It looks like just data changes.

There are additional codepoints and a renamed property (which the
standard library doesn't support anyway).

___
Python-Dev mailing list
[email protected]
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


[Python-Dev] About Python Developer Testsuites

2015-06-18 Thread Arsalan Javeed (Student)
Dear Concerned,

I am using python v.2.7.1 for my research work in software testing. I have
already downloaded the source codes and found the built-in testsuites for
running on the build. However, i was wondering if by any chance are there
any testsuites which exist that are primarily meant for* developers* of the
source code which can be used before releasing a build, for instance smoke
testsuite/regression testsuites, besides the one already distributed with
source code.

If such developer testsuite exist i would request to share them.

Thanking in advance for the information.

-- 
Regards,

Arsalan Javeed
MS Computer Science and Engineering
___
Python-Dev mailing list
[email protected]
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] Unicode 8.0 and 3.5

2015-06-18 Thread Steven D'Aprano
On Thu, Jun 18, 2015 at 08:34:14PM +0100, MRAB wrote:
> On 2015-06-18 19:33, Larry Hastings wrote:
> >On 06/18/2015 11:27 AM, Terry Reedy wrote:
> >>Unicode 8.0 was just released.  Can we have unicodedata updated to
> >>match in 3.5?
> >>
> >
> >What does this entail?  Data changes, code changes, both?
> >
> It looks like just data changes.

At the very least, there is a change to the casefolding algorithm. 
Cherokee was classified as unicameral but is now considered bicameral 
(two cases, like English). Unusually, case-folding Cherokee maps to 
uppercase rather than lowercase.

The full set of changes is listed here:

http://unicode.org/versions/Unicode8.0.0/

Apart from the addition of 7716 characters and changes to 
str.casefold(), I don't think any of the changes will make a big 
difference to Python's implementation. But it would be good to support 
Unicode 8 (to the degree that Python actually does support Unicode, 
rather than just that character set part of it).

 
> There are additional codepoints and a renamed property (which the
> standard library doesn't support anyway).

Which one are you referring to, Indic_Matra_Category renamed to 
Indic_Positional_Category?


-- 
Steve
___
Python-Dev mailing list
[email protected]
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] Unicode 8.0 and 3.5

2015-06-18 Thread MRAB

On 2015-06-19 00:56, Steven D'Aprano wrote:

On Thu, Jun 18, 2015 at 08:34:14PM +0100, MRAB wrote:

On 2015-06-18 19:33, Larry Hastings wrote:
>On 06/18/2015 11:27 AM, Terry Reedy wrote:
>>Unicode 8.0 was just released.  Can we have unicodedata updated to
>>match in 3.5?
>>
>
>What does this entail?  Data changes, code changes, both?
>
It looks like just data changes.


At the very least, there is a change to the casefolding algorithm.
Cherokee was classified as unicameral but is now considered bicameral
(two cases, like English). Unusually, case-folding Cherokee maps to
uppercase rather than lowercase.


Doesn't the case-folding just depend on the data and the algorithm
remains the same?


The full set of changes is listed here:

http://unicode.org/versions/Unicode8.0.0/

Apart from the addition of 7716 characters and changes to
str.casefold(), I don't think any of the changes will make a big
difference to Python's implementation. But it would be good to support
Unicode 8 (to the degree that Python actually does support Unicode,
rather than just that character set part of it).



There are additional codepoints and a renamed property (which the
standard library doesn't support anyway).


Which one are you referring to, Indic_Matra_Category renamed to
Indic_Positional_Category?


Yes.

___
Python-Dev mailing list
[email protected]
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] Unicode 8.0 and 3.5

2015-06-18 Thread Larry Hastings

On 06/18/2015 11:27 AM, Terry Reedy wrote:
Unicode 8.0 was just released.  Can we have unicodedata updated to 
match in 3.5?



What do the Python unicodedata Experts say?  That'd be "loewis", 
"lemburg", and "ezio.melotti".


According to the Dev Guide,


//arry/
___
Python-Dev mailing list
[email protected]
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] Unicode 8.0 and 3.5

2015-06-18 Thread Steven D'Aprano
On Fri, Jun 19, 2015 at 01:55:07AM +0100, MRAB wrote:
> On 2015-06-19 00:56, Steven D'Aprano wrote:

> >At the very least, there is a change to the casefolding algorithm.
> >Cherokee was classified as unicameral but is now considered bicameral
> >(two cases, like English). Unusually, case-folding Cherokee maps to
> >uppercase rather than lowercase.
> >
> Doesn't the case-folding just depend on the data and the algorithm
> remains the same?

That depends on what algorithm str.casefold uses :-)

Case folding is specifically mentioned as something that people 
migrating to Unicode 8 will need to take care with, and also says:

"This mapping also has consequences on identifiers, as described in the 
changes to UAX #31, Unicode Identifier and Pattern Syntax."

http://unicode.org/versions/Unicode8.0.0/#Migration


-- 
Steve
___
Python-Dev mailing list
[email protected]
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] Unicode 8.0 and 3.5

2015-06-18 Thread Serhiy Storchaka

On 18.06.15 22:34, MRAB wrote:

On 2015-06-18 19:33, Larry Hastings wrote:

On 06/18/2015 11:27 AM, Terry Reedy wrote:

Unicode 8.0 was just released.  Can we have unicodedata updated to
match in 3.5?



What does this entail?  Data changes, code changes, both?


It looks like just data changes.

There are additional codepoints and a renamed property (which the
standard library doesn't support anyway).


May be private table for case-insensitive matching in the re module 
should be updated too.



___
Python-Dev mailing list
[email protected]
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] About Python Developer Testsuites

2015-06-18 Thread Wes Turner
On Thu, Jun 18, 2015 at 4:34 PM, Arsalan Javeed (Student) <
[email protected]> wrote:

> Dear Concerned,
>
> I am using python v.2.7.1 for my research work in software testing. I have
> already downloaded the source codes and found the built-in testsuites for
> running on the build. However, i was wondering if by any chance are there
> any testsuites which exist that are primarily meant for* developers* of
> the source code which can be used before releasing a build, for instance
> smoke testsuite/regression testsuites, besides the one already distributed
> with source code.
>
> If such developer testsuite exist i would request to share them.
>
> Thanking in advance for the information.
>

| Source: https://hg.python.org/cpython/file/tip/Lib/test
| Docs: https://docs.python.org/devguide/coverage.html
| Docs: https://docs.python.org/devguide/runtests.html
| Docs https://docs.python.org/devguide/buildbots.html
| Source:  https://hg.python.org/hooks/file/tip/hgbuildbot.py

| Source: https://hg.python.org/benchmarks/file/tip/performance

| Docs: https://hg.python.org/devinabox/file/tip/README

speed.python.org
-
| Homepage: https://speed.python.org/

* https://westurner.org/wiki/awesome-python-testing#benchmarks


>
> Regards,
>
___
Python-Dev mailing list
[email protected]
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] About Python Developer Testsuites

2015-06-18 Thread Wes Turner
...
[Python-Dev] Automated testing of patches from bugs.python.org
https://groups.google.com/forum/#!topic/dev-python/CQA4YAItD74

On Fri, Jun 19, 2015 at 1:32 AM, Wes Turner  wrote:

>
>
> On Thu, Jun 18, 2015 at 4:34 PM, Arsalan Javeed (Student) <
> [email protected]> wrote:
>
>> Dear Concerned,
>>
>> I am using python v.2.7.1 for my research work in software testing. I
>> have already downloaded the source codes and found the built-in testsuites
>> for running on the build. However, i was wondering if by any chance are
>> there any testsuites which exist that are primarily meant for*
>> developers* of the source code which can be used before releasing a
>> build, for instance smoke testsuite/regression testsuites, besides the one
>> already distributed with source code.
>>
>> If such developer testsuite exist i would request to share them.
>>
>> Thanking in advance for the information.
>>
>
> | Source: https://hg.python.org/cpython/file/tip/Lib/test
> | Docs: https://docs.python.org/devguide/coverage.html
> | Docs: https://docs.python.org/devguide/runtests.html
> | Docs https://docs.python.org/devguide/buildbots.html
> | Source:  https://hg.python.org/hooks/file/tip/hgbuildbot.py
>
> | Source: https://hg.python.org/benchmarks/file/tip/performance
>
> | Docs: https://hg.python.org/devinabox/file/tip/README
>
> speed.python.org
> -
> | Homepage: https://speed.python.org/
>
> * https://westurner.org/wiki/awesome-python-testing#benchmarks
>
>
>>
>> Regards,
>>
>
___
Python-Dev mailing list
[email protected]
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com