Re: autobuild system of linaro

2010-12-16 Thread Tom Gall
To use Linaro's optimized packages and get their sources, firstly you'll need 
to identify which package(s) you're interested in. Often times teams will have 
their own PPAs where they will place development versions of optimized packages 
as they are working on them and/or just before they submit them for inclusion 
by the main archive. 

When you visit a PPA you'll notice there are instructions on how to add that 
PPA so that when you do an apt-get install it can pull from that PPA.

So look at  the linaro-maintainers PPA as an example:

https://launchpad.net/~linaro-maintainers/+archive/overlay

So if you are interested in the es2gears app

All you need to do is either download the debs directory and install via dpkg 
(ick!)  or 

sudo add-apt-repository ppa:linaro-maintainers/overlay
sudo apt-get update
sudo apt-get install es2gears 

and as long as the es2gears deb found in that PPA is newer than what is in the 
main package archive it will be installed from the PPA.

If you want the source you can issue:

apt-get source packagename

Now for meego, that's a whole different discussion and really you should join 
say #meego and ask there or on the meego lists tho I will mention in passing 
that I am currently working on packaging some of Meego up for use in linaro. 

Hopefully this helps a bit.

Regards,
Tom

"We want great men who, when fortune frowns will not be discouraged." - Colonel 
Henry Knox
w) tom.gall att linaro.org
w) tom_gall att vnet.ibm.com
h) tom_gall att mac.com







On Dec 15, 2010, at 7:48 PM, Paul Li wrote:

> Hi Alexander,
>   I want to know how to use Linaro's optimized sources.
>   For example, if I run Lucid on my board and where can I get the deb 
> packages and source code of Linaro's optimized sources(Graphics, Multimeia, 
> Tools and so on)? You have said that I can just use them 'sudo apt-get 
> install '
>   If I run MeeGo on my board and where can I get the rpm packages and 
> source code of Linaro's optimized sources?
>   Does Linaro have a web server to store the deb or rpm packages and 
> source code? 
> 
> B.R
> Paul
> 
> -Original Message-
> From: Alexander Sack [mailto:a...@linaro.org] 
> Sent: 2010年12月15日 19:13
> To: Paul Li
> Cc: spring; Linaro Dev
> Subject: Re: autobuild system of linaro
> 
> On Wed, Dec 15, 2010 at 11:39 AM, Paul Li  wrote:
>> Hi,
>>Thank you. And another question, I can see GCC and kernel related in 
>> 10.11 release, but not graphics, power management and multimedia. Will these 
>> be available in 11.15?
> 
> what do you need?
> 
> but yes, toolchain and kernel were main focus in 10.11; graphics, mm
> and pmgmt WG have now their first full cycle in 11.05 ... and their
> output will be integrated in 11.05 - where feasible.
> 
> Anyway, in 10.11 we also did some ground work related to graphics in
> user-platform team; you can look at the work item tracker of
> user-platform to get an idea:
> 
>  
> http://people.canonical.com/~pitti/workitems/maverick/linaro-user-platforms.html
> 
> the arm-ui-and-test-heads spec as well as the graphics on x spec might
> be most relevant for that.
> 
> Let me know what you are trying to do from a high level perspective
> and I can probably give better guidance :)
> 
> Thanks,
> 
> -- 
> 
>  - Alexander
> ___
> linaro-dev mailing list
> linaro-dev@lists.linaro.org
> http://lists.linaro.org/mailman/listinfo/linaro-dev


___
linaro-dev mailing list
linaro-dev@lists.linaro.org
http://lists.linaro.org/mailman/listinfo/linaro-dev


MMC double buffering

2010-12-16 Thread Per Forlin
Hi,

I am working on the blueprint
https://blueprints.launchpad.net/linux-linaro/+spec/other-storage-performance-emmc.
Currently I am investigating performance for DMA vs PIO on eMMC.

Pros and cons for DMA on MMC
+ Offloads CPU
+ Fewer interrupts, one single interrupt for each transfer compared to
100s or even 1000s
+ Power save, DMA consumes less power than CPU
- Less bandwidth / throughput compared to PIO-CPU

The reason for introducing double buffering in the MMC framework is to
address the throughput issue for DMA on MMC.
The assumption is that the CPU and DMA have higher throughput than the
MMC / SD-card.
My hypothesis is that the difference in performance between PIO-mode
and DMA-mode for MMC is due to latency for preparing a DMA-job.
If the next DMA-job could be prepared while the current job is ongoing
this latency would be reduced. The biggest part of preparing a DMA-job
is maintenance of caches.
In my case I run on U5500 (mach-ux500) which has both L1 and L2
caches. The host mmc driver in use is the mmci driver (PL180).

I have done a hack in both the MMC-framework and mmci in order to make
a prove of concept. I have run IOZone to get measurements to prove my
case worthy.
The next step, if the results are promising will be to clean up my
work and send out patches for review.

The DMAC in ux500 support to modes LOG and PHY.
LOG - Many logical channels are multiplex on top of one physical channel
PHY - Only one channel per physical channel

DMA mode LOG and PHY have different latency both HW and SW wise. One
could almost treat them as "two different DMACs. To get a wider test
scope I have tested using both modes.

Summary of the results.
* It is optional for the mmc host driver to utitlize the 2-buf
support. 2-buf in framework requires no change in the host drivers.
* IOZone shows no performance hit on existing drivers* if adding 2-buf
to the framework but not in the host driver.
  (* So far I have only test one driver)
* The performance gain for DMA using 2-buf is probably proportional to
the cache maintenance time.
  The faster the card is the more significant the cache maintenance
part becomes and vice versa.
* For U5500 with 2-buf performance for DMA is:
Throughput: DMA vanilla vs DMA 2-buf
  * read +5-10 %
  * write +0-3 %
CPU load: CPU vs DMA 2-buf
  * read large data: minus 10-20 units of %
  * read small data: same as PIO
  * write: same load as PIO ( why? )

Here follows two of the measurements from IOZones comparing MMC with
double buffering and without. The rest you can find in the text files
attached.

=== Performance CPU compared with DMA vanilla kernel ===
Absolute diff: MMC-VANILLA-CPU -> MMC-VANILLA-DMA-LOG
random  random
KB  reclen  write   rewrite readreread  readwrite
51200   4   -14 -8  -1005   -988-679-1
cpu:-0.0-0.1-0.8-0.9-0.7+0.0

51200   8   -35 -34 -1763   -1791   -1327   +0
cpu:+0.0-0.1-0.9-1.2-0.7+0.0

51200   16  +6  -38 -2712   -2728   -2225   +0
cpu:-0.1-0.0-1.6-1.2-0.7-0.0

51200   32  -10 -79 -3640   -3710   -3298   -1
cpu:-0.1-0.2-1.2-1.2-0.7-0.0

51200   64  +31 -16 -4401   -4533   -4212   -1
cpu:-0.2-0.2-0.6-1.2-1.2-0.0

51200   128 +58 -58 -4749   -4776   -4532   -4
cpu:-0.2-0.0-1.2-1.1-1.2+0.1

51200   256 +192+283-5343   -5347   -5184   +13
cpu:+0.0+0.1-1.2-0.6-1.2+0.0

51200   512 +232+470-4663   -4690   -4588   +171
cpu:+0.1+0.1-4.5-3.9-3.8-0.1

51200   1024+250+68 -3151   -3318   -3303   +122
cpu:-0.1-0.5-14.0   -13.5   -14.0   -0.1

51200   2048+224+401-2708   -2601   -2612   +161
cpu:-1.7-1.3-18.4   -19.5   -17.8   -0.5

51200   4096+194+417-2380   -2361   -2520   +242
cpu:-1.3-1.6-19.4   -19.9   -19.4   -0.6

51200   8192+228+315-2279   -2327   -2291   +270
cpu:-1.0-0.9-20.8   -20.3   -21.0   -0.6

51200   16384   +254+289-2260   -2232   -2269   +308
cpu:-0.8-0.8-20.5   -19.9   -21.5   -0.4

=== Performance CPU compared with DMA with MMC double buffering ===
Absolute diff: MMC-VANILLA-CPU -> MMC-MMCI-2-BUF-DMA-LOG
random  random
KB  reclen  write   rewrite readreread  readwrite
51200   4   -7  -11 -533-513-365+0
cpu:-0.0-0.1-0.5-0.

RE: autobuild system of linaro

2010-12-16 Thread Paul Li
Hi Tom,

This is really useful for me. Thank you so much.

B.R
Paul

-Original Message-
From: Tom Gall [mailto:tom_g...@vnet.ibm.com] 
Sent: 2010年12月16日 21:48
To: Paul Li
Cc: Linaro Dev
Subject: Re: autobuild system of linaro

To use Linaro's optimized packages and get their sources, firstly you'll need 
to identify which package(s) you're interested in. Often times teams will have 
their own PPAs where they will place development versions of optimized packages 
as they are working on them and/or just before they submit them for inclusion 
by the main archive. 

When you visit a PPA you'll notice there are instructions on how to add that 
PPA so that when you do an apt-get install it can pull from that PPA.

So look at  the linaro-maintainers PPA as an example:

https://launchpad.net/~linaro-maintainers/+archive/overlay

So if you are interested in the es2gears app

All you need to do is either download the debs directory and install via dpkg 
(ick!)  or 

sudo add-apt-repository ppa:linaro-maintainers/overlay
sudo apt-get update
sudo apt-get install es2gears 

and as long as the es2gears deb found in that PPA is newer than what is in the 
main package archive it will be installed from the PPA.

If you want the source you can issue:

apt-get source packagename

Now for meego, that's a whole different discussion and really you should join 
say #meego and ask there or on the meego lists tho I will mention in passing 
that I am currently working on packaging some of Meego up for use in linaro. 

Hopefully this helps a bit.

Regards,
Tom

"We want great men who, when fortune frowns will not be discouraged." - Colonel 
Henry Knox
w) tom.gall att linaro.org
w) tom_gall att vnet.ibm.com
h) tom_gall att mac.com







On Dec 15, 2010, at 7:48 PM, Paul Li wrote:

> Hi Alexander,
>   I want to know how to use Linaro's optimized sources.
>   For example, if I run Lucid on my board and where can I get the deb 
> packages and source code of Linaro's optimized sources(Graphics, Multimeia, 
> Tools and so on)? You have said that I can just use them 'sudo apt-get 
> install '
>   If I run MeeGo on my board and where can I get the rpm packages and 
> source code of Linaro's optimized sources?
>   Does Linaro have a web server to store the deb or rpm packages and 
> source code? 
> 
> B.R
> Paul
> 
> -Original Message-
> From: Alexander Sack [mailto:a...@linaro.org] 
> Sent: 2010年12月15日 19:13
> To: Paul Li
> Cc: spring; Linaro Dev
> Subject: Re: autobuild system of linaro
> 
> On Wed, Dec 15, 2010 at 11:39 AM, Paul Li  wrote:
>> Hi,
>>Thank you. And another question, I can see GCC and kernel related in 
>> 10.11 release, but not graphics, power management and multimedia. Will these 
>> be available in 11.15?
> 
> what do you need?
> 
> but yes, toolchain and kernel were main focus in 10.11; graphics, mm
> and pmgmt WG have now their first full cycle in 11.05 ... and their
> output will be integrated in 11.05 - where feasible.
> 
> Anyway, in 10.11 we also did some ground work related to graphics in
> user-platform team; you can look at the work item tracker of
> user-platform to get an idea:
> 
>  
> http://people.canonical.com/~pitti/workitems/maverick/linaro-user-platforms.html
> 
> the arm-ui-and-test-heads spec as well as the graphics on x spec might
> be most relevant for that.
> 
> Let me know what you are trying to do from a high level perspective
> and I can probably give better guidance :)
> 
> Thanks,
> 
> -- 
> 
>  - Alexander
> ___
> linaro-dev mailing list
> linaro-dev@lists.linaro.org
> http://lists.linaro.org/mailman/listinfo/linaro-dev

___
linaro-dev mailing list
linaro-dev@lists.linaro.org
http://lists.linaro.org/mailman/listinfo/linaro-dev