RE: Question on MSI support in PCI and PCI-E devices

2015-03-04 Thread McKay, Luke
I don't personally know of any PCI drivers that use polling instead of 
interrupts, since that would really mean the hardware is broke.

Basically all you need to do is create a timer, and have it's callback set to 
your driver routine that can check the device status registers to determine if 
there is work to be done.  The status register(s) would be the same indicators 
that should have generated an interrupt.

Regards,
Luke


-- 
Luke McKay 
Senior Engineer
Cobham AvComm
T : +1 (316) 529 5585

Please consider the environment before printing this email



-Original Message-
From: Andrey Utkin [mailto:andrey.ut...@corp.bluecherry.net] 
Sent: Tuesday, March 03, 2015 8:29 AM
To: McKay, Luke
Cc: Andrey Utkin; Stephen Hemminger; kernel-ment...@selenic.com; 
linux-kernel@vger.kernel.org; kernelnewbies
Subject: Re: Question on MSI support in PCI and PCI-E devices

On Mon, Mar 2, 2015 at 4:02 PM, McKay, Luke  wrote:
> It doesn't appear that your device supports MSI.  If it did lspci -v should 
> list the MSI capability and whether or not it is enabled.
>
> i.e. Something like...
> Capabilities: [68] MSI: Enable+ Count=1/1 Maskable- 64bit+
>
> Without a listing that shows the capability is present, there is nothing to 
> enable.
>
> Have you tried polling instead of using interrupts?  Definitely not ideal, 
> but it might help you to determine whether hardware is dropping/missing an 
> interrupt or whether the hardware is being completely hung up.
>
> Do you know if this missing interrupt is occurring in other systems as well?  
> How about whether it happens with different boards in the same system?  
> Answers to these questions would help to determine whether you might have a 
> defective board, or some sort of incompatibility with the system.

We have just three setups reproducing this. We have no boards for replacement 
experiments, unfortunately.
Polling instead of using interrupts sounds interesting. Is there an example of 
such usage in any other PCI device driver?

--
Bluecherry developer.


Aeroflex is now a Cobham company


RE: Question on MSI support in PCI and PCI-E devices

2015-03-04 Thread McKay, Luke
Legacy INTx is shared amongst multiple devices.  Since it is a level sensitive 
simulation of the interrupt line, it only takes one device (or driver) to 
forget to clear the interrupt, and then it stuck and won't work for any of the 
devices using it.

If you're working with one particular device that seems to be causing these 
sorts of problems then you can verify misbehaving hardware with a PCIe 
analyzer.  With the analyzer you can verify that when the driver informs the 
device that it has processed the interrupt that the device sends the 
deassertion message for the INTx line.

Or if that isn't available, simply verifying that interrupt being cleared by 
the driver on the end device is taken correctly and then verifying the chain of 
propagation that clears the interrupt status.  It can be verified through any 
switch that is in the path, to the root port where the legacy PCI interrupt 
controller that the interrupt is cleared, to the top level interrupt controller.

Regards,
Luke

-- 
Luke McKay 
Senior Engineer
Cobham AvComm
T : +1 (316) 529 5585

Please consider the environment before printing this email



-Original Message-
From: Roger Heflin [mailto:rogerhef...@gmail.com] 
Sent: Wednesday, March 04, 2015 10:31 AM
To: McKay, Luke
Cc: Andrey Utkin; Andrey Utkin; Stephen Hemminger; kernel-ment...@selenic.com; 
linux-kernel@vger.kernel.org; kernelnewbies
Subject: Re: Question on MSI support in PCI and PCI-E devices

I know from some data I have seen that between the Intel Sandy Bridge and Intel 
Ivy Bridge the same motherboards stopped delivering INTx reliably (int lost 
under load around 1x every 30 days, driver and
firmware has no method to recover from failure)   We had to transition
to using MSI on some PCI cards that had this issue. Our issue was duplicated on 
a large number of different physical machines so if it was a hardware error is 
was a lot of different physical machines that had the defect.

On Wed, Mar 4, 2015 at 10:03 AM, McKay, Luke  wrote:
> I don't personally know of any PCI drivers that use polling instead of 
> interrupts, since that would really mean the hardware is broke.
>
> Basically all you need to do is create a timer, and have it's callback set to 
> your driver routine that can check the device status registers to determine 
> if there is work to be done.  The status register(s) would be the same 
> indicators that should have generated an interrupt.
>
> Regards,
> Luke
>
>
> --
> Luke McKay
> Senior Engineer
> Cobham AvComm
> T : +1 (316) 529 5585
>
> Please consider the environment before printing this email
>
>
>
> -Original Message-
> From: Andrey Utkin [mailto:andrey.ut...@corp.bluecherry.net]
> Sent: Tuesday, March 03, 2015 8:29 AM
> To: McKay, Luke
> Cc: Andrey Utkin; Stephen Hemminger; kernel-ment...@selenic.com; 
> linux-kernel@vger.kernel.org; kernelnewbies
> Subject: Re: Question on MSI support in PCI and PCI-E devices
>
> On Mon, Mar 2, 2015 at 4:02 PM, McKay, Luke  wrote:
>> It doesn't appear that your device supports MSI.  If it did lspci -v should 
>> list the MSI capability and whether or not it is enabled.
>>
>> i.e. Something like...
>> Capabilities: [68] MSI: Enable+ Count=1/1 Maskable- 64bit+
>>
>> Without a listing that shows the capability is present, there is nothing to 
>> enable.
>>
>> Have you tried polling instead of using interrupts?  Definitely not ideal, 
>> but it might help you to determine whether hardware is dropping/missing an 
>> interrupt or whether the hardware is being completely hung up.
>>
>> Do you know if this missing interrupt is occurring in other systems as well? 
>>  How about whether it happens with different boards in the same system?  
>> Answers to these questions would help to determine whether you might have a 
>> defective board, or some sort of incompatibility with the system.
>
> We have just three setups reproducing this. We have no boards for replacement 
> experiments, unfortunately.
> Polling instead of using interrupts sounds interesting. Is there an example 
> of such usage in any other PCI device driver?
>
> --
> Bluecherry developer.
>
>
> Aeroflex is now a Cobham company


Aeroflex is now a Cobham company

--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/


RE: Question on MSI support in PCI and PCI-E devices

2015-03-02 Thread McKay, Luke
It doesn't appear that your device supports MSI.  If it did lspci -v should 
list the MSI capability and whether or not it is enabled.

i.e. Something like...
Capabilities: [68] MSI: Enable+ Count=1/1 Maskable- 64bit+

Without a listing that shows the capability is present, there is nothing to 
enable.

Have you tried polling instead of using interrupts?  Definitely not ideal, but 
it might help you to determine whether hardware is dropping/missing an 
interrupt or whether the hardware is being completely hung up.  

Do you know if this missing interrupt is occurring in other systems as well?  
How about whether it happens with different boards in the same system?  Answers 
to these questions would help to determine whether you might have a defective 
board, or some sort of incompatibility with the system.

Regards,
Luke


-- 
Luke McKay 
Senior Engineer
Cobham AvComm
T : +1 (316) 529 5585

Please consider the environment before printing this email


-Original Message-
From: Kernel-mentors [mailto:kernel-mentors-boun...@selenic.com] On Behalf Of 
Andrey Utkin
Sent: Thursday, February 12, 2015 9:12 AM
To: Stephen Hemminger
Cc: kernel-ment...@selenic.com; linux-kernel@vger.kernel.org; kernelnewbies
Subject: Re: Question on MSI support in PCI and PCI-E devices

2015-02-12 16:48 GMT+02:00 Stephen Hemminger :
> On Wed, 11 Feb 2015 18:19:00 +
> Andrey Utkin  wrote:
>
>> Is it true that _every_ PCI or PCI Express device supporting MSI is 
>> indicated by some mention of MSI in "lspci -v", and if there's no 
>> such mention, it surely doesn't support MSI?
>>
>
> Look at kernel source (drivers/pci/msi.c) function pci_msi_supported 
> there are many things which can block MSI.
>
> There can be cases where PCI quirks in kernel block MSI because for 
> example the device supports MSI, but the motherboard BIOS is broken. 
> This only happens on really old systems.

Thank you for your reply.
However, I was more interested in the case when lspci for device doesn't 
mention MSI at all, so I wonder if it makes sense to try to enable it in the 
driver at all.

04:05.0 Multimedia video controller: Bluecherry BC-H16480A 16 port
H.264 video and audio encoder / decoder
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop-
ParErr- Stepping- SERR- FastB2B- DisINTx-
Status: Cap- 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium
>TAbort- SERR-  1)
+   solo_dev->isr_more_laps++;
+   return IRQ_RETVAL(handled);
 }

 static void free_solo_dev(struct solo_dev *solo_dev) @@ -232,6 +239,16 @@ 
static ssize_t p2m_timeouts_show(struct device *dev,
return sprintf(buf, "%d\n", solo_dev->p2m_timeouts);  }

+static ssize_t isr_more_laps_show(struct device *dev,
+ struct device_attribute *attr,
+ char *buf) {
+   struct solo_dev *solo_dev =
+   container_of(dev, struct solo_dev, dev);
+
+   return sprintf(buf, "%d\n", solo_dev->isr_more_laps); }
+
 static ssize_t sdram_size_show(struct device *dev,
   struct device_attribute *attr,
   char *buf) @@ -415,6 +432,7 @@ static const 
struct device_attribute solo_dev_attrs[] = {
__ATTR_RO(input_map),
__ATTR_RO(intervals),
__ATTR_RO(sdram_offsets),
+   __ATTR_RO(isr_more_laps),
 };

 static void solo_device_release(struct device *dev) index d19c0ae..dffd7d7
--- a/drivers/media/pci/solo6x10/solo6x10-enc.c
+++ b/drivers/media/pci/solo6x10/solo6x10-enc.c
@@ -28,7 +28,7 @@
 #define VI_PROG_HSIZE  (1280 - 16)
 #define VI_PROG_VSIZE  (1024 - 16)

-#define IRQ_LEVEL  2
+#define IRQ_LEVEL  3

 static void solo_capture_config(struct solo_dev *solo_dev)  { index 
6c9bc70..4799ea2
--- a/drivers/media/pci/solo6x10/solo6x10.h
+++ b/drivers/media/pci/solo6x10/solo6x10.h
@@ -277,6 +277,8 @@ struct solo_dev {
spinlock_t  slock;
int old_write;
struct list_headvidq_active;
+
+   int isr_more_laps;
 };

 static inline u32 solo_reg_read(struct solo_dev *solo_dev, int reg)

--
Andrey Utkin
___
Kernel-mentors mailing list
kernel-ment...@selenic.com
http://selenic.com/mailman/listinfo/kernel-mentors


Aeroflex is now a Cobham company