RE: Question on MSI support in PCI and PCI-E devices
I don't personally know of any PCI drivers that use polling instead of interrupts, since that would really mean the hardware is broke. Basically all you need to do is create a timer, and have it's callback set to your driver routine that can check the device status registers to determine if there is work to be done. The status register(s) would be the same indicators that should have generated an interrupt. Regards, Luke -- Luke McKay Senior Engineer Cobham AvComm T : +1 (316) 529 5585 Please consider the environment before printing this email -Original Message- From: Andrey Utkin [mailto:andrey.ut...@corp.bluecherry.net] Sent: Tuesday, March 03, 2015 8:29 AM To: McKay, Luke Cc: Andrey Utkin; Stephen Hemminger; kernel-ment...@selenic.com; linux-kernel@vger.kernel.org; kernelnewbies Subject: Re: Question on MSI support in PCI and PCI-E devices On Mon, Mar 2, 2015 at 4:02 PM, McKay, Luke wrote: > It doesn't appear that your device supports MSI. If it did lspci -v should > list the MSI capability and whether or not it is enabled. > > i.e. Something like... > Capabilities: [68] MSI: Enable+ Count=1/1 Maskable- 64bit+ > > Without a listing that shows the capability is present, there is nothing to > enable. > > Have you tried polling instead of using interrupts? Definitely not ideal, > but it might help you to determine whether hardware is dropping/missing an > interrupt or whether the hardware is being completely hung up. > > Do you know if this missing interrupt is occurring in other systems as well? > How about whether it happens with different boards in the same system? > Answers to these questions would help to determine whether you might have a > defective board, or some sort of incompatibility with the system. We have just three setups reproducing this. We have no boards for replacement experiments, unfortunately. Polling instead of using interrupts sounds interesting. Is there an example of such usage in any other PCI device driver? -- Bluecherry developer. Aeroflex is now a Cobham company
RE: Question on MSI support in PCI and PCI-E devices
Legacy INTx is shared amongst multiple devices. Since it is a level sensitive simulation of the interrupt line, it only takes one device (or driver) to forget to clear the interrupt, and then it stuck and won't work for any of the devices using it. If you're working with one particular device that seems to be causing these sorts of problems then you can verify misbehaving hardware with a PCIe analyzer. With the analyzer you can verify that when the driver informs the device that it has processed the interrupt that the device sends the deassertion message for the INTx line. Or if that isn't available, simply verifying that interrupt being cleared by the driver on the end device is taken correctly and then verifying the chain of propagation that clears the interrupt status. It can be verified through any switch that is in the path, to the root port where the legacy PCI interrupt controller that the interrupt is cleared, to the top level interrupt controller. Regards, Luke -- Luke McKay Senior Engineer Cobham AvComm T : +1 (316) 529 5585 Please consider the environment before printing this email -Original Message- From: Roger Heflin [mailto:rogerhef...@gmail.com] Sent: Wednesday, March 04, 2015 10:31 AM To: McKay, Luke Cc: Andrey Utkin; Andrey Utkin; Stephen Hemminger; kernel-ment...@selenic.com; linux-kernel@vger.kernel.org; kernelnewbies Subject: Re: Question on MSI support in PCI and PCI-E devices I know from some data I have seen that between the Intel Sandy Bridge and Intel Ivy Bridge the same motherboards stopped delivering INTx reliably (int lost under load around 1x every 30 days, driver and firmware has no method to recover from failure) We had to transition to using MSI on some PCI cards that had this issue. Our issue was duplicated on a large number of different physical machines so if it was a hardware error is was a lot of different physical machines that had the defect. On Wed, Mar 4, 2015 at 10:03 AM, McKay, Luke wrote: > I don't personally know of any PCI drivers that use polling instead of > interrupts, since that would really mean the hardware is broke. > > Basically all you need to do is create a timer, and have it's callback set to > your driver routine that can check the device status registers to determine > if there is work to be done. The status register(s) would be the same > indicators that should have generated an interrupt. > > Regards, > Luke > > > -- > Luke McKay > Senior Engineer > Cobham AvComm > T : +1 (316) 529 5585 > > Please consider the environment before printing this email > > > > -Original Message- > From: Andrey Utkin [mailto:andrey.ut...@corp.bluecherry.net] > Sent: Tuesday, March 03, 2015 8:29 AM > To: McKay, Luke > Cc: Andrey Utkin; Stephen Hemminger; kernel-ment...@selenic.com; > linux-kernel@vger.kernel.org; kernelnewbies > Subject: Re: Question on MSI support in PCI and PCI-E devices > > On Mon, Mar 2, 2015 at 4:02 PM, McKay, Luke wrote: >> It doesn't appear that your device supports MSI. If it did lspci -v should >> list the MSI capability and whether or not it is enabled. >> >> i.e. Something like... >> Capabilities: [68] MSI: Enable+ Count=1/1 Maskable- 64bit+ >> >> Without a listing that shows the capability is present, there is nothing to >> enable. >> >> Have you tried polling instead of using interrupts? Definitely not ideal, >> but it might help you to determine whether hardware is dropping/missing an >> interrupt or whether the hardware is being completely hung up. >> >> Do you know if this missing interrupt is occurring in other systems as well? >> How about whether it happens with different boards in the same system? >> Answers to these questions would help to determine whether you might have a >> defective board, or some sort of incompatibility with the system. > > We have just three setups reproducing this. We have no boards for replacement > experiments, unfortunately. > Polling instead of using interrupts sounds interesting. Is there an example > of such usage in any other PCI device driver? > > -- > Bluecherry developer. > > > Aeroflex is now a Cobham company Aeroflex is now a Cobham company -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
RE: Question on MSI support in PCI and PCI-E devices
It doesn't appear that your device supports MSI. If it did lspci -v should list the MSI capability and whether or not it is enabled. i.e. Something like... Capabilities: [68] MSI: Enable+ Count=1/1 Maskable- 64bit+ Without a listing that shows the capability is present, there is nothing to enable. Have you tried polling instead of using interrupts? Definitely not ideal, but it might help you to determine whether hardware is dropping/missing an interrupt or whether the hardware is being completely hung up. Do you know if this missing interrupt is occurring in other systems as well? How about whether it happens with different boards in the same system? Answers to these questions would help to determine whether you might have a defective board, or some sort of incompatibility with the system. Regards, Luke -- Luke McKay Senior Engineer Cobham AvComm T : +1 (316) 529 5585 Please consider the environment before printing this email -Original Message- From: Kernel-mentors [mailto:kernel-mentors-boun...@selenic.com] On Behalf Of Andrey Utkin Sent: Thursday, February 12, 2015 9:12 AM To: Stephen Hemminger Cc: kernel-ment...@selenic.com; linux-kernel@vger.kernel.org; kernelnewbies Subject: Re: Question on MSI support in PCI and PCI-E devices 2015-02-12 16:48 GMT+02:00 Stephen Hemminger : > On Wed, 11 Feb 2015 18:19:00 + > Andrey Utkin wrote: > >> Is it true that _every_ PCI or PCI Express device supporting MSI is >> indicated by some mention of MSI in "lspci -v", and if there's no >> such mention, it surely doesn't support MSI? >> > > Look at kernel source (drivers/pci/msi.c) function pci_msi_supported > there are many things which can block MSI. > > There can be cases where PCI quirks in kernel block MSI because for > example the device supports MSI, but the motherboard BIOS is broken. > This only happens on really old systems. Thank you for your reply. However, I was more interested in the case when lspci for device doesn't mention MSI at all, so I wonder if it makes sense to try to enable it in the driver at all. 04:05.0 Multimedia video controller: Bluecherry BC-H16480A 16 port H.264 video and audio encoder / decoder Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx- Status: Cap- 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- SERR- 1) + solo_dev->isr_more_laps++; + return IRQ_RETVAL(handled); } static void free_solo_dev(struct solo_dev *solo_dev) @@ -232,6 +239,16 @@ static ssize_t p2m_timeouts_show(struct device *dev, return sprintf(buf, "%d\n", solo_dev->p2m_timeouts); } +static ssize_t isr_more_laps_show(struct device *dev, + struct device_attribute *attr, + char *buf) { + struct solo_dev *solo_dev = + container_of(dev, struct solo_dev, dev); + + return sprintf(buf, "%d\n", solo_dev->isr_more_laps); } + static ssize_t sdram_size_show(struct device *dev, struct device_attribute *attr, char *buf) @@ -415,6 +432,7 @@ static const struct device_attribute solo_dev_attrs[] = { __ATTR_RO(input_map), __ATTR_RO(intervals), __ATTR_RO(sdram_offsets), + __ATTR_RO(isr_more_laps), }; static void solo_device_release(struct device *dev) index d19c0ae..dffd7d7 --- a/drivers/media/pci/solo6x10/solo6x10-enc.c +++ b/drivers/media/pci/solo6x10/solo6x10-enc.c @@ -28,7 +28,7 @@ #define VI_PROG_HSIZE (1280 - 16) #define VI_PROG_VSIZE (1024 - 16) -#define IRQ_LEVEL 2 +#define IRQ_LEVEL 3 static void solo_capture_config(struct solo_dev *solo_dev) { index 6c9bc70..4799ea2 --- a/drivers/media/pci/solo6x10/solo6x10.h +++ b/drivers/media/pci/solo6x10/solo6x10.h @@ -277,6 +277,8 @@ struct solo_dev { spinlock_t slock; int old_write; struct list_headvidq_active; + + int isr_more_laps; }; static inline u32 solo_reg_read(struct solo_dev *solo_dev, int reg) -- Andrey Utkin ___ Kernel-mentors mailing list kernel-ment...@selenic.com http://selenic.com/mailman/listinfo/kernel-mentors Aeroflex is now a Cobham company