Thanks Mike, Yes I have set right kernel values of rp_filter, please find the attached file which includes debug output,tcpdump and command output. Discovery works fine for eth3 but iscsiadm cant login though. I can see the packets are coming in/out at right interface eth3
Regards, Farhan On Thu, Jul 28, 2011 at 8:31 AM, Mike Christie <[email protected]> wrote: > On 07/27/2011 05:18 PM, Farhan Ahmed wrote: > > Hi Mike, > > > > Have you got chance to look into this issue? > > > > I have not. You tried changing the rp_filter values right? > > Run iscsid by hand in debug mode > > /etc/init.d/iscsid stop > iscsid -d 8 -f all > > iscsiadm -m node ..... -l > > Send iscsid output. > > Also send /var/log/messages output. Also run tcpdump to check that the > tcp ip SYN is going through the right interface. > > > > Farhan > > > > On Jul 26, 2011 12:54 PM, "Farhan Ahmed" <[email protected] > > <mailto:[email protected]>> wrote: > >> Hi Mike, > >> > >> I installed CentOS 6.0 and git code worked well. I can perform the > >> discovery now but iscsiadm cant login > >> > >> eth2 is down from the Switch > >> > >> [root@nfs02 ~]# ping 192.168.42.190 > >> PING 192.168.42.190 (192.168.42.190) 56(84) bytes of data. > >> ^C > >> --- 192.168.42.190 ping statistics --- > >> 3 packets transmitted, 0 received, 100% packet loss, time 2930ms > >> > >> [root@nfs02 ~]# ping -I eth3 192.168.42.190 > >> PING 192.168.42.190 (192.168.42.190) from 192.168.42.71 eth3: 56(84) > >> bytes of data. > >> 64 bytes from 192.168.42.190 <http://192.168.42.190>: icmp_seq=1 > > ttl=255 time=0.108 ms > >> 64 bytes from 192.168.42.190 <http://192.168.42.190>: icmp_seq=2 > > ttl=255 time=0.107 ms > >> ^C > >> --- 192.168.42.190 ping statistics --- > >> 2 packets transmitted, 2 received, 0% packet loss, time 1311ms > >> rtt min/avg/max/mdev = 0.107/0.107/0.108/0.010 ms > >> > >> [root@nfs02 ~]# iscsiadm -m discovery -p 192.168.42.190 -t st -I eth3 > >> 192.168.42.190:3260 <http://192.168.42.190:3260>,1 > > iqn.2001-05.com.equallogic:0-8a0906- > >> f0a1ed402-1f40012bba54e28b-nfs02-bond > >> > >> > >> [root@nfs02 ~]# iscsiadm -m node -T iqn.2001-05.com.equallogic: > >> 0-8a0906-f0a1ed402-1f40012bba54e28b-nfs02-bond -I eth3 -l > >> Logging in to [iface: eth3, target: iqn.2001-05.com.equallogic: > >> 0-8a0906-f0a1ed402-1f40012bba54e28b-nfs02-bond, portal: > >> 192.168.42.190,3260] (multiple) > >> iscsiadm: Could not login to [iface: eth3, target: iqn. > >> 2001-05.com.equallogic:0-8a0906-f0a1ed402-1f40012bba54e28b-nfs02-bond, > >> portal: 192.168.42.190,3260]. > >> iscsiadm: initiator reported error (8 - connection timed out) > >> iscsiadm: Could not log into all portals > >> > >> > >> Could you please advise? Secondly if we reboot our box while "eth2 is > >> down from switch" still iscsiadm cant login > >> > >> Regards, > >> > >> Farhan > >> > >> > >> > >> > >> > >> On Jul 24, 6:20 pm, Mike Christie <[email protected] > > <mailto:[email protected]>> wrote: > >>> On 07/24/2011 12:02 AM, Farhan Ahmed wrote: > >>> > >>> > It is centos 5.6. I tried to compile kernel without DEPRECATED option > >>> > but kernel didnt boot and threw errors so I had to compile it again > >>> > with DEPRECATED support, I cant udnerstand why SYSFS had no issue > with > >>> > the default version of open-iscsi. We can upgrade CENTOS from 5.6 to > >>> > 6.0. May I ask when are you releasing new version of open-scsi that > >>> > fix this routing issue? > >>> > >>> About Aug 15th. > >> > >> -- > >> You received this message because you are subscribed to the Google > > Groups "open-iscsi" group. > >> To post to this group, send email to [email protected] > > <mailto:[email protected]>. > >> To unsubscribe from this group, send email to > > [email protected] > > <mailto:open-iscsi%[email protected]>. > >> For more options, visit this group at > > http://groups.google.com/group/open-iscsi?hl=en. > >> > > > > -- > > You received this message because you are subscribed to the Google > > Groups "open-iscsi" group. > > To post to this group, send email to [email protected]. > > To unsubscribe from this group, send email to > > [email protected]. > > For more options, visit this group at > > http://groups.google.com/group/open-iscsi?hl=en. > > -- You received this message because you are subscribed to the Google Groups "open-iscsi" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/open-iscsi?hl=en.
iscsid -d 8 -f all iscsid: sysfs_init: sysfs_path='/sys' iscsid: sysfs_attr_get_value: open '/module/scsi_transport_iscsi'/'version' iscsid: sysfs_attr_get_value: new uncached attribute '/sys/module/scsi_transport_iscsi/version' iscsid: sysfs_attr_get_value: add to cache '/sys/module/scsi_transport_iscsi/version' iscsid: sysfs_attr_get_value: cache '/sys/module/scsi_transport_iscsi/version' with attribute value '2.0-870' iscsid: transport class version 2.0-870. iscsid version 2.0-872 iscsid: in ctldev_open iscsid: created NETLINK_ISCSI socket... iscsid: InitiatorName=iqn.2005-03.org.open-iscsi:aa77d365579b iscsid: InitiatorName=iqn.2005-03.org.open-iscsi:aa77d365579b iscsid: InitiatorAlias=nfs02 iscsid: Max file limits 1024 1024 iscsid: found 192.168.42.190,3260 iscsid: Looking for config file /etc/iscsi/send_targets/192.168.42.190,3260 iscsid: Looking for config file /etc/iscsi/send_targets/192.168.42.190,3260 config st_config. iscsid: updated 'discovery.startup', 'manual' => 'manual' iscsid: updated 'discovery.type', 'sendtargets' => 'sendtargets' iscsid: updated 'discovery.sendtargets.address', '' => '192.168.42.190' iscsid: updated 'discovery.sendtargets.port', '0' => '3260' iscsid: updated 'discovery.sendtargets.auth.authmethod', 'None' => 'None' iscsid: updated 'discovery.sendtargets.timeo.login_timeout', '15' => '15' iscsid: updated 'discovery.sendtargets.use_discoveryd', 'No' => 'No' iscsid: updated 'discovery.sendtargets.discoveryd_poll_inval', '30' => '30' iscsid: updated 'discovery.sendtargets.reopen_max', '5' => '5' iscsid: updated 'discovery.sendtargets.timeo.auth_timeout', '45' => '45' iscsid: updated 'discovery.sendtargets.timeo.active_timeout', '30' => '30' iscsid: updated 'discovery.sendtargets.iscsi.MaxRecvDataSegmentLength', '32768' => '32768' iscsid: st_start 192.168.42.190:3260 0 iscsid: reaped pid 10867, reap_count now 0 iscsid: poll result 1 iscsid: mgmt_ipc_write_rsp: rsp to fd 5 iscsid: poll result 1 iscsid: mgmt_ipc_write_rsp: rsp to fd 5 iscsid: poll result 1 iscsid: mgmt_ipc_write_rsp: rsp to fd 5 iscsid: poll result 1 iscsid: mgmt_ipc_write_rsp: rsp to fd 5 iscsid: thread 01f7c900 wait some more iscsid: thread 01f7c900 was scheduled at 218:4, curtime 224 q_forw 0x6650b0 &pend_list 0x6650b0 iscsid: thread 01f7c900 now in actor_list iscsid: exec thread 01f7c900 callback iscsid: iscsi_login_eh iscsid: login failed STATE_IN_LOGIN/R_STAGE_NO_CHANGE 0 iscsid: re-opening session 20 (reopen_cnt 0) iscsid: thread 01f7c900 delete: state 3 iscsid: thread 01f7c938 delete: state 0 iscsid: disconnecting conn 0x1f7a438, fd 6 iscsid: in kstop_conn iscsid: in __kipc_call iscsid: in kwritev iscsid: in nlpayload_read iscsid: in nlpayload_read iscsid: connection 20:0 is stopped for recovery iscsid: Waiting 2 seconds before trying to reconnect. iscsid: Requeue reopen attempt in 2 secs iscsid: thread 01f7c900 delete: state 3 iscsid: thread 0x1f7c900 schedule: delay 8 state 3 iscsid: thread removed iscsid: thread 01f7c900 wait some more iscsid: thread 01f7c900 wait some more iscsid: thread 01f7c900 was scheduled at 224:8, curtime 233 q_forw 0x6650b0 &pend_list 0x6650b0 iscsid: thread 01f7c900 now in actor_list iscsid: exec thread 01f7c900 callback iscsid: iscsi_login_eh iscsid: login failed STATE_XPT_WAIT/R_STAGE_NO_CHANGE iscsid: Giving up on initial login attempt after 2 seconds. iscsid: disconnect conn iscsid: kdestroy conn iscsid: in kdestroy_conn iscsid: in __kipc_call iscsid: in kwritev iscsid: in nlpayload_read iscsid: in nlpayload_read iscsid: kdestroy session 20 iscsid: in kdestroy_session iscsid: in __kipc_call iscsid: in kwritev iscsid: in nlpayload_read iscsid: expecting event 12, got 105, handling... iscsid: in ctldev_handle iscsid: in nl_read iscsid: ctldev_handle got event type 105 iscsid: get ev context 0x1f7ea50 iscsid: message real length is 72 bytes, recv_handle 0x1f7eaa0 iscsid: in nlpayload_read iscsid: sched conn context 0x1f7ea50 event 5, tmo 0 iscsid: thread 0x1f7ea50 schedule: delay 0 state 3 iscsid: in nlpayload_read iscsid: expecting event 12, got 104, handling... iscsid: in ctldev_handle iscsid: in nl_read iscsid: ctldev_handle got event type 104 iscsid: in nlpayload_read iscsid: session destroyed sid 20 host no 28 iscsid: in nlpayload_read iscsid: in nlpayload_read iscsid: Connection20:0 to [target: iqn.2001-05.com.equallogic:0-8a0906-f0a1ed402-1f40012bba54e28b-nfs02-bond, portal: 192.168.42.190,3260] through [iface: eth3] is shutdown. iscsid: mgmt_ipc_write_rsp: rsp to fd 5 iscsid: thread 01f7c900 delete: state 3 iscsid: thread 01f7c938 delete: state 3 iscsid: destroying session iscsid: thread 01f7ea50 delete: state 4 iscsid: deleting a scheduled/waiting thread! iscsid: put ev context 0x1f7ea50 iscsid: Releasing session 0x1f77410 iscsid: thread removed [root@nfs02 ~]# tcpdump -i eth3 port 3260 tcpdump: verbose output suppressed, use -v or -vv for full protocol decode listening on eth3, link-type EN10MB (Ethernet), capture size 65535 bytes 09:03:37.840480 IP 192.168.42.71.59960 > 192.168.42.190.iscsi-target: Flags [S], seq 153217901, win 5840, options [mss 1460,sackOK,TS val 152947365 ecr 0,nop,wscale 8], length 0 09:03:37.840588 IP 192.168.42.190.iscsi-target > 192.168.42.71.59960: Flags [S.], seq 1531618649, ack 153217902, win 65535, options [mss 1460,nop,wscale 5,nop,nop,TS val 0 ecr 152947365], length 0 09:03:37.840601 IP 192.168.42.71.59960 > 192.168.42.190.iscsi-target: Flags [.], ack 1, win 23, options [nop,nop,TS val 152947365 ecr 0], length 0 09:03:37.840793 IP 192.168.42.190.iscsi-target > 192.168.42.71.59960: Flags [.], ack 1, win 2304, options [nop,nop,TS val 0 ecr 0], length 0 09:03:38.096827 IP 192.168.42.71.59960 > 192.168.42.190.iscsi-target: Flags [P.], seq 1:49, ack 1, win 23, options [nop,nop,TS val 152947621 ecr 0], length 48 09:03:38.096843 IP 192.168.42.71.59960 > 192.168.42.190.iscsi-target: Flags [P.], seq 49:541, ack 1, win 23, options [nop,nop,TS val 152947621 ecr 0], length 492 09:03:38.097094 IP 192.168.42.190.iscsi-target > 192.168.42.71.59960: Flags [.], ack 541, win 2288, options [nop,nop,TS val 2 ecr 152947621], length 0 09:03:39.098340 IP 192.168.42.71.59960 > 192.168.42.190.iscsi-target: Flags [F.], seq 541, ack 1, win 23, options [nop,nop,TS val 152948623 ecr 2], length 0 09:03:39.098577 IP 192.168.42.190.iscsi-target > 192.168.42.71.59960: Flags [F.], seq 1, ack 542, win 2304, options [nop,nop,TS val 10 ecr 152948623], length 0 09:03:39.098594 IP 192.168.42.71.59960 > 192.168.42.190.iscsi-target: Flags [.], ack 2, win 23, options [nop,nop,TS val 152948623 ecr 10], length 0 [root@nfs02 ~]# iscsiadm -m discovery -p 192.168.42.190 -t st -I eth3 192.168.42.190:3260,1 iqn.2001-05.com.equallogic:0-8a0906-f0a1ed402-1f40012bba54e28b-nfs02-bond [root@nfs02 ~]# iscsiadm -m node -T iqn.2001-05.com.equallogic:0-8a0906-f0a1ed402-1f40012bba54e28b-nfs02-bond -I eth3 -l Logging in to [iface: eth3, target: iqn.2001-05.com.equallogic:0-8a0906-f0a1ed402-1f40012bba54e28b-nfs02-bond, portal: 192.168.42.190,3260] (multiple) iscsiadm: Could not login to [iface: eth3, target: iqn.2001-05.com.equallogic:0-8a0906-f0a1ed402-1f40012bba54e28b-nfs02-bond, portal: 192.168.42.190,3260]. iscsiadm: initiator reported error (8 - connection timed out) iscsiadm: Could not log into all portals Jul 28 08:52:14 nfs02 kernel: igb: eth2 NIC Link is Down Jul 28 08:52:58 nfs02 kernel: igb: eth2 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX Jul 28 08:53:17 nfs02 iscsid: iscsid shutting down. Jul 28 08:53:49 nfs02 kernel: igb: eth2 NIC Link is Down Jul 28 08:55:27 nfs02 kernel: scsi25 : iSCSI Initiator over TCP/IP Jul 28 08:56:13 nfs02 kernel: Bluetooth: Core ver 2.15 Jul 28 08:56:13 nfs02 kernel: NET: Registered protocol family 31 Jul 28 08:56:13 nfs02 kernel: Bluetooth: HCI device and connection manager initialized Jul 28 08:56:13 nfs02 kernel: Bluetooth: HCI socket layer initialized Jul 28 08:56:52 nfs02 kernel: device eth0 entered promiscuous mode Jul 28 08:56:58 nfs02 kernel: device eth0 left promiscuous mode Jul 28 08:57:05 nfs02 kernel: device eth3 entered promiscuous mode Jul 28 08:57:08 nfs02 kernel: scsi26 : iSCSI Initiator over TCP/IP Jul 28 08:57:28 nfs02 kernel: device eth3 left promiscuous mode Jul 28 08:57:33 nfs02 kernel: device eth2 entered promiscuous mode Jul 28 08:57:37 nfs02 kernel: scsi27 : iSCSI Initiator over TCP/IP Jul 28 09:02:04 nfs02 kernel: scsi28 : iSCSI Initiator over TCP/IP Jul 28 09:03:00 nfs02 kernel: device eth2 left promiscuous mode Jul 28 09:03:06 nfs02 kernel: device eth3 entered promiscuous mode Jul 28 09:03:14 nfs02 kernel: device eth3 left promiscuous mode Jul 28 09:03:16 nfs02 kernel: device eth3 entered promiscuous mode Jul 28 09:03:21 nfs02 kernel: scsi29 : iSCSI Initiator over TCP/IP Jul 28 09:03:31 nfs02 kernel: device eth3 left promiscuous mode Jul 28 09:03:32 nfs02 kernel: device eth3 entered promiscuous mode Jul 28 09:03:38 nfs02 kernel: scsi30 : iSCSI Initiator over TCP/IP Jul 28 09:03:59 nfs02 kernel: device eth3 left promiscuous mode net.ipv4.ip_forward = 0 net.ipv4.conf.default.rp_filter = 2 net.ipv4.conf.default.accept_source_route = 0 kernel.sysrq = 0 kernel.core_uses_pid = 1 net.ipv4.tcp_syncookies = 1 kernel.msgmnb = 65536 kernel.msgmax = 65536 kernel.shmmax = 68719476736 kernel.shmall = 4294967296 net.ipv4.conf.all.arp_ignore = 1 net.ipv4.conf.all.arp_announce = 2 net.ipv4.conf.all.rp_filter = 2 net.core.rmem_max=8388608 net.core.wmem_max=8388608 net.core.rmem_default=65536 net.core.wmem_default=65536 net.ipv4.tcp_rmem='8192 87380 8388608' net.ipv4.tcp_wmem='8192 65536 8388608' net.ipv4.tcp_mem='8388608 8388608 8388608' net.ipv4.route.flush=1
