Hi Mike, Thanks for suggestions....
I think you meant, echo 1 > /sys/block/sdX/device/delete I don't see /sys/block/sdX/device/remove in my setup. How do following FIO options look? [default] rw=read size=4g bs=1m ioengine=libaio direct=1 numjobs=1 filename=/dev/sda runtime=360 iodepth=256 Thanks for your time! On Tue, Aug 26, 2014 at 4:49 PM, Michael Christie <[email protected]> wrote: > > On Aug 26, 2014, at 3:11 PM, Learner <[email protected]> wrote: > >> Another related observation and some questions; >> >> I am using open iscsi on init with IET on trgt over a single 10gbps link >> >> There are three ip aliases on each side >> >> I have 3 ramdisks exported by IET to init >> >> I do iscsi login 3 times, once using each underlying ip address and notice >> that each iscsi session sees all 3 disks. >> >> Is it possible to restrict such that each init only sees one separate disk? >> > > There is no iscsi initiator or target setting for this. The default is to > show all paths (each /dev/sdx is a path to the same device).. > > You would have to manually delete some paths by doing > > echo 1 > /sys/block/sdX/device/remove > >> When I run fio on each mounted disk, I see that only two underlying tcp >> sessions are being used - that limits the perf. >> Any ideas on how to overcome this? > > How are you matching sessions with devices? It should just be a matter of > running fio on the right devices. If you run: > > iscsiadm -m session -P 3 > > you can see how the sdXs match up with sessions/connections. If you run fio > to a /dev/sdX from each session, you should be seeing IO to all 3 sessions. > > > > >> >> Thanks! >> >> >> Sent from my iPhone >> >> On Aug 26, 2014, at 12:53 PM, "Mark Lehrer" <[email protected]> wrote: >> >>> On Tue, 26 Aug 2014 08:58:46 -0400 Alvin Starr <[email protected]> wrote: >>>> >>>>>> I am trying to achieve10Gbps in my single initiator/single target >>>>>> env. (open-iscsi and IET) >>>>> >>>>> On a semi-related note, are there any good guides out there to >>>>> tuning Linux for maximum single-socket performance? On my 40 gigabit >>>> >>>> You are likely getting hit by the bandwidth-delay product. >>>> Take a look at http://en.wikipedia.org/wiki/Bandwidth-delay_product >>>> and http://www.kehlet.cx/articles/99.html >>> >>> Thanks that helped get my netcat transfer up over 500MB/sec using IPoIB. >>> Unfortunately that is still only about 10% of the available bandwidth. >>> >>> I'll keep on tweaking and see how far I can take it. >>> >>> Thanks, >>> Mark >>> >>> -- >>> You received this message because you are subscribed to the Google Groups >>> "open-iscsi" group. >>> To unsubscribe from this group and stop receiving emails from it, send an >>> email to [email protected]. >>> To post to this group, send email to [email protected]. >>> Visit this group at http://groups.google.com/group/open-iscsi. >>> For more options, visit https://groups.google.com/d/optout. >> >> -- >> You received this message because you are subscribed to the Google Groups >> "open-iscsi" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected]. >> To post to this group, send email to [email protected]. >> Visit this group at http://groups.google.com/group/open-iscsi. >> For more options, visit https://groups.google.com/d/optout. > > -- > You received this message because you are subscribed to the Google Groups > "open-iscsi" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To post to this group, send email to [email protected]. > Visit this group at http://groups.google.com/group/open-iscsi. > For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups "open-iscsi" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/open-iscsi. For more options, visit https://groups.google.com/d/optout.
