Hi Benoit, I'm running bare metal, however on CentOS 7 so I'm not running the latest version of VPP and currently running 20.09 (which, as far as I could find, is the latest available for CentOS7).
For the file limit I'm pretty sure as the vpp runs as root and from a root shell a `ulimit -n` gave the right value (and I had rebooted after making that change). I will try to I dunno 20000 and see what that brings. I will also re-image my server with CentOS 8 and try 21.01 with the same configuration and see if it makes any difference [image: Intello by TELUS Business] <http://intello.com/> *André Courchesne* R&D Team - Software Designer / Équipe R&D - Concepteur logiciel andre.courche...@intello.com 1 888-404-6261 x329 On Thu, 10 Feb 2022 at 13:47, Benoit Ganne (bganne) <bga...@cisco.com> wrote: > I think you're still out of free fd, the error message is quite clear > "tap_create_if: open '/dev/net/tun': Too many open files". > Looks like 8000 is not enough... > Are you sure the ulimit update does apply to the VPP process - I am asking > because a lot of things can change it, between different users, > /etc/security/limits.* or container restrictions... > > Best > ben > > > -----Original Message----- > > From: vpp-dev@lists.fd.io <vpp-dev@lists.fd.io> On Behalf Of Andre > > Courchesne > > Sent: jeudi 10 février 2022 17:04 > > To: vpp-dev@lists.fd.io > > Subject: [vpp-dev] Configuration with over 800 VLANs > > > > Hi, > > > > I'm trying to bring up a VPP setup with over 800 VLANs. When it's bring > up > > the TAP interfaces I get the following error: > > > > > > Feb 10 10:32:51 vppdev-0cc47ac8fa74 vpp[11939]: tap282 > > Feb 10 10:32:51 vppdev-0cc47ac8fa74 vpp[11939]: tap283 > > Feb 10 10:32:51 vppdev-0cc47ac8fa74 vpp[11939]: tap284 > > Feb 10 10:32:53 vppdev-0cc47ac8fa74 vnet[11939]: > > linux_epoll_file_update:120: epoll_ctl: Bad file descriptor (errno 9) > > Feb 10 10:32:53 vppdev-0cc47ac8fa74 vnet[11939]: tap: tap679: > > tap_create_if: open '/dev/net/tun': Too many open files > > Feb 10 10:32:53 vppdev-0cc47ac8fa74 vnet[11939]: received signal > > SIGSEGV, PC 0x7f5f6918de2b, faulting address 0x0 > > Feb 10 10:32:53 vppdev-0cc47ac8fa74 vnet[11939]: #0 > > 0x00007f5f695aff84 0x7f5f695aff84 > > Feb 10 10:32:53 vppdev-0cc47ac8fa74 vnet[11939]: #1 > > 0x00007f5f67d5a630 0x7f5f67d5a630 > > Feb 10 10:32:53 vppdev-0cc47ac8fa74 vpp[11939]: tapCouldn't create > > /tmp/api_post_mortem.11939 > > Feb 10 10:32:53 vppdev-0cc47ac8fa74 vpp[11939]: 285 > > Feb 10 10:32:53 vppdev-0cc47ac8fa74 vpp[11939]: tap286 > > Feb 10 10:32:53 vppdev-0cc47ac8fa74 vpp[11939]: tap287 > > Feb 10 10:32:53 vppdev-0cc47ac8fa74 vpp[11939]: tap288 > > > > > > I bumped the filesystem max open file to 8000 and it's still the same. > > Strangely it's always on tap285 which corresponds to VLAN 3273: > > > > > > comment { Create loop284 -> VLAN 3273 : In Room Lan Vlan 3273 } > > loopback create-interface > > set int l2 bridge loop284 285 bvi > > set int ip address loop284 172.31.34.1/27 <http://172.31.34.1/27> > > set int state loop284 up > > > > > > If I remove that VLAN entirely from the configuration the error moves to > > tap288 which corresponds to VLAN 3277: > > > > > > > > Feb 10 11:00:31 vppdev-0cc47ac8fa74 vpp[30583]: tap285 > > Feb 10 11:00:31 vppdev-0cc47ac8fa74 vpp[30583]: tap286 > > Feb 10 11:00:31 vppdev-0cc47ac8fa74 vpp[30583]: tap287 > > Feb 10 11:00:34 vppdev-0cc47ac8fa74 vnet[30583]: > > linux_epoll_file_update:120: epoll_ctl: Bad file descriptor (errno 9) > > Feb 10 11:00:34 vppdev-0cc47ac8fa74 vnet[30583]: tap: tap679: > > tap_create_if: open '/dev/net/tun': Too many open files > > Feb 10 11:00:34 vppdev-0cc47ac8fa74 vnet[30583]: received signal > > SIGSEGV, PC 0x7fe76b685e2b, faulting address 0x0 > > Feb 10 11:00:34 vppdev-0cc47ac8fa74 vnet[30583]: #0 > > 0x00007fe76baa7f84 0x7fe76baa7f84 > > Feb 10 11:00:34 vppdev-0cc47ac8fa74 vnet[30583]: #1 > > 0x00007fe76a252630 0x7fe76a252630 > > Feb 10 11:00:34 vppdev-0cc47ac8fa74 vpp[30583]: tap28Couldn't > create > > /tmp/api_post_mortem.30583 > > Feb 10 11:00:34 vppdev-0cc47ac8fa74 vpp[30583]: 8 > > Feb 10 11:00:34 vppdev-0cc47ac8fa74 vpp[30583]: tap289 > > Feb 10 11:00:34 vppdev-0cc47ac8fa74 vpp[30583]: tap290 > > Feb 10 11:00:34 vppdev-0cc47ac8fa74 vpp[30583]: tap291 > > Feb 10 11:00:34 vppdev-0cc47ac8fa74 vpp[30583]: tap292 > > > > > > > > comment { Create loop287 -> VLAN 3277 : In Room Lan Vlan 3277 } > > loopback create-interface > > set int l2 bridge loop287 288 bvi > > set int ip address loop287 172.31.34.129/27 > > <http://172.31.34.129/27> > > set int state loop287 up > > > > > > Interface that was loading properly before... > > > > Any hints or clues ? > > > > Andre > > > > <http://intello.com/> > > > > André Courchesne > > R&D Team - Software Designer / Équipe R&D - Concepteur logiciel > > andre.courche...@intello.com <mailto:andre.courche...@intello.com> > > 1 888-404-6261 x329 > >
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#20857): https://lists.fd.io/g/vpp-dev/message/20857 Mute This Topic: https://lists.fd.io/mt/89048728/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
