I think you're still out of free fd, the error message is quite clear 
"tap_create_if: open '/dev/net/tun': Too many open files".
Looks like 8000 is not enough...
Are you sure the ulimit update does apply to the VPP process - I am asking 
because a lot of things can change it, between different users, 
/etc/security/limits.* or container restrictions...

Best
ben

> -----Original Message-----
> From: vpp-dev@lists.fd.io <vpp-dev@lists.fd.io> On Behalf Of Andre
> Courchesne
> Sent: jeudi 10 février 2022 17:04
> To: vpp-dev@lists.fd.io
> Subject: [vpp-dev] Configuration with over 800 VLANs
> 
> Hi,
> 
> I'm trying to bring up a VPP setup with over 800 VLANs. When it's bring up
> the TAP interfaces I get the following error:
> 
> 
>       Feb 10 10:32:51 vppdev-0cc47ac8fa74 vpp[11939]: tap282
>       Feb 10 10:32:51 vppdev-0cc47ac8fa74 vpp[11939]: tap283
>       Feb 10 10:32:51 vppdev-0cc47ac8fa74 vpp[11939]: tap284
>       Feb 10 10:32:53 vppdev-0cc47ac8fa74 vnet[11939]:
> linux_epoll_file_update:120: epoll_ctl: Bad file descriptor (errno 9)
>       Feb 10 10:32:53 vppdev-0cc47ac8fa74 vnet[11939]: tap: tap679:
> tap_create_if: open '/dev/net/tun': Too many open files
>       Feb 10 10:32:53 vppdev-0cc47ac8fa74 vnet[11939]: received signal
> SIGSEGV, PC 0x7f5f6918de2b, faulting address 0x0
>       Feb 10 10:32:53 vppdev-0cc47ac8fa74 vnet[11939]: #0
> 0x00007f5f695aff84 0x7f5f695aff84
>       Feb 10 10:32:53 vppdev-0cc47ac8fa74 vnet[11939]: #1
> 0x00007f5f67d5a630 0x7f5f67d5a630
>       Feb 10 10:32:53 vppdev-0cc47ac8fa74 vpp[11939]: tapCouldn't create
> /tmp/api_post_mortem.11939
>       Feb 10 10:32:53 vppdev-0cc47ac8fa74 vpp[11939]: 285
>       Feb 10 10:32:53 vppdev-0cc47ac8fa74 vpp[11939]: tap286
>       Feb 10 10:32:53 vppdev-0cc47ac8fa74 vpp[11939]: tap287
>       Feb 10 10:32:53 vppdev-0cc47ac8fa74 vpp[11939]: tap288
> 
> 
> I bumped the filesystem max open file to 8000 and it's still the same.
> Strangely it's always on tap285 which corresponds to VLAN 3273:
> 
> 
>       comment { Create loop284 -> VLAN 3273 : In Room Lan Vlan 3273 }
>       loopback create-interface
>       set int l2 bridge loop284 285 bvi
>       set int ip address loop284 172.31.34.1/27 <http://172.31.34.1/27>
>       set int state loop284 up
> 
> 
> If I remove that VLAN entirely from the configuration the error moves to
> tap288 which corresponds to VLAN 3277:
> 
> 
> 
>       Feb 10 11:00:31 vppdev-0cc47ac8fa74 vpp[30583]: tap285
>       Feb 10 11:00:31 vppdev-0cc47ac8fa74 vpp[30583]: tap286
>       Feb 10 11:00:31 vppdev-0cc47ac8fa74 vpp[30583]: tap287
>       Feb 10 11:00:34 vppdev-0cc47ac8fa74 vnet[30583]:
> linux_epoll_file_update:120: epoll_ctl: Bad file descriptor (errno 9)
>       Feb 10 11:00:34 vppdev-0cc47ac8fa74 vnet[30583]: tap: tap679:
> tap_create_if: open '/dev/net/tun': Too many open files
>       Feb 10 11:00:34 vppdev-0cc47ac8fa74 vnet[30583]: received signal
> SIGSEGV, PC 0x7fe76b685e2b, faulting address 0x0
>       Feb 10 11:00:34 vppdev-0cc47ac8fa74 vnet[30583]: #0
> 0x00007fe76baa7f84 0x7fe76baa7f84
>       Feb 10 11:00:34 vppdev-0cc47ac8fa74 vnet[30583]: #1
> 0x00007fe76a252630 0x7fe76a252630
>       Feb 10 11:00:34 vppdev-0cc47ac8fa74 vpp[30583]: tap28Couldn't create
> /tmp/api_post_mortem.30583
>       Feb 10 11:00:34 vppdev-0cc47ac8fa74 vpp[30583]: 8
>       Feb 10 11:00:34 vppdev-0cc47ac8fa74 vpp[30583]: tap289
>       Feb 10 11:00:34 vppdev-0cc47ac8fa74 vpp[30583]: tap290
>       Feb 10 11:00:34 vppdev-0cc47ac8fa74 vpp[30583]: tap291
>       Feb 10 11:00:34 vppdev-0cc47ac8fa74 vpp[30583]: tap292
> 
> 
> 
>       comment { Create loop287 -> VLAN 3277 : In Room Lan Vlan 3277 }
>       loopback create-interface
>       set int l2 bridge loop287 288 bvi
>       set int ip address loop287 172.31.34.129/27
> <http://172.31.34.129/27>
>       set int state loop287 up
> 
> 
> Interface that was loading properly before...
> 
> Any hints or clues ?
> 
> Andre
> 
>  <http://intello.com/>
> 
>       André Courchesne
> R&D Team - Software Designer / Équipe R&D - Concepteur logiciel
> andre.courche...@intello.com <mailto:andre.courche...@intello.com>
> 1 888-404-6261 x329

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#20856): https://lists.fd.io/g/vpp-dev/message/20856
Mute This Topic: https://lists.fd.io/mt/89048728/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Reply via email to