Bug#1051418: Info received (obs-studio: clicking on an xcomposite window source makes obs segfault)

[Brian Bostwick]

On Mon, 23 Oct 2023 22:20:04 +0000 (UTC) Michael Neilly <mnei...@yahoo.com>
wrote:
> Sending in plain text so it is readable:
>
>
> I'm seeing the same bug in the latest Debian testing updated this
> morning. Specifically, if I have the following github page open in my
> browser clicking the xcomposite window source cases a seg fault as
> reported.
>
>
> Â  Â  https://github.com/pjreddie/darknet/issues/553
>
>
> This results in a window name of
>
>
>     "Error on make: 'cuda_runtime.h: No such file or directory' ·
Issue #553 · pjreddie/darknet - Brave"
>
>
> In xcompcap_props(), the name_lower variable has zero values in the
> struct which is then pushed to window_strings.array. I can't currently
> step into dstr_to_lower().
>
>
> The following shows the array entry in window_strings.array:
>
>
> Â  Â  $18 = {
> Â  Â  name_lower = {array = 0x0, len = 0, capacity = 0},
> Â  Â  name = {
> Â  Â  Â  Â  array = 0x5555570b88e0 "Error on make: 'cuda_runtime.h: No
such file or directory' · Issue #553 · pjreddie/darknet - Brave",
> Â  Â  Â  Â  len = 100,
> Â  Â  Â  Â  capacity = 101
> Â  Â  },
> Â  Â  desc = {
> Â  Â  Â  Â  array = 0x555555c24560 "54525967\r\nError on make:
'cuda_runtime.h: No such file or directory' · Issue #553 ·
pjreddie/darknet - Brave\r\nbrave-browser",
> Â  Â  Â  Â  len = 125,
> Â  Â  Â  Â  capacity = 126
> Â  Â  }
> Â  Â  }
>
>
> The following is the gdb backtrace with frame 11 being the frame where
> the above was observed.
>
>
> (gdb) bt
> #0Â  __strcmp_avx2 () at ../sysdeps/x86_64/multiarch/strcmp-avx2.S:283
> #1Â  0x00007ffff3e5de65 in msort_with_tmp (p=p@entry=0x7fffffffc510,
b=b@entry=0x7fffffffc448, n=n@entry=3) at ./stdlib/msort.c:123
> #2Â  0x00007ffff3e5ddb1 in msort_with_tmp (n=3, b=0x7fffffffc448,
p=0x7fffffffc510) at ./stdlib/msort.c:44
> #3Â  msort_with_tmp (p=p@entry=0x7fffffffc510, b=b@entry=0x7fffffffc430,
n=n@entry=6) at ./stdlib/msort.c:53
> #4Â  0x00007ffff3e5dd94 in msort_with_tmp (n=6, b=0x7fffffffc430,
p=0x7fffffffc510) at ./stdlib/msort.c:44
> #5Â  msort_with_tmp (p=p@entry=0x7fffffffc510, b=b@entry=0x7fffffffc430,
n=n@entry=12) at ./stdlib/msort.c:52
> #6Â  0x00007ffff3e5ddb1 in msort_with_tmp (n=12, b=0x7fffffffc430,
p=0x7fffffffc510) at ./stdlib/msort.c:44
> #7Â  msort_with_tmp (p=p@entry=0x7fffffffc510, b=0x7fffffffc3d8, n=n@entry=23)
at ./stdlib/msort.c:53
> #8Â  0x00007ffff3e5e23b in msort_with_tmp (n=23, b=<optimized out>,
p=0x7fffffffc510) at ./stdlib/msort.c:44
> #9Â  __GI___qsort_r (b=b@entry=0x5555570e2320, n=n@entry=23, s=s@entry=72,
cmp=cmp@entry=0x7fffe1fdaac0 <cmp_wi>, arg=arg@entry=0x0) at
./stdlib/msort.c:253
> #10 0x00007ffff3e5e3c8 in __GI_qsort (b=b@entry=0x5555570e2320, n=n@entry=23,
s=s@entry=72, cmp=cmp@entry=0x7fffe1fdaac0 <cmp_wi>) at ./stdlib/msort.c:307
> #11 0x00007fffe1fdbcb5 in xcompcap_props (unused=<optimized out>) at
./plugins/linux-capture/xcomposite-input.c:750
> #12 0x00007ffff65629f6 in obs_source_properties () at
/lib/x86_64-linux-gnu/libobs.so.0
> #13 0x000055555564c3d5 in SourceToolbar::SourceToolbar(QWidget*,
OBSSafeRef<obs_source*, &obs_source_get_ref, &obs_source_release>)
(source=..., parent=0x555555ea89a0, this=0x555556074fd0) at
./libobs/obs.hpp:103

Installing testing's nvidia-cuda-toolkit and nvidia-driver packages
resolved this for me. Originally, I installed the driver via the .run file,
which I still think can work if you ensure the cuda libs are selected
during the setup process.