Here I’m testing with an earlier message that originally failed.
It eventually came thru after I simplified the .forward.
2023-06-02 12:36:42 cwd=/var/spool/exim 3 args: /usr/sbin/exim -Mc
1q5AZm-0002cJ-0b
2023-06-02 12:36:42 1q5AZm-0002cJ-0b <= bbar...@matlensilver.com
H=mail-lf1-f42.google.com [209.85.167.42] P=esmtps
X=TLS1.2:ECDHE-ECDSA-AES128-GCM-SHA256:128 CV=no S=8426
DKIM=matlensilver-com.20221208.gappssmtp.com
id=camp+ihqxhtpwwbwrj4ifg27gqx+-yqf8bagrgqphacpait-...@mail.gmail.com T="Test
#2" from <bbar...@matlensilver.com> for rob...@elastica.com
2023-06-02 12:36:42 1q5AZm-0002cJ-0b SIGSEGV (fault address: (nil))
2023-06-02 12:36:42 1q5AZm-0002cJ-0b SIGSEGV (null pointer indirection)
2023-06-02 12:36:42 1q5AZm-0002cJ-0b internal problem in userforward router
(recipient is elast...@lhvm02.lizardhill.com): failure to transfer data from
subprocess: status=0100 readerror='No such file or directory'
2023-06-02 12:36:42 1q5AZm-0002cJ-0b == elast...@lhvm02.lizardhill.com
<rob...@elastica.com> R=userforward defer (-1): internal problem in userforward
router (recipient is elast...@lhvm02.lizardhill.com): failure to transfer data
from subprocess: status=0100 readerror='No such file or directory'
2023-06-02 13:16:23 1q5AZm-0002cJ-0b => |$home/perlscripts/filter.sh
(elast...@lhvm02.lizardhill.com) <rob...@elastica.com>
F=<bbar...@matlensilver.com> R=userforward T=address_pipe S=8481
2023-06-02 13:16:23 1q5AZm-0002cJ-0b Completed
-----
This is with the working .forward file.
exim -bf ~/.forward </tmp/6.txt
Return-path copied from sender
Sender = elast...@lhvm02.lizardhill.com
Recipient = elast...@lhvm02.lizardhill.com
Testing Exim filter file "/home/elastica/.forward"
Logfile /home/elastica/filter.log
Logwrite "Sat, 03 Jun 2023 08:39:37 -0700 GOT from mail-lf1-f42.google.com
([209.85.167.42])\n by lhvm02.lizardhill.com with esmtps (TLS1.2) tls
TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256\n (Exim 4.96-58-g4e9ed49f8)\n
(envelope-from <bbar...@matlensilver.com>)\n id 1q5AZm-0002cJ-0b\n for
rob...@elastica.com;\n Fri, 02 Jun 2023 12:36:42 -0700\nby
mail-lf1-f42.google.com with SMTP id 2adb3069b0e04-4f004cc54f4so3402189e87.3\n
for <rob...@elastica.com>; Fri, 02 Jun 2023 12:36:39 -0700 (PDT) Fri, 2
Jun 2023 15:36:25 -0400 message from Brandon Barlow <bbar...@matlensilver.com>
to rob...@elastica.com about Test #2\n"
Pipe message to: $home/perlscripts/filter.sh
Finish
Filtering set up at least one significant delivery or other action.
No other deliveries will occur.
This is testing with a .forward that was failing with this message.
exim -bf ~/.forward.20230602 </tmp/6.txt
Return-path copied from sender
Sender = elast...@lhvm02.lizardhill.com
Recipient = elast...@lhvm02.lizardhill.com
Testing Exim filter file "/home/elastica/.forward.20230602"
Logfile /home/elastica/filter.log
Logwrite "Sat, 03 Jun 2023 08:39:20 -0700 GOT from mail-lf1-f42.google.com
([209.85.167.42])\n by lhvm02.lizardhill.com with esmtps (TLS1.2) tls
TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256\n (Exim 4.96-58-g4e9ed49f8)\n
(envelope-from <bbar...@matlensilver.com>)\n id 1q5AZm-0002cJ-0b\n for
rob...@elastica.com;\n Fri, 02 Jun 2023 12:36:42 -0700\nby
mail-lf1-f42.google.com with SMTP id 2adb3069b0e04-4f004cc54f4so3402189e87.3\n
for <rob...@elastica.com>; Fri, 02 Jun 2023 12:36:39 -0700 (PDT) Fri, 2
Jun 2023 15:36:25 -0400 message from Brandon Barlow <bbar...@matlensilver.com>
to rob...@elastica.com about Test #2\n"
Pipe message to: $home/perlscripts/filter.sh
Finish
Filtering set up at least one significant delivery or other action.
No other deliveries will occur.
-----
So you can see I don’t really have a very good way to test since the above
isn’t reproducing the issue as far as I can tell.
If it’s relevant here’s my attempt at -d
working .forward
exim -d -bf ~/.forward </tmp/6.txt
Exim version 4.96-58-g4e9ed49f8 uid=1043 gid=1045 pid=30436 D=f7715cfd
Support for: crypteq IPv6 Perl OpenSSL TLS_resume move_frozen_messages
Content_Scanning DKIM DNSSEC Event OCSP PIPECONNECT PRDR Queue_Ramp SPF SRS
TCP_Fast_Open
Lookups (built-in): lsearch wildlsearch nwildlsearch iplsearch cdb dbm dbmjz
dbmnz dnsdb
Authenticators: cram_md5 dovecot plaintext spa
Routers: accept dnslookup ipliteral manualroute queryprogram redirect
Transports: appendfile/maildir/mailstore/mbx autoreply lmtp pipe smtp
Malware: f-protd f-prot6d drweb aveserver fsecure kavdaemon sophie clamd mksd
avast sock cmdline
Fixed never_users: 0
Configure owner: 0:0
Size of off_t: 8
Compiler: GCC [4.8.5 20150623 (Red Hat 4.8.5-44)]
Library version: Glibc: Compile: 2.17
Runtime: 2.17
Library version: BDB: Compile: Berkeley DB 5.3.21: (May 11, 2012)
Runtime: Berkeley DB 5.3.21: (May 11, 2012)
Library version: OpenSSL: Compile: OpenSSL 1.0.2k-fips 26 Jan 2017
Runtime: OpenSSL 1.0.2k-fips 26 Jan 2017
: built on: reproducible build, date
unspecified
Library version: spf2: Compile: 1.2.11
Runtime: 1.2.11
Library version: PCRE2: Compile: 10.35
Runtime: 10.35 2020-05-09
Total 11 lookups
WHITELIST_D_MACROS unset
TRUSTED_CONFIG_LIST unset
changed uid/gid: -C, -D, -be or -bf forces real uid
uid=1043 gid=1045 pid=30436
auxiliary group list: 1045
seeking password data for user "mail": cache not available
getpwnam() succeeded uid=8 gid=12
seeking password data for user "majordomo": cache not available
getpwnam() succeeded uid=993 gid=2
seeking password data for user "diradmin": cache not available
getpwnam() succeeded uid=995 gid=995
seeking password data for user "root": cache not available
getpwnam() succeeded uid=0 gid=0
openssl option, adding to 03104000: 01000000 (no_sslv2 +no_sslv3 +no_tlsv1
+no_tlsv1_1 +cipher_server_preference)
openssl option, adding to 03104000: 02000000 (no_sslv3 +no_tlsv1
+no_tlsv1_1 +cipher_server_preference)
openssl option, adding to 03104000: 04000000 (no_tlsv1 +no_tlsv1_1
+cipher_server_preference)
openssl option, adding to 07104000: 10000000 (no_tlsv1_1
+cipher_server_preference)
openssl option, adding to 17104000: 00400000 (cipher_server_preference)
XDG_SESSION_ID in keep_environment? no (end of list)
HOSTNAME in keep_environment? no (end of list)
TERM in keep_environment? no (end of list)
SHELL in keep_environment? no (end of list)
HISTSIZE in keep_environment? no (end of list)
SSH_CLIENT in keep_environment? no (end of list)
PERL5LIB in keep_environment? no (end of list)
SSH_TTY in keep_environment? no (end of list)
USER in keep_environment? no (end of list)
LS_COLORS in keep_environment? no (end of list)
MAIL in keep_environment? no (end of list)
PATH in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
LANG in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HISTCONTROL in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
SHLVL in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
LOGNAME in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
SSH_CONNECTION in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
LESSOPEN in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
XDG_RUNTIME_DIR in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
_ in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
OLDPWD in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
configuration file is /etc/exim.conf
log selectors = 000024ac 73205036 0000000e
exim: debugging permission denied
Problematic .forward
exim -d -bf ~/.forward.20230602 </tmp/6.txt
Exim version 4.96-58-g4e9ed49f8 uid=1043 gid=1045 pid=30492 D=f7715cfd
Support for: crypteq IPv6 Perl OpenSSL TLS_resume move_frozen_messages
Content_Scanning DKIM DNSSEC Event OCSP PIPECONNECT PRDR Queue_Ramp SPF SRS
TCP_Fast_Open
Lookups (built-in): lsearch wildlsearch nwildlsearch iplsearch cdb dbm dbmjz
dbmnz dnsdb
Authenticators: cram_md5 dovecot plaintext spa
Routers: accept dnslookup ipliteral manualroute queryprogram redirect
Transports: appendfile/maildir/mailstore/mbx autoreply lmtp pipe smtp
Malware: f-protd f-prot6d drweb aveserver fsecure kavdaemon sophie clamd mksd
avast sock cmdline
Fixed never_users: 0
Configure owner: 0:0
Size of off_t: 8
Compiler: GCC [4.8.5 20150623 (Red Hat 4.8.5-44)]
Library version: Glibc: Compile: 2.17
Runtime: 2.17
Library version: BDB: Compile: Berkeley DB 5.3.21: (May 11, 2012)
Runtime: Berkeley DB 5.3.21: (May 11, 2012)
Library version: OpenSSL: Compile: OpenSSL 1.0.2k-fips 26 Jan 2017
Runtime: OpenSSL 1.0.2k-fips 26 Jan 2017
: built on: reproducible build, date
unspecified
Library version: spf2: Compile: 1.2.11
Runtime: 1.2.11
Library version: PCRE2: Compile: 10.35
Runtime: 10.35 2020-05-09
Total 11 lookups
WHITELIST_D_MACROS unset
TRUSTED_CONFIG_LIST unset
changed uid/gid: -C, -D, -be or -bf forces real uid
uid=1043 gid=1045 pid=30492
auxiliary group list: 1045
seeking password data for user "mail": cache not available
getpwnam() succeeded uid=8 gid=12
seeking password data for user "majordomo": cache not available
getpwnam() succeeded uid=993 gid=2
seeking password data for user "diradmin": cache not available
getpwnam() succeeded uid=995 gid=995
seeking password data for user "root": cache not available
getpwnam() succeeded uid=0 gid=0
openssl option, adding to 03104000: 01000000 (no_sslv2 +no_sslv3 +no_tlsv1
+no_tlsv1_1 +cipher_server_preference)
openssl option, adding to 03104000: 02000000 (no_sslv3 +no_tlsv1
+no_tlsv1_1 +cipher_server_preference)
openssl option, adding to 03104000: 04000000 (no_tlsv1 +no_tlsv1_1
+cipher_server_preference)
openssl option, adding to 07104000: 10000000 (no_tlsv1_1
+cipher_server_preference)
openssl option, adding to 17104000: 00400000 (cipher_server_preference)
XDG_SESSION_ID in keep_environment? no (end of list)
HOSTNAME in keep_environment? no (end of list)
TERM in keep_environment? no (end of list)
SHELL in keep_environment? no (end of list)
HISTSIZE in keep_environment? no (end of list)
SSH_CLIENT in keep_environment? no (end of list)
PERL5LIB in keep_environment? no (end of list)
SSH_TTY in keep_environment? no (end of list)
USER in keep_environment? no (end of list)
LS_COLORS in keep_environment? no (end of list)
MAIL in keep_environment? no (end of list)
PATH in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
LANG in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HISTCONTROL in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
SHLVL in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
LOGNAME in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
SSH_CONNECTION in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
LESSOPEN in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
XDG_RUNTIME_DIR in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
_ in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
OLDPWD in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
configuration file is /etc/exim.conf
log selectors = 000024ac 73205036 0000000e
exim: debugging permission denied
> On Jun 3, 2023, at 5:50 AM, Andrew C Aitchison via Exim-users
> <exim-users@lists.exim.org> wrote:
>
> On Fri, 2 Jun 2023, Robert Nicholson via Exim-users wrote:
>
>> I’ve shrunk the .forward now and some of the problematic emails
>> started getting delivered.
>>
>> Still I don’t have root cause.
>>
>> But I’m told that the backup that you see me saving things into it’s
>> immediate but rather delayed hence the messages don’t end up there
>> either.
>>
>> The biggest contributor making this difficult to resolve is largely
>> the inability to push test data thru it without involving Admins
>> (takes time) because I don’t have the actual messages nor can I push
>> it thru end to end thru userforward etc myself as I don’t have the
>> permissions.
>
> I am a bit confused. You say that some of the problematic messages have been
> delivered but you don't have actual messages.
>
> Does `exim -bf ~/.forward < ... ` work in your circumstances ?
>
> --
> Andrew C. Aitchison Kendal, UK
> and...@aitchison.me.uk
>
> --
> ## subscription configuration (requires account):
> ##
> https://lists.exim.org/mailman3/postorius/lists/exim-users.lists.exim.org/
> ## unsubscribe (doesn't require an account):
> ## exim-users-unsubscr...@lists.exim.org
> ## Exim details at http://www.exim.org/
> ## Please use the Wiki with this list - http://wiki.exim.org/
--
## subscription configuration (requires account):
## https://lists.exim.org/mailman3/postorius/lists/exim-users.lists.exim.org/
## unsubscribe (doesn't require an account):
## exim-users-unsubscr...@lists.exim.org
## Exim details at http://www.exim.org/
## Please use the Wiki with this list - http://wiki.exim.org/
