[PHP-DEV] Problems with iconv on AIX 5.3 and 6.1 - maybe a bug

Sat, 09 Oct 2010 13:14:18 -0700 

I think it is a bug, but it might also be a misunderstanding.
Background: I am trying to convert Joomla 1.0.X to 1.5.X and ran into problems with the conversion of the database that is done during the migration. I started out by doing several of the tests/samples in the php manuals, but always got blank results. I tried changing the php.ini settings: 
[iconv]
iconv.input_encoding = ISO8859-1
iconv.internal_encoding = ISO8859-1
iconv.output_encoding = ISO8859-1
and I dont think it is really necessary - as the iconv command interface also accepts ISO-8859-1 as an argument.
Initially I was confused by the information provided by phpinfo() from Joomla 1.0.X SysInfo tab: 


   iconv

iconv support   enabled
iconv implementation    unknown
iconv library version   unknown
Only when I looked in iconv.c did I find where the "unknown" string was coming from: 

#ifdef PHP_ICONV_IMPL
REGISTER_STRING_CONSTANT("ICONV_IMPL", PHP_ICONV_IMPL, CONST_CS | CONST_PERSISTENT); 
#elif HAVE_LIBICONV
REGISTER_STRING_CONSTANT("ICONV_IMPL", "libiconv", CONST_CS | CONST_PERSISTENT); 
#elif defined(NETWARE)
REGISTER_STRING_CONSTANT("ICONV_IMPL", "Novell", CONST_CS | CONST_PERSISTENT); 
#else
REGISTER_STRING_CONSTANT("ICONV_IMPL", "unknown", CONST_CS | CONST_PERSISTENT); 
#endif
REGISTER_STRING_CONSTANT("ICONV_VERSION", version, CONST_CS | CONST_PERSISTENT); 

It seems my system is being configured, but under #else - "unknown".
I did some digging in configure. Once configures finds iconv (PHP version 5.2.13 line numbers!) 
Please note the bold lines:

*configure:45884: checking for iconv support
configure:45947: checking for iconv*
configure:45975: xlc -o conftest -L/usr/local/ssl/lib -L/usr/local/lib -L/usr/lib -L/usr/local/mysql/lib -blibpat h:/usr/local/lib:/usr/lib:/usr/local/ssl/lib:/usr/local/mysql/lib -R/usr/local/lib -L/usr/local/lib conftest.c -lf reetype -lpng -lz -ljpeg -lcurl -lz -lrt -lm -lxml2 -liconv -lm -lcurl -lxml2 -liconv -lm 1>&5 
ld: 0706-027 The -R /usr/local/lib flag is ignored.
*configure:46563: checking if iconv is glibc's*
configure:46572: xlc -o conftest -I/usr/include -L/usr/local/ssl/lib -L/usr/local/lib -L/usr/lib -L/usr/local/mysq l/lib -L/usr/lib -blibpath:/usr/local/lib:/usr/lib:/usr/local/ssl/lib:/usr/local/mysql/lib -R/usr/local/lib -L/us r/local/lib conftest.c -lfreetype -lpng -lz -ljpeg -lcurl -lz -lrt -lm -lxml2 -liconv -lm -lcurl -lxml2 -liconv - 
lm 1>&5
"configure", line 46566.10: 1506-296 (S) #include file <gnu/libc-version.h> not found. 
configure: failed program was:
#line 46565 "configure"
#include "confdefs.h"
#include <gnu/libc-version.h>
int main() {
gnu_get_libc_version();
; return 0; }
*configure:46590: checking if using GNU libiconv*
configure:46610: xlc -o conftest -I/usr/include -L/usr/local/ssl/lib -L/usr/local/lib -L/usr/lib -L/usr/local/mysq l/lib -liconv -L/usr/lib -blibpath:/usr/local/lib:/usr/lib:/usr/local/ssl/lib:/usr/local/mysql/lib -R/usr/local/l ib -L/usr/local/lib conftest.c -lfreetype -lpng -lz -ljpeg -lcurl -lz -lrt -lm -lxml2 -liconv -lm -lcurl -lxml2 - 
liconv -lm 1>&5
"configure", line 46604.22: 1506-045 (S) Undeclared identifier _libiconv_version. 
configure: failed program was:
#line 46600 "configure"
#include "confdefs.h"

#include </usr/include/iconv.h>
int main() {
        printf("%d", _libiconv_version);
        return 0;
}

*configure:46632: checking if iconv is Konstantin Chuguev's*
configure:46641: xlc -o conftest -I/usr/include -L/usr/local/ssl/lib -L/usr/local/lib -L/usr/lib -L/usr/local/mysq l/lib -L/usr/lib -blibpath:/usr/local/lib:/usr/lib:/usr/local/ssl/lib:/usr/local/mysql/lib -R/usr/local/lib -L/us r/local/lib conftest.c -lfreetype -lpng -lz -ljpeg -lcurl -lz -lrt -lm -lxml2 -liconv -lm -lcurl -lxml2 -liconv - 
lm 1>&5
ld: 0706-027 The -R /usr/local/lib flag is ignored.
ld: 0711-317 ERROR: Undefined symbol: .iconv_ccs_init
ld: 0711-345 Use the -bloadmap or -bnoquiet option to obtain more information. 
configure: failed program was:
#line 46634 "configure"
#include "confdefs.h"
#include <iconv.h>
int main() {
iconv_ccs_init(NULL, NULL);
; return 0; }
*configure:46809: checking if iconv supports errno*
configure:46844: xlc -o conftest -I/usr/include -L/usr/local/ssl/lib -L/usr/local/lib -L/usr/lib -L/usr/local/mysq l/lib -L/usr/lib -blibpath:/usr/local/lib:/usr/lib:/usr/local/ssl/lib:/usr/local/mysql/lib -R/usr/local/lib -L/us r/local/lib conftest.c -lfreetype -lpng -lz -ljpeg -lcurl -lz -lrt -lm -lxml2 -liconv -lm -lcurl -lxml2 -liconv - 
lm 1>&5
ld: 0706-027 The -R /usr/local/lib flag is ignored.
configure:46876: checking if your cpp allows macro usage in include lines
================
At this point configure has found iconv, and that it supports errno, but not the "version". 
I felt that it "should" work with *libiconv *as it's variable. In configure,
as a hack to test, I added the lines:
if { (eval echo configure:45975: \"$ac_link\") 1>&5; (eval $ac_link) 2>&5; } && test -s conftest${ac_exeext}; then 
  rm -rf conftest*
  eval "ac_cv_func_iconv=yes"
*      iconv_impl_name="aix_libiconv"
echo "MAMF TESTING:host:" $host_alias "iconv_impl_name is:" $iconv_impl_name >&5* 
else
  echo "configure: failed program was:" >&5
  cat conftest.$ac_ext >&5
  rm -rf conftest*
  eval "ac_cv_func_iconv=no"
fi

and farther below:
*echo "MAMF TESTING:host:" $host_alias "iconv_impl_name is:" $iconv_impl_name >&5* 
    case "$iconv_impl_name" in
*      aix_libiconv | gnu_libiconv )*
echo "#define PHP_ICONV_IMPL \"libiconv\"" > ext/iconv/php_php_iconv_impl.h 

        cat >> confdefs.h <<\EOF
#define PHP_ICONV_IMPL "libiconv"
EOF


  echo "#define HAVE_LIBICONV 1" > ext/iconv/php_have_libiconv.h

Now I get in configure.log
configure:45884: checking for iconv support
configure:45947: checking for iconv
configure:45975: xlc -o conftest -L/usr/local/ssl/lib -L/usr/local/lib -L/usr/lib -L/usr/local/mysql/lib -blibpat h:/usr/local/lib:/usr/lib:/usr/local/ssl/lib:/usr/local/mysql/lib -R/usr/local/lib -L/usr/local/lib conftest.c -lf reetype -lpng -lz -ljpeg -lcurl -lz -lrt -lm -lxml2 -liconv -lm -lcurl -lxml2 -liconv -lm 1>&5 
ld: 0706-027 The -R /usr/local/lib flag is ignored.
*MAMF TESTING:host: powerpc-ibm-aix5.3.0.0 iconv_impl_name is: aix_libiconv*
*configure:46563: checking if iconv is glibc's*
configure:46572: xlc -o conftest -I/usr/include -L/usr/local/ssl/lib -L/usr/local/lib -L/usr/lib -L/usr/local/mysq l/lib -L/usr/lib -blibpath:/usr/local/lib:/usr/lib:/usr/local/ssl/lib:/usr/local/mysql/lib -R/usr/local/lib -L/us r/local/lib conftest.c -lfreetype -lpng -lz -ljpeg -lcurl -lz -lrt -lm -lxml2 -liconv -lm -lcurl -lxml2 -liconv - 
lm 1>&5
"configure", line 46566.10: 1506-296 (S) #include file <gnu/libc-version.h> not found. 
configure: failed program was:
#line 46565 "configure"
#include "confdefs.h"
*#include <gnu/libc-version.h>*
int main() {
gnu_get_libc_version();
; return 0; }
*MAMF TESTING:host: powerpc-ibm-aix5.3.0.0 iconv_impl_name is: aix_libiconv
configure:46809: checking if iconv supports errno*
configure:46844: xlc -o conftest -I/usr/include -L/usr/local/ssl/lib -L/usr/local/lib -L/usr/lib -L/usr/local/mysq l/lib -L/usr/lib -blibpath:/usr/local/lib:/usr/lib:/usr/local/ssl/lib:/usr/local/mysql/lib -R/usr/local/lib -L/us r/local/lib conftest.c -liconv -lfreetype -lpng -lz -ljpeg -lcurl -lz -lrt -lm -lxml2 -liconv -lm -lcurl -lxml2 - 
liconv -lm 1>&5

... snip

configure finishes.

make runs fine until iconv.c:
r...@x105:[/data/prj/php-5.2.13.a]make
/bin/sh /data/prj/php-5.2.13.a/libtool --silent --preserve-dup-deps --mode=compile xlc -I"/usr/include" -Iext/iconv/ -I/data/prj/php-5.2.13.a/ext/iconv/ -DPHP_ATOM_INC -I/data/prj/php-5.2.13.a/include -I/data/prj/php-5.2.13.a/main -I/data/prj/php-5.2.13.a -I/data/prj/php-5.2.13.a/ext/date/lib -I/usr/local/include/libxml2 -I/usr/local/include -I/usr/local/include/freetype2 -I/usr/local/mysql/include -I/usr/local/mysql/include/mysql -I/data/prj/php-5.2.13.a/TSRM -I/data/prj/php-5.2.13.a/Zend -I/usr/include -L/usr/local/ssl/lib -L/usr/local/lib -L/usr/lib -L/usr/local/mysql/lib -c /data/prj/php-5.2.13.a/ext/iconv/iconv.c -o ext/iconv/iconv.lo "/data/prj/php-5.2.13.a/ext/iconv/iconv.c", line 265.23: 1506-045 (S) Undeclared identifier _libiconv_version. "/data/prj/php-5.2.13.a/ext/iconv/iconv.c", line 686.33: 1506-280 (W) Function argument assignment between types "unsigned int*" and "int*" is not allowed. 
make: 1254-004 The error code from the last command is 1.

So I modified iconv.c to read:

/* {{{ PHP_MINIT_FUNCTION */
PHP_MINIT_FUNCTION(miconv)
{
        char *version = "unknown";

        REGISTER_INI_ENTRIES();

*#ifndef _AIX*
#if HAVE_LIBICONV
        {
                static char buf[16];
                snprintf(buf, sizeof(buf), "%d.%d",
((_libiconv_version >> 8) & 0x0f), (_libiconv_version & 0x0f)); 
                version = buf;
        }
#elif HAVE_GLIBC_ICONV
        version = (char *)gnu_get_libc_version();
#elif defined(NETWARE)
        version = "OS built-in";
#endif
*#else
        version = "OS built-in";
#endif*

#ifdef PHP_ICONV_IMPL
REGISTER_STRING_CONSTANT("ICONV_IMPL", PHP_ICONV_IMPL, CONST_CS | CONST_PERSISTENT); 

========
To be continued. The sapi/cli/php5 is not being created now. Will be updated with changes in the 
failed make test output once I figure what has gone wrong. :(

Reply via email to