Beta release of gawk 4.2.0 now available

2017-10-04 Thread Arnold Robbins
This note is to announce the BETA release of GNU Awk 4.2.0

It is available from:

http://www.skeeve.com/gawk/gawk-4.1.65.tar.gz

This is a major release, with many significant new features.
The important part of the NEWS file is below.

As far as I can tell, the documentation and code have both hit the
freeze point.

So, why do a beta release? So that you, yes you, the end user, can see
if anything I've done breaks gawk for you.  Then you can TELL ME ABOUT
IT so that I can fix it for the final release.

Thanks,

Arnold Robbins
arn...@skeeve.com
-
   Copyright (C) 2010, 2011, 2012, 2013, 2014, 2015, 2016, 2017
   Free Software Foundation, Inc.
   
   Copying and distribution of this file, with or without modification,
   are permitted in any medium without royalty provided the copyright
   notice and this notice are preserved.

Changes from 4.1.4 to 4.2.0
---

1. If not in POSIX mode, changes to ENVIRON are reflected into
   gawk's environment, affecting any programs run by system()
   or for piped redirections. This can also affect built-in routines, such
   as mktime(), which is typically influenced by the TZ environment variable.

2. The series of numbers returned by rand() should now be "more
   random" than previously.  Gawk's rand() remains repeatable; you will
   get the same series of numbers each time you call rand() repeatedly,
   but this will be a different series than previously.

3. The --pretty-print option no longer runs the program too.

4. The igawk script and igawk.1 man page are no longer installed by
   `make install'.  They have been obsolete since gawk 4.0.0.

5. Gawk can now be built with CMake.  This is an alternative build
   system for those who may want it; gawk is not going to switch off
   use of the autotools anytime soon, if ever.

6. Gawk now processes a maximum of two hexadecimal digits in \x
   escape sequences inside strings.

7. Setting PROCINFO["redirection", "NONFATAL"] to true makes I/O
   errors for "redirection" not fatal, setting ERRNO. Setting
   PROCINFO["NONFATAL"] makes all I/O nonfatal.

8. MirBSD is no longer supported.

9. Pretty printing now preserves comments and places them into the
   pretty-printed file.

10. `make install' now installs shell startup files
$sysconfdir/profile.d/gawk.{csh,sh} containing shell functions to
manipulate the AWKPATH and AWKLIBPATH environment variables.  On a Fedora
system, these files belong in /etc/profile.d, but the appropriate location
may be different on other platforms.

11. Gawk now supports retryable I/O via PROCINFO[input-file, "RETRY"]; see
the manual.

12. The API minor version has been increased to 2; the get_file()
API provides access to open redirections. Also see the manual.

13. Revisions in the POSIX standard remove the special case for POSIX
mode when FS = " " where newline was not a field separator. The code
and doc have been updated.

14. Gawk now supports strongly typed regexp constants. Such constants
look like @/.../.  You can assign them to variables, pass them to
functions, use them in ~, !~ and the case part of a switch statement.
More details are provided in the manual.

15. The new typeof() function can be used to indicate if a variable or
array element is an array, regexp, string or number.  The isarray()
function is deprecated in favor of typeof().

16. As promised when 4.1 was released, the old extension mechanism,
using the `extension' function, is now gone.

17. Support for GNU/Linux on Alpha systems has been removed.

18. Optimizations are now enabled by default. Use the new -s/--no-optimize
option(s) to disable them.  Pretty-printing and profiling automatically
disable optimizations so that the output program is the same as the
original input program.

19. The extension API now provides a mechanism for generating nonfatal
error messages.

21. Gawk now uses fwrite_unlocked if it's available. The yields a 7% - 18%
improvement in raw output speed (gawk '{ print }' on a large file).

22. Pretty-printing now uses the original text of constant numeric values for
pretty-printing and profiling.

23. Passing negative operands to any of the bitwise functions now
produces a fatal error.

24. The C API has undergone changes that break binary compatibility with
the previous version. Thus the API version is now at 2.0.  YOU WILL
NEED TO RECOMPILE YOUR EXTENSIONS to work with this version of gawk.
Source code compatibility remains intact, although you will get
compiler warnings if you do not revise your extensions. We strongly
recommend that you do so.  Fortunately, the changes are fairly minor
and straightforward.

25. Programs that toggle IGNORECASE a lot should now be noticeably faster.

26. The mktime func

gawk 4.2.0 released!

2017-10-19 Thread Arnold Robbins
Greetings all.

This note announces the next major release of GNU Awk: version 4.2.0.

The following files may be retrieved from ftp://ftp.gnu.org/gnu/gawk,
or via HTTPS from https://ftp.gnu.org/gnu/gawk:

-rw-rw-r-- 1 arnold arnold 5602299 Oct 19 21:29 gawk-4.2.0.tar.gz
-rw-rw-r-- 1 arnold arnold 473 Oct 19 21:38 gawk-4.2.0.tar.gz.sig
-rw-rw-r-- 1 arnold arnold 2853125 Oct 19 21:28 gawk-4.2.0.tar.lz
-rw-rw-r-- 1 arnold arnold 473 Oct 19 21:38 gawk-4.2.0.tar.lz.sig
-rw-rw-r-- 1 arnold arnold 2948108 Oct 19 21:29 gawk-4.2.0.tar.xz
-rw-rw-r-- 1 arnold arnold 473 Oct 19 21:38 gawk-4.2.0.tar.xz.sig

This is a major new release, with a number of new features.  The relevant
part of the NEWS file is appended below.

This release represents over four years of very hard work by a number
of people.  I thank them all for their contributions, I could not have
done it by myself.

Differences from gawk 4.1.4 are not available; they would be too large.

The usual GNU build incantation should be used:

tar -xpvzf gawk-4.2.0.tar.gz
cd gawk-4.2.0
./configure && make && make check

Bug reports should be sent to bug-g...@gnu.org.

Enjoy!

Arnold Robbins (on behalf of all the gawk developers)
arn...@skeeve.com

Changes from 4.1.4 to 4.2.0
---

1. If not in POSIX mode, changes to ENVIRON are reflected into
   gawk's environment, affecting any programs run by system()
   or for piped redirections. This can also affect built-in routines, such
   as mktime(), which is typically influenced by the TZ environment variable.

2. The series of numbers returned by rand() should now be "more
   random" than previously.  Gawk's rand() remains repeatable; you will
   get the same series of numbers each time you call rand() repeatedly,
   but this will be a different series than previously.

3. Multiple changes related to the pretty printer:

   * The --pretty-print option no longer runs the program too.

   * Pretty printing now preserves comments and places them into the
 pretty-printed file.

   * Pretty-printing now uses the original text of constant numeric values
 for pretty-printing and profiling.

   * Pretty-printing now preserves parenthesized expressions as they
 were in the source file. This solves several niggling corner cases
 with such things.

4. The igawk script and igawk.1 man page are no longer installed by
   `make install'.  They have been obsolete since gawk 4.0.0.

5. Gawk can now be built with CMake.  This is an alternative build
   system for those who may want it; gawk is not going to switch off
   use of the autotools anytime soon, if ever.

6. Gawk now processes a maximum of two hexadecimal digits in \x
   escape sequences inside strings.

7. Setting PROCINFO["redirection", "NONFATAL"] to true makes I/O
   errors for "redirection" not fatal, setting ERRNO. Setting
   PROCINFO["NONFATAL"] makes all I/O nonfatal. See the manual.

8. MirBSD is no longer supported.

9. `make install' now installs shell startup files
   $sysconfdir/profile.d/gawk.{csh,sh} containing shell functions to
   manipulate the AWKPATH and AWKLIBPATH environment variables.  On a Fedora
   system, these files belong in /etc/profile.d, but the appropriate location
   may be different on other platforms.

10. Gawk now supports retryable I/O via PROCINFO[input-file, "RETRY"]; see
the manual.

11. The C API has undergone changes that break binary compatibility with
the previous version. Thus the API version is now at 2.0.  YOU WILL
NEED TO RECOMPILE YOUR EXTENSIONS to work with this version of gawk.
Source code compatibility remains intact, although you will get
compiler warnings if you do not revise your extensions. We strongly
recommend that you do so.  Fortunately, the changes are fairly minor
and straightforward.

See the manual for the new features.

12. Revisions in the POSIX standard remove the special case for POSIX
mode when FS = " " where newline was not a field separator. The code
and doc have been updated.

13. Gawk now supports strongly typed regexp constants. Such constants
look like @/.../.  You can assign them to variables, pass them to
functions, use them in ~, !~ and the case part of a switch statement.
More details are provided in the manual.

14. The new typeof() function can be used to indicate if a variable or
array element is an array, regexp, string or number.

15. As promised when 4.1 was released, the old extension mechanism,
using the `extension' function, is now gone.

16. Support for GNU/Linux on Alpha systems has been removed.

17. Optimizations are now enabled by default. Use the new -s/--no-optimize
option(s) to disable them.  Pretty-printing and profiling automatically
disable optimizations so that the out

Release 4.2.1 of gawk now available

2018-03-13 Thread Arnold Robbins
Greetings all.

This note announces the next release of GNU Awk: version 4.2.1.

The following files may be retrieved from ftp://ftp.gnu.org/gnu/gawk,
or via HTTPS from https://ftp.gnu.org/gnu/gawk:

-rw-rw-r-- 1 arnold arnold 473 Feb 25 21:04 gawk-4.2.1.tar.lz.sig
-rw-rw-r-- 1 arnold arnold 473 Feb 25 21:03 gawk-4.2.1.tar.xz.sig
-rw-rw-r-- 1 arnold arnold 473 Feb 25 21:03 gawk-4.2.1.tar.gz.sig
-rw-rw-r-- 1 arnold arnold 510 Feb 25 19:35 gawk-4.2.1.tar.gz
-rw-rw-r-- 1 arnold arnold 2985412 Feb 25 19:35 gawk-4.2.1.tar.xz
-rw-rw-r-- 1 arnold arnold 2889549 Feb 25 19:35 gawk-4.2.1.tar.lz

This is a bugfix release.  The relevant part of the NEWS file is
appended below.

Differences from gawk 4.2.0 are available:

-rw-rw-r-- 1 arnold arnold 473 Mar 13 18:09 gawk-4.2.0-4.2.1.diff.gz.sig
-rw-r--r-- 1 arnold arnold  462689 Mar 13 18:07 gawk-4.2.0-4.2.1.diff.gz

The .diff file is a shell script that should be executed in the gawk-4.2.0
source directory.

The usual GNU build incantation should be used:

tar -xpvzf gawk-4.2.1.tar.gz
cd gawk-4.2.1
./configure && make && make check

The documentation on the GNU web site has been updated.

Bug reports should be sent to bug-g...@gnu.org.

Enjoy!

Arnold Robbins (on behalf of all the gawk developers)
arn...@skeeve.com
-
Changes from 4.2.0 to 4.2.1
---

1. Support for OS/2 has been brought up to date.  This support was
   accidentally omitted from the initial 4.2 release, for which
   we apologize.

2. The manual received a number of updates to make it format better
   for PDF.

3. A new configure option, --enable-versioned-dir, causes the directory
   holding extensions to include the API version in its name.

4. extension/configure.ac has been improved considerably.

5. In MPFR mode, When ROUNDMODE changes, string values for numerically
   type values will be redone.

6. The various 'inplace' tests now pass on modern BSD systems.

7. A number of bugs, some of them quite significant, have been fixed.
   See the ChangeLog for details.

-- 
If you have a working or partly working program that you'd like
to offer to the GNU project as a GNU package,
see https://www.gnu.org/help/evaluation.html.


Gawk 5.0.0 released!

2019-04-12 Thread Arnold Robbins
Greetings all.

This note announces the next major release of GNU Awk: version 5.0.0.

The following files may be retrieved from ftp://ftp.gnu.org/gnu/gawk,
or via HTTPS from https://ftp.gnu.org/gnu/gawk:

-rw-rw-r-- 1 arnold arnold 5763496 Apr 12 12:32 gawk-5.0.0.tar.gz
-rw-rw-r-- 1 arnold arnold 2868796 Apr 12 12:32 gawk-5.0.0.tar.lz
-rw-rw-r-- 1 arnold arnold 3000432 Apr 12 12:32 gawk-5.0.0.tar.xz

This is a major new release, with new or improved features, including
namespaces.  The relevant part of the NEWS file is appended below.

This release represents a lot of very hard work by a number of people.
I thank them all for their contributions, I could not have done it
by myself.

Differences from gawk 4.2.1 are not available; they would be too large.

The usual GNU build incantation should be used:

tar -xpvzf gawk-5.0.0.tar.gz
cd gawk-5.0.0
./configure && make && make check

Bug reports should be sent to bug-g...@gnu.org.

Enjoy!

Arnold Robbins (on behalf of all the gawk developers)
arn...@skeeve.com

   Copyright (C) 2019, Free Software Foundation, Inc.
   
   Copying and distribution of this file, with or without modification,
   are permitted in any medium without royalty provided the copyright
   notice and this notice are preserved.

Changes from 4.2.1 to 5.0.0
---

1. Support for the POSIX standard %a and %A printf formats has been added.

2. The test infrastructure has been greatly improved, simplifying the
   contents of test/Makefile.am and making it possible to generate
   pc/Makefile.tst from test/Makefile.in.

3. The regex routines have been replaced with those from GNULIB, allowing
   me to stop carrying forward decades of changes against the original
   ones from GLIBC.

4. Infrastructure upgrades: Bison 3.3, Automake 1.16.1, Gettext 0.19.8.1,
   makeinfo 6.5.

5. The undocumented configure option and code that enabled the use of
   non-English "letters" in identifiers is now gone.

6. The `--with-whiny-user-strftime' configuration option is now gone.

7. The code now makes some stronger assumptions about a C99 environment.

8. PROCINFO["platform"] yields a string indicating the platform for
   which gawk was compiled.

9. Writing to elements of SYMTAB that are not variable names now
   causes a fatal error. THIS CHANGES BEHAVIOR.

10. Comment handling in the pretty-printer has been reworked almost completely
from scratch. As a result, comments in many corner cases that were
previously lost are now included in the formatted output.

11. Namespaces have been implemented! See the manual.  One consequence of this
is that files included with -i, read with -f, and command line program
segments must all be self-contained syntactic units. E.g., you can no
longer do something like this:

gawk -e 'BEGIN {' -e 'print "hello" }'

12. Gawk now uses the locale settings for ignoring case in single byte
locales, instead of hardwiring in Latin-1.

13. A number of bugs, some of them quite significant, have been fixed.
See the ChangeLog for details.

-- 
If you have a working or partly working program that you'd like
to offer to the GNU project as a GNU package,
see https://www.gnu.org/help/evaluation.html.


Gawk 5.0.1 released

2019-06-18 Thread Arnold Robbins
Greetings all.

This note announces the next release of GNU Awk: version 5.0.1.

The following files may be retrieved from ftp://ftp.gnu.org/gnu/gawk,
or via HTTPS from https://ftp.gnu.org/gnu/gawk:

-rw-rw-r-- 1 arnold arnold 5981609 Jun 18 20:56 gawk-5.0.1.tar.gz
-rw-rw-r-- 1 arnold arnold 2992147 Jun 18 20:56 gawk-5.0.1.tar.lz
-rw-rw-r-- 1 arnold arnold 3136004 Jun 18 20:56 gawk-5.0.1.tar.xz

This is a bug fix release. The relevant part of the NEWS file
is appended below.

This release represents a lot of work by a number of people.
I thank them all for their contributions, I could not have done it
by myself.

Differences from gawk 5.0.0 are available in this file:

-rw-r--r-- 1 arnold arnold  247846 Jun 18 21:11 gawk-5.0.0-5.0.1.diff.gz

The usual GNU build incantation should be used:

tar -xpvzf gawk-5.0.1.tar.gz
cd gawk-5.0.1
./configure && make && make check

Bug reports should be sent to bug-g...@gnu.org.

Enjoy!

Arnold Robbins (on behalf of all the gawk developers)
arn...@skeeve.com

   Copyright (C) 2019, Free Software Foundation, Inc.
   
   Copying and distribution of this file, with or without modification,
   are permitted in any medium without royalty provided the copyright
   notice and this notice are preserved.

Changes from 5.0.0 to 5.0.1
---

1. A number of ChangeLog.1 files that were left out of the distribution
   have been restored.

2. Multiple syntax errors should no longer be able to cause a core dump.

3. Sandbox mode now disallows assigning new filename values in ARGV that
   were not there when gawk was invoked.

4. There are many small documentation improvements in the manual.

5. The new argument "no-ext" to --lint disables ``XXX is a gawk extension''
   lint warnings.

6. Infrastructure upgrades: Bison 3.4.

N. A number of bugs, some of them quite significant, have been fixed.
   See the ChangeLog for details.

-- 
If you have a working or partly working program that you'd like
to offer to the GNU project as a GNU package,
see https://www.gnu.org/help/evaluation.html.

Gawk 5.1.0 released!

2020-04-14 Thread Arnold Robbins
Greetings all.

This note announces the next major release of GNU Awk: version 5.1.0.

The following files may be retrieved from ftp://ftp.gnu.org/gnu/gawk,
or via HTTPS from https://ftp.gnu.org/gnu/gawk:

-rw-rw-r-- 1 arnold arnold 6001060 Apr 14 14:48 gawk-5.1.0.tar.gz
-rw-rw-r-- 1 arnold arnold 3008723 Apr 14 14:48 gawk-5.1.0.tar.lz
-rw-rw-r-- 1 arnold arnold 3154564 Apr 14 14:48 gawk-5.1.0.tar.xz

This is a major new release.  The relevant part of the NEWS file
is appended below.

This release represents a lot of very hard work by a number of people.
I thank them all for their contributions, I could not have done it
by myself.

Differences from gawk 5.0.1 are not available; they would be too large.

The online documentation on the GNU web site will be updated within
the next week or two, I hope.

The usual GNU build incantation should be used:

tar -xpvzf gawk-5.1.0.tar.gz
cd gawk-5.1.0
./configure && make && make check

Bug reports should be sent to bug-g...@gnu.org.

Enjoy!

Arnold Robbins (on behalf of all the gawk developers)
arn...@skeeve.com

   Copyright (C) 2019, 2020 Free Software Foundation, Inc.
   
   Copying and distribution of this file, with or without modification,
   are permitted in any medium without royalty provided the copyright
   notice and this notice are preserved.

Changes from 5.0.1 to 5.1.0
---

1. The major version of the API is bumped to 3, something that should
   have happened at the 5.0.0 release but didn't.

2. A number of memory leak issues have been fixed.

3. Infrastructure upgrades: Bison 3.5.4, Texinfo 6.7, Gettext 0.20.1,
   Automake 1.16.2.

4. The indexing in the manual has been thoroughly revised, in particular
   making use of the facilities in Texinfo 6.7.  That version (or newer)
   must be used to format the manual.

5. MSYS2 is now supported out-of-the-box by configure.

6. Several bugs have been fixed.  See the ChangeLog for details.

-- 
If you have a working or partly working program that you'd like
to offer to the GNU project as a GNU package,
see https://www.gnu.org/help/evaluation.html.

Gawk 5.2.0 released!

2022-09-04 Thread Arnold Robbins
Greetings all.

This note announces the next major release of GNU Awk: version 5.2.0.

The following files may be retrieved via HTTPS from
https://ftp.gnu.org/gnu/gawk:

-rw-rw-r-- 1 arnold arnold 6540181 Sep  4 18:52 gawk-5.2.0.tar.gz
-rw-rw-r-- 1 arnold arnold 3228577 Sep  4 18:52 gawk-5.2.0.tar.lz
-rw-rw-r-- 1 arnold arnold 3386344 Sep  4 18:52 gawk-5.2.0.tar.xz

This is a major new release.  The relevant part of the NEWS file
is appended below.

This release represents a lot of very hard work by a number of people.
I thank them all for their contributions, I could not have done it
by myself.

Differences from gawk 5.1.1 are not available; they would be too large.

The online documentation on the GNU web site is already updated,
including a manual for the new persistent memory feature.

The usual GNU build incantation should be used:

tar -xpvzf gawk-5.2.0.tar.gz
cd gawk-5.2.0
./configure && make && make check

Please use the new buggawk script to report bugs. If it doesn't
work for you, then send email to bug-g...@gnu.org.

NOTE that the manual's instructions for sending bug reports have
been updated. Please review them carefully before submitting a report!

ONLY bug reports should be submitted to the bug-gawk list. All other
questions should use the relatively new help-g...@gnu.org mailing list.

Enjoy!

Arnold Robbins (on behalf of all the gawk developers)
arn...@skeeve.com

   Copyright (C) 2019, 2020, 2021, 2022 Free Software Foundation, Inc.
   
   Copying and distribution of this file, with or without modification,
   are permitted in any medium without royalty provided the copyright
   notice and this notice are preserved.

Changes from 5.1.x to 5.2.0
---

*
* MPFR mode (the -M option) is now ON PAROLE.  This feature is now being*
* supported by a volunteer in the development team and not by the primary   *
* maintainer.  If this situation changes, then the feature will be removed. *
* For more information see this section in the manual:  *
* https://www.gnu.org/software/gawk/manual/html_node/MPFR-On-Parole.html*
*

1. Infrastructure upgrades: Libtool 2.4.7, Bison 3.8.2.

2. Numeric scalars now compare in the same way as C for the relational
   operators. Comparison order for sorting has not changed.  This only
   makes a difference when comparing Infinity and NaN values with
   regular numbers; it should not be noticeable most of the time.

3. If the AWK_HASH environment variable is set to "fnv1a" gawk will
   use the FNV1-A hash function for associative arrays.

4. The CMake infrastructure has been removed. In the five years it was in
   the tree, nobody used it, and it was not updated.

5. There is now a new function, mkbool(), that creates Boolean-typed
   values.  These values *are* numbers, but they are also tagged as
   Boolean. This is mainly for use with data exchange to/from languages
   or environments that support real Boolean values. See the manual
   for details.

6. As BWK awk has supported interval expressions since 2019, they are
   now enabled even if --traditional is supplied. The -r/--re-interval option
   remains, but it does nothing.

7. The rwarray extension has two new functions, writeall() and readall(),
   for saving / restoring all of gawk's variables and arrays.

8. The new `gawkbug' script should be used for reporting bugs.

9. The manual page (doc/gawk.1) has been considerably reduced in size.
   Wherever possible, details were replaced with references to the online
   copy of the manual.

10. Gawk now supports Terence Kelly's "persistent malloc" (pma),
allowing gawk to preserve its variables, arrays and user-defined
functions between runs. THIS IS AN EXPERIMENTAL FEATURE!
   
For more information, see the manual. A new pm-gawk.1 man page
is included, as is a separate user manual that focuses on the feature.

11. Support for OS/2 has been removed. It was not being actively
maintained.

12. Similarly, support for DJGPP has been removed. It also was not
being actively maintained.

13. VAX/VMS is no longer supported, as it can no longer be tested.
The files for it remain in the distribution but will be removed
eventually.

14. Some subtle issues with untyped array elements being passed to
functions have been fixed.

15. Syntax errors are now immediately fatal. This prevents problems
with errors from fuzzers and other such things.

16. There have been numerous minor code cleanups and bug fixes. See the
ChangeLog for details.

Changes from 5.1.1 to 5.1.x
---

1. Infrastructure upgrades: Automake 1.16.5, Texinfo 6.8.

2. The rwarray extension now supports writ