Changeset: 9847e6d6f8f7 for MonetDB URL: https://dev.monetdb.org/hg/MonetDB/rev/9847e6d6f8f7 Modified Files: sql/server/sql_parser.y sql/server/sql_scan.c Branch: literal_features Log Message:
merged with default diffs (truncated from 41139 to 300 lines): diff --git a/.hgtags b/.hgtags --- a/.hgtags +++ b/.hgtags @@ -809,3 +809,5 @@ 79dbf838f04483a2d9ccce8332090ff91b18caec 79dbf838f04483a2d9ccce8332090ff91b18caec Jun2023_release 573511e0e7bf2f7ab11f00b45711aab5f1aff6f2 Jun2023_5 573511e0e7bf2f7ab11f00b45711aab5f1aff6f2 Jun2023_SP1_release +ce63ebe9a78c52ef0cbe8fd6f2159d2637f0387c Jun2023_7 +1efa83c6409769d13b2ee30e497d5f7ab42fa955 Jun2023_9 diff --git a/ChangeLog b/ChangeLog --- a/ChangeLog +++ b/ChangeLog @@ -7,3 +7,9 @@ During the upgrade function definitions will fallback to the normal PYTHON language option. +* Mon Jul 17 2023 Panagiotis Koutsourakis <kutsu...@monetdbsolutions.com> +- Implemented direct masking for strimp construction. The strimps + datastructure now keeps an array of 65K 64-bit integers that is zero + everywhere except at the indexes that correspond to header pairs. The + entry for the nth pair in order has the nth bit of the bitstring + on. These can be used to quickly construct bitstrings. diff --git a/ChangeLog-Archive b/ChangeLog-Archive --- a/ChangeLog-Archive +++ b/ChangeLog-Archive @@ -1,6 +1,15 @@ # DO NOT EDIT THIS FILE -- MAINTAINED AUTOMATICALLY # This file contains past ChangeLog entries +* Wed Aug 30 2023 Sjoerd Mullender <sjo...@acm.org> - 11.47.7-20230925 +- Do a lot more error checking, mostly for allocation failures. More is + still needed, though. + +* Thu Aug 10 2023 Panagiotis Koutsourakis <kutsu...@monetdbsolutions.com> - 11.47.7-20230925 +- Improve performance of the ILIKE operator when the pattern contains only + ASCII characters. In this case we do not need to treat any characters as + UTF-8 and we can use much faster routines that perform byte comparisons. + * Wed Jan 12 2022 Sjoerd Mullender <sjo...@acm.org> - 11.43.5-20220118 - A couple of concurrency issues have been fixed. diff --git a/ChangeLog.Jun2023 b/ChangeLog.Jun2023 --- a/ChangeLog.Jun2023 +++ b/ChangeLog.Jun2023 @@ -1,8 +1,7 @@ # ChangeLog file for devel # This file is updated with Maddlog -* Thu Aug 10 2023 Panagiotis Koutsourakis <kutsu...@monetdbsolutions.com> -- Improve performance of the ILIKE operator when the pattern contains only - ASCII characters. In this case we do not need to treat any characters as - UTF-8 and we can use much faster routines that perform byte comparisons. +* Fri Sep 29 2023 Sjoerd Mullender <sjo...@acm.org> +- Fixed an installation issue on Debian and Ubuntu introduced in the + last build. diff --git a/ChangeLog.strimps-updates b/ChangeLog.strimps-updates deleted file mode 100644 --- a/ChangeLog.strimps-updates +++ /dev/null @@ -1,10 +0,0 @@ -# ChangeLog file for strimpsv2 -# This file is updated with Maddlog - -* Mon Jul 17 2023 Panagiotis Koutsourakis <kutsu...@monetdbsolutions.com> -- Implemented direct masking for strimp construction. The strimps - datastructure now keeps an array of 65K 64-bit integers that is zero - everywhere except at the indexes that correspond to header pairs. The - entry for the nth pair in order has the nth bit of the bitstring - on. These can be used to quickly construct bitstrings. - diff --git a/MonetDB.spec b/MonetDB.spec --- a/MonetDB.spec +++ b/MonetDB.spec @@ -89,7 +89,7 @@ Group: Applications/Databases License: MPL-2.0 URL: https://www.monetdb.org/ BugURL: https://github.com/MonetDB/MonetDB/issues -Source: https://www.monetdb.org/downloads/sources/Jun2023-SP1/%{name}-%{version}.tar.bz2 +Source: https://www.monetdb.org/downloads/sources/Jun2023-SP2/%{name}-%{version}.tar.bz2 # The Fedora packaging document says we need systemd-rpm-macros for # the _unitdir and _tmpfilesdir macros to exist; however on RHEL 7 @@ -860,6 +860,48 @@ fi %endif %changelog +* Wed Sep 27 2023 Sjoerd Mullender <sjo...@acm.org> - 11.47.9-20230927 +- Rebuilt. +- GH#7402: Privileges on merge table not propagated to partition tables + +* Mon Sep 25 2023 Sjoerd Mullender <sjo...@acm.org> - 11.47.7-20230925 +- Rebuilt. +- GH#7094: Drop remote tables in transactions and rollback +- GH#7303: Improve the performance of multi-column filters +- GH#7400: VM max memory is not check correctly for cgroups v2 +- GH#7401: Column aliases used incorrectly in UNION subqueries + +* Fri Sep 22 2023 Sjoerd Mullender <sjo...@acm.org> - 11.47.7-20230925 +- gdk: Fixed a number of data races (race conditions). + +* Mon Sep 18 2023 Sjoerd Mullender <sjo...@acm.org> - 11.47.7-20230925 +- gdk: Fixed a reference counting problem when a BAT could nog be loaded, + e.g. because of resource limitations. + +* Wed Aug 30 2023 Sjoerd Mullender <sjo...@acm.org> - 11.47.7-20230925 +- gdk: Only check for virtual memory limits when creating or growing bats, + not for general memory allocations. There is (still) too much code + that doesn't properly handle failing allocations, so we need to avoid + those as much as possible. This has mostly an effect if there are + virtual memory size restrictions imposed by cgroups (memory.swap.max + in cgroups v2, memory.memsw.limit_in_bytes in cgroups v1). +- gdk: The low-level commit turned out to always commit every persistent bat + in the system. There is no need for that, it should only commit bats + that were changed. This has now been fixed. +- gdk: Implemented timeout/exit checks in a bunch more operators. Long(er) + running operators occasionally check whether they're taking too long + (past a user-specified timeout) or whether the server is exiting. + This is now done in more places. + +* Wed Aug 30 2023 Sjoerd Mullender <sjo...@acm.org> - 11.47.7-20230925 +- MonetDB: Do a lot more error checking, mostly for allocation failures. More is + still needed, though. + +* Thu Aug 10 2023 Panagiotis Koutsourakis <kutsu...@monetdbsolutions.com> - 11.47.7-20230925 +- MonetDB: Improve performance of the ILIKE operator when the pattern contains only + ASCII characters. In this case we do not need to treat any characters as + UTF-8 and we can use much faster routines that perform byte comparisons. + * Tue Jul 18 2023 Sjoerd Mullender <sjo...@acm.org> - 11.47.5-20230718 - Rebuilt. - GH#7388: Query results in large cross product diff --git a/README.rst b/README.rst --- a/README.rst +++ b/README.rst @@ -61,35 +61,35 @@ the first of the ``cmake`` command lines otherwise, options are ``ON`` when the relevant libraries can be found. Available options are: -============== =============================================================================================== -Option Explanation -============== =============================================================================================== -ASSERT Enable asserts (default=ON for development sources, OFF for tarball installation) -CINTEGRATION Enable support for C UDFs (default=ON except on Windows) -CMAKE_SUMMARY Show a summary of the cmake configuration (for debug purposes, default=OFF) -CMAKE_UNITTEST Build and run the unittest for the build system (default=OFF) -FITS Enable support for FITS -GEOM Enable support for geom module -INT128 Enable support for 128-bit integers -NETCDF Enable support for netcdf -ODBC Compile the MonetDB ODBC driver -PY3INTEGRATION Enable support for Python 3 integration into MonetDB -RINTEGRATION Enable support for R integration into MonetDB -SANITIZER Enable support for the GCC address sanitizer (default=OFF) -SHP Enable support for ESRI Shapefiles -STRICT Enable strict compiler flags (default=ON for development sources, OFF for tarball installation) -TESTING Enable support for testing -WITH_BZ2 Include bz2 support -WITH_CMOCKA Include cmocka support (default=OFF) -WITH_CURL Include curl support -WITH_LZMA Include lzma support -WITH_PCRE Include pcre support -WITH_PROJ Include proj support -WITH_READLINE Include readline support -WITH_VALGRIND Include valgrind support -WITH_XML2 Include xml2 support -WITH_ZLIB Include zlib support -============== =============================================================================================== +================= =============================================================================================== +Option Explanation +================= =============================================================================================== +ASSERT Enable asserts (default=ON for development sources, OFF for tarball installation) +CINTEGRATION Enable support for C UDFs (default=ON except on Windows) +CMAKE_SUMMARY Show a summary of the cmake configuration (for debug purposes, default=OFF) +CMAKE_UNITTESTS Build and run the unittest for the build system (default=OFF) +FITS Enable support for FITS +GEOM Enable support for geom module +INT128 Enable support for 128-bit integers +NETCDF Enable support for netcdf +ODBC Compile the MonetDB ODBC driver +PY3INTEGRATION Enable support for Python 3 integration into MonetDB +RINTEGRATION Enable support for R integration into MonetDB +SANITIZER Enable support for the GCC address sanitizer (default=OFF) +SHP Enable support for ESRI Shapefiles +STRICT Enable strict compiler flags (default=ON for development sources, OFF for tarball installation) +TESTING Enable support for testing +WITH_BZ2 Include bz2 support +WITH_CMOCKA Include cmocka support (default=OFF) +WITH_CURL Include curl support +WITH_LZMA Include lzma support +WITH_PCRE Include pcre support +WITH_PROJ Include proj support +WITH_READLINE Include readline support +WITH_VALGRIND Include valgrind support +WITH_XML2 Include xml2 support +WITH_ZLIB Include zlib support +================= =============================================================================================== Required and Optional Packages .............................. diff --git a/buildtools/coverity_model.c b/buildtools/coverity_model.c --- a/buildtools/coverity_model.c +++ b/buildtools/coverity_model.c @@ -126,7 +126,7 @@ GDKmmap(const char *path, int mode, size } gdk_return -GDKmunmap(void *p, size_t size) +GDKmunmap(void *p, int mode, size_t size) { int failed; __coverity_free__(p); @@ -139,7 +139,7 @@ GDKmremap(const char *path, int mode, vo { void *p = GDKmmap(path, mode, new_size); if (p) { - (void) GDKmunmap(old_address, old_size); + (void) GDKmunmap(old_address, mode, old_size); } return p; } diff --git a/clients/Tests/MAL-signatures-hge.test b/clients/Tests/MAL-signatures-hge.test --- a/clients/Tests/MAL-signatures-hge.test +++ b/clients/Tests/MAL-signatures-hge.test @@ -3494,6 +3494,26 @@ command algebra.likeselect(X_0:bat[:str] PCRElikeselect; Select all head values of the first input BAT for which the@tail value is "like" the given (SQL-style) pattern and for@which the head value occurs in the tail of the second input@BAT.@Input is a dense-headed BAT, output is a dense-headed BAT with in@the tail the head value of the input BAT for which the@relationship holds. The output BAT is sorted on the tail value. algebra +markjoin +command algebra.markjoin(X_0:bat[:any_1], X_1:bat[:any_1], X_2:bat[:oid], X_3:bat[:oid], X_4:lng) (X_5:bat[:oid], X_6:bat[:bit]) +ALGmark2join; +Mark join with candidate lists +algebra +markjoin +command algebra.markjoin(X_0:bat[:any_1], X_1:bat[:any_1], X_2:bat[:oid], X_3:bat[:oid], X_4:lng) (X_5:bat[:oid], X_6:bat[:oid], X_7:bat[:bit]) +ALGmark3join; +Mark join with candidate lists +algebra +markjoin +command algebra.markjoin(X_0:bat[:any_1], X_1:bat[:any_1], X_2:bat[:oid], X_3:bat[:oid], X_4:bit, X_5:lng) (X_6:bat[:oid], X_7:bat[:bit]) +ALGmarkjoin; +Left mark join with candidate lists, produces left output and mark flag; +algebra +markselect +command algebra.markselect(X_0:bat[:oid], X_1:bat[:bit], X_2:bat[:bit], X_3:bit) (X_4:bat[:oid], X_5:bat[:bit]) +ALGmarkselect; +Group on group-ids, return aggregated anyequal or allnotequal +algebra not_like command algebra.not_like(X_0:str, X_1:str, X_2:str, X_3:bit):bit PCREnotlike; @@ -3504,6 +3524,11 @@ command algebra.orderidx(X_0:bat[:any_1] OIDXorderidx; Create an order index algebra +outercrossproduct +command algebra.outercrossproduct(X_0:bat[:any_1], X_1:bat[:any_2], X_2:bat[:oid], X_3:bat[:oid], X_4:bit) (X_5:bat[:oid], X_6:bat[:oid]) +ALGoutercrossproduct3; +Compute the outer cross product of both input bats +algebra outerjoin command algebra.outerjoin(X_0:bat[:any_1], X_1:bat[:any_1], X_2:bat[:oid], X_3:bat[:oid], X_4:bit, X_5:bit, X_6:lng):bat[:oid] ALGouterjoin1; @@ -3514,6 +3539,11 @@ command algebra.outerjoin(X_0:bat[:any_1 ALGouterjoin; Left outer join with candidate lists algebra +outerselect +command algebra.outerselect(X_0:bat[:oid], X_1:bat[:bit], X_2:bat[:bit], X_3:bit) (X_4:bat[:oid], X_5:bat[:bit]) +ALGouterselect; +Per input lid return atleast one row, if none of the predicates (p) hold, return a nil, else 'all' true cases. +algebra project pattern algebra.project(X_0:bat[:any_1], X_1:any_3):bat[:any_3] ALGprojecttail; @@ -51033,56 +51063,6 @@ user_statistics pattern sysmon.user_statistics() (X_0:bat[:str], X_1:bat[:lng], X_2:bat[:lng], X_3:bat[:timestamp], X_4:bat[:timestamp], X_5:bat[:lng], X_6:bat[:str]) SYSMONstatistics; (empty) -tokenizer -append -command tokenizer.append(X_0:str):oid -TKNZRappend; -tokenize a new string and append it to the tokenizer (duplicate elimination is performed) -tokenizer -close -command tokenizer.close():void -TKNZRclose; -close the current tokenizer store -tokenizer -depositFile -command tokenizer.depositFile(X_0:str):void -TKNZRdepositFile; -batch insertion from a file of strings to tokenize, each string is separated by a new line -tokenizer -getCardinality -command tokenizer.getCardinality():bat[:lng] -TKNZRgetCardinality; -debugging function that returns the unique tokens at each level -tokenizer _______________________________________________ checkin-list mailing list -- checkin-list@monetdb.org To unsubscribe send an email to checkin-list-le...@monetdb.org
