Changeset: 2fe7cae3eb18 for MonetDB URL: https://dev.monetdb.org/hg/MonetDB/rev/2fe7cae3eb18 Modified Files: clients/Tests/MAL-signatures.stable.out clients/Tests/MAL-signatures.stable.out.int128 clients/Tests/exports.stable.out gdk/gdk_aggr.c gdk/gdk_calc.h gdk/gdk_firstn.c gdk/gdk_group.c gdk/gdk_string.c gdk/gdk_subquery.c monetdb5/modules/atoms/batxml.c monetdb5/modules/atoms/blob.c monetdb5/modules/atoms/json.c monetdb5/modules/atoms/mtime.c monetdb5/modules/atoms/uuid.c monetdb5/modules/kernel/aggr.c monetdb5/modules/kernel/algebra.c monetdb5/modules/kernel/bat5.c monetdb5/modules/kernel/batmmath.c monetdb5/modules/kernel/batstr.c monetdb5/modules/kernel/mmath.c monetdb5/modules/mal/batcalc.c monetdb5/modules/mal/calc.c monetdb5/modules/mal/mkey.c monetdb5/modules/mal/pcre.c monetdb5/optimizer/opt_mergetable.c monetdb5/optimizer/opt_prelude.c monetdb5/optimizer/opt_prelude.h monetdb5/optimizer/opt_pushselect.c monetdb5/optimizer/opt_remap.c sql/backends/monet5/for.c sql/backends/monet5/mal_backend.h sql/backends/monet5/rel_bin.c sql/backends/monet5/rel_bin.h sql/backends/monet5/sql.c sql/backends/monet5/sql.h sql/backends/monet5/sql_execute.c sql/backends/monet5/sql_gencode.c sql/backends/monet5/sql_gencode.h sql/backends/monet5/sql_rank.c sql/backends/monet5/sql_statement.c sql/backends/monet5/sql_statement.h sql/backends/monet5/sql_statistics.c sql/backends/monet5/sql_subquery.c sql/common/sql_types.c sql/server/rel_dump.c sql/server/rel_optimizer.c sql/server/rel_propagate.c sql/server/rel_updates.c sql/test/SQLancer/Tests/sqlancer17.test sql/test/SQLancer/Tests/sqlancer18.test sql/test/miscellaneous/Tests/groupby_expressions.test sql/test/subquery/Tests/subquery5.test Branch: pushcands Log Message:
Merged with default diffs (truncated from 187580 to 300 lines): diff --git a/.hgtags b/.hgtags --- a/.hgtags +++ b/.hgtags @@ -820,3 +820,7 @@ 65065954ca086d01254a20cc145695fa8b9a3db2 4b353b1f914e3c9c7493117284f9cc06677e4c71 Jul2021_SP1_release 65065954ca086d01254a20cc145695fa8b9a3db2 Jul2021_SP1_release 014b82412e664a306d2f5d3a2a2d49d75a6f8da5 Jan2022_root +1cc77329e40543d12dd9de04cbeec50d442520e9 Jul2021_13 +1cc77329e40543d12dd9de04cbeec50d442520e9 Jul2021_SP2_release +e730f4981db58bb336d6b17a022eec95d9f0eae5 Jan2022_1 +e730f4981db58bb336d6b17a022eec95d9f0eae5 Jan2022_release diff --git a/CMakeLists.txt b/CMakeLists.txt --- a/CMakeLists.txt +++ b/CMakeLists.txt @@ -3,7 +3,7 @@ # License, v. 2.0. If a copy of the MPL was not distributed with this # file, You can obtain one at http://mozilla.org/MPL/2.0/. # -# Copyright 1997 - July 2008 CWI, August 2008 - 2021 MonetDB B.V. +# Copyright 1997 - July 2008 CWI, August 2008 - 2022 MonetDB B.V. #]] cmake_minimum_required(VERSION 3.12) diff --git a/ChangeLog.Jul2021 b/ChangeLog.Jul2021 deleted file mode 100644 --- a/ChangeLog.Jul2021 +++ /dev/null @@ -1,3 +0,0 @@ -# ChangeLog file for devel -# This file is updated with Maddlog - diff --git a/Config.cmake.in b/Config.cmake.in --- a/Config.cmake.in +++ b/Config.cmake.in @@ -3,7 +3,7 @@ # License, v. 2.0. If a copy of the MPL was not distributed with this # file, You can obtain one at http://mozilla.org/MPL/2.0/. # -# Copyright 1997 - July 2008 CWI, August 2008 - 2021 MonetDB B.V. +# Copyright 1997 - July 2008 CWI, August 2008 - 2022 MonetDB B.V. #]] @PACKAGE_INIT@ diff --git a/MacOSX/summary.rtf b/MacOSX/summary.rtf --- a/MacOSX/summary.rtf +++ b/MacOSX/summary.rtf @@ -7,4 +7,4 @@ \f0\b\fs24 \cf0 Installation was successful. \b0 \ \ -You can now start MonetDB from your Terminal. For a tutorial how to operate and use MonetDB, please visit {\field{\*\fldinst{HYPERLINK "https://www.monetdb.org/Documentation/UserGuide/Tutorial"}}{\fldrslt https://www.monetdb.org/Documentation/UserGuide/Tutorial}}.} \ No newline at end of file +You can now start MonetDB from your Terminal. For a tutorial how to operate and use MonetDB, please visit {\field{\*\fldinst{HYPERLINK "https://www.monetdb.org/documentation/user-guide/tutorials/voc-tutorial/"}}{\fldrslt https://www.monetdb.org/documentation/user-guide/tutorials/voc-tutorial/}}.} diff --git a/MonetDB.spec b/MonetDB.spec --- a/MonetDB.spec +++ b/MonetDB.spec @@ -81,7 +81,7 @@ Group: Applications/Databases License: MPLv2.0 URL: https://www.monetdb.org/ BugURL: https://bugs.monetdb.org/ -Source: https://www.monetdb.org/downloads/sources/Jul2021-SP1/%{name}-%{version}.tar.bz2 +Source: https://www.monetdb.org/downloads/sources/Jan2022/%{name}-%{version}.tar.bz2 # The Fedora packaging document says we need systemd-rpm-macros for # the _unitdir and _tmpfilesdir macros to exist; however on RHEL 7 @@ -616,7 +616,11 @@ This package contains files needed to de %files SQL-server5-devel %defattr(-,root,root) +%{_includedir}/monetdb/exception_buffer.h +%{_includedir}/monetdb/opt_backend.h +%{_includedir}/monetdb/rel_*.h %{_includedir}/monetdb/sql*.h +%{_includedir}/monetdb/store_*.h %package embedded Summary: MonetDB as an embedded library @@ -823,9 +827,7 @@ install -d -m 0775 %{buildroot}%{_rundir rm -f %{buildroot}%{_libdir}/*.la rm -f %{buildroot}%{_libdir}/monetdb5/*.la rm -f %{buildroot}%{_libdir}/monetdb5/lib_opt_sql_append.so -rm -f %{buildroot}%{_libdir}/monetdb5/run_*.mal rm -f %{buildroot}%{_libdir}/monetdb5/lib_run_*.so -rm -f %{buildroot}%{_libdir}/monetdb5/microbenchmark.mal rm -f %{buildroot}%{_libdir}/monetdb5/lib_microbenchmark*.so rm -f %{buildroot}%{_libdir}/monetdb5/lib_udf*.so rm -f %{buildroot}%{_bindir}/monetdb_mtest.sh @@ -848,6 +850,176 @@ fi %endif %changelog +* Mon Jan 03 2022 Sjoerd Mullender <sjo...@acm.org> - 11.43.1-20220103 +- Rebuilt. +- GH#7168: Loosing the documentation +- GH#7180: GROUP BY-subquery crashes MonetDb +- GH#7182: Queries against sys.querylog_catalog, sys.querylog_calls or + sys.querylog_history fail after restore of a db created using call + sys.hot_snapshot(R'\path\file.tar'); +- GH#7201: Selection of a subquery with a LEFT JOIN returns the wrong + result set +- GH#7202: DISTINCT does not work when sorting by additional columns + +* Mon Jan 3 2022 Panagiotis Koutsourakis <kutsu...@monetdbsolutions.com> - 11.43.1-20220103 +- gdk: Implement string imprints (strimps for short) a pre-filter structure + for strings in order to accelerate LIKE queries. If a strimp exists + for a specific string column the strings are pre-filtered, rejecting + strings that cannot possibly match, before the more expensive and + accurate matching algorithms run. Strimps are created automatically + or using 'sys.strimp_create' with arguments the names of the schema, + table and column. Automatic strimp creation is controlled by two + user settable gdk options: 'gdk_use_strimps' (default value "no") and + 'gdk_strimps_threshold' (default value 1.000.000). See the manual for + more details. + +* Wed Dec 15 2021 Pedro Ferreira <pedro.ferre...@monetdbsolutions.com> - 11.43.1-20220103 +- monetdb5: The storage cleanup in the 11.41.5 (Jul2021) release made the OLTP + optimizer pipeline obsolete, thus it was removed. + +* Wed Dec 15 2021 Pedro Ferreira <pedro.ferre...@monetdbsolutions.com> - 11.43.1-20220103 +- sql: With the storage cleanup in the 11.41.5 (Jul2021) release, the ANALYZE + statement was updated to accomodate those changes. The SAMPLE parameter + is now ignored because ANALYZE generated statistics used by + relational operators, are required to be precise. +- sql: In order to mitigate the I/O required to update the 'statistics' table, + this table is no longer persisted. Alternately, it was changed into a + computed view every time when queried. The 'stamp' and 'sample' fields + were removed for the aforementioned reasons. The 'schema', 'table' and + 'column' fields were added for convenience. + +* Mon Dec 13 2021 Sjoerd Mullender <sjo...@acm.org> - 11.43.1-20220103 +- sql: In previous versions there was no check that the INCREMENT BY value of + a SEQUENCE was not zero. During the automatic upgrade of a database, + INCREMENT BY values that are zero are set to one. + +* Mon Dec 13 2021 Pedro Ferreira <pedro.ferre...@monetdbsolutions.com> - 11.43.1-20220103 +- sql: The method to compute the 'side_effect' effect property was changed + for SQL functions defined in the backend engine (eg. ``CREATE FUNCTION + ... EXTERNAL NAME "module"."function"''). It was changed from being + computed by the SQL layer to the backend engine itself. As a consequence, + the computed 'side_effect' value may be different, thus bringing + incompatibilities. After an upgrade, if a 'side_effect' incompatibility + arises, either the 'side_effect' value in the backend should be changed or + the function should be re-created in SQL. + +* Mon Dec 13 2021 Martin van Dinther <martin.van.dint...@monetdbsolutions.com> - 11.43.1-20220103 +- sql: Removed deprecated system view sys.systemfunctions. It was marked + as deprecated from release Apr2019 (11.33.3). Use query: + select id as function_id from sys.functions where system; + to get the same data as the old view. + +* Mon Dec 13 2021 Martin van Dinther <martin.van.dint...@monetdbsolutions.com> - 11.43.1-20220103 +- sql: Extended SQL system catalog with lookup table sys.fkey_actions and + view sys.fkeys to provide user friendly querying of existing foreign + keys and their ON UPDATE and ON DELETE referential action specifications. + +* Mon Dec 13 2021 Pedro Ferreira <pedro.ferre...@monetdbsolutions.com> - 11.43.1-20220103 +- sql: Many improvements were done for REMOTE table plans. As a consequence, + master or slave servers from this feature release are not compatible + with older releases. + +* Mon Dec 13 2021 Sjoerd Mullender <sjo...@acm.org> - 11.43.1-20220103 +- sql: The view sys.ids has been changed to give more information about the + objects in the system. In particular, there is an extra column + added at the end that indicates whether the object is a system + object. + +* Mon Dec 13 2021 Sjoerd Mullender <sjo...@acm.org> - 11.43.1-20220103 +- sql: The example modules opt_sql_append and udf are no longer loaded by + default and no longer part of the binary release. If installed, + they can be loaded using the --loadmodule option. + +* Mon Dec 13 2021 Sjoerd Mullender <sjo...@acm.org> - 11.43.1-20220103 +- clients: A new output formatting mode was added to mclient. Use -fcsv-noquote + to produce a CSV (comma-separated values) output where the quote + characters have not been escapes. This can be useful when producing + a single column string output that should be saved as is, e.g. when + using the sys.dump_database() function. + +* Mon Dec 13 2021 Sjoerd Mullender <sjo...@acm.org> - 11.43.1-20220103 +- gdk: Many (most) low level functions that could take a long time (such as + BATjoin) can now be aborted with a timeout. When the function takes too + long, the function will fail, and hence the whole SQL query will fail. +- gdk: At some point in the past, string heaps were created where the + hash value of the string was stored in the heap before the string. + This hasn't been used in a long time. Now the code that could still + read those old heaps has been removed. Bats that used the old format + are converted automatically. + +* Mon Dec 13 2021 Sjoerd Mullender <sjo...@acm.org> - 11.43.1-20220103 +- misc: Reliance on the OpenSSL library has been removed. OpenSSL was used + for the hash algorithms it contained (e.g. SHA512 and RIPEMD160) and + for producing random numbers. The hash functions have been replaced + by the original published functions, and random numbers are generated + using system-specific random sources (i.e. not simply pseudo-random + number generators). + +* Mon Dec 13 2021 Sjoerd Mullender <sjo...@acm.org> - 11.43.1-20220103 +- sql: The built-in SQL functions to produce a dump that were added as a + proof-of-concept in the previous release have been improved and are + now usable. Use the query ``SELECT stmt FROM sys.dump_database(FALSE) + ORDER BY o'' to produce a dump. The dump code built into mclient and + msqldump is probably still more efficient, though. + +* Mon Dec 13 2021 Sjoerd Mullender <sjo...@acm.org> - 11.43.1-20220103 +- gdk: Some small interface changes to the atom functions: the atomPut function + now returns (var_t) -1 on error instead of 0; the atomHeap function + now returns success or failure as a gdk_return value. + +* Mon Dec 13 2021 Sjoerd Mullender <sjo...@acm.org> - 11.43.1-20220103 +- sql: The sys.epoch function has always been confusing. There are two + versions, one with an INTEGER argument, and one with a BIGINT + argument. The former accepted values as seconds, whereas the + latter expected milliseconds. Also, the construct EXTRACT(EPOCH + FROM value) returns a BIGINT with millisecond precision. This has + now been overhauled. There is no longer a function sys.epoch with + BIGINT argument, but instead there is a new function sys.epoch with + DECIMAL(18,3) argument. The argument is seconds, but with 3 decimals, + it provides millisecond accuracy. Also the EXTRACT(EPOCH FROM value) + now returns a DECIMAL(18,3), again seconds with 3 decimals giving + millisecond accuracy. Note that the internal, binary representation + of DECIMAL(18,3) interpreted as seconds with 3 decimals and BIGINT + with millisecond precision is exactly the same. + +* Mon Dec 13 2021 Panagiotis Koutsourakis <kutsu...@monetdbsolutions.com> - 11.43.1-20220103 +- merovingian: Removed the deprecated monetdb commands `profilerstart` and + `profilerstop`. + +* Mon Dec 13 2021 Sjoerd Mullender <sjo...@acm.org> - 11.41.13-20211213 +- Rebuilt. +- GH#7163: Multiple sql.mvc() invocations in the same query +- GH#7167: sys.shutdown() problems +- GH#7184: Insert into query blocks all other queries +- GH#7185: GROUPING SETS on groups with aliases provided in the SELECT + returns empty result +- GH#7186: data files created with COPY SELECT .. INTO 'file.csv' fail to + be loaded using COPY INTO .. FROM 'file.csv' when double quoted string + data contains the field values delimiter character +- GH#7191: [MonetDBe] monetdbe_cleanup_statement() with bound NULLs on + variable-sized types bug +- GH#7196: BATproject2: does not match always +- GH#7198: Suboptimal query plan for query containing JSON access filter + and two negative string comparisons +- GH#7200: PRIMARY KEY unique constraint is violated with concurrent + inserts +- GH#7206: Python UDF fails when returning an empty table as a dictionary + +* Mon Dec 13 2021 Sjoerd Mullender <sjo...@acm.org> - 11.41.13-20211213 +- clients: Dumping the database now also dumps the read-only and insert-only + states of tables. + +* Mon Dec 13 2021 Sjoerd Mullender <sjo...@acm.org> - 11.41.13-20211213 +- gdk: Sometimes when the server was restarted, it wouldn't start anymore due + to an error from BBPcheckbats. We finally found and fixed a (hopefully + "the") cause of this problem. + +* Thu Oct 28 2021 Sjoerd Mullender <sjo...@acm.org> - 11.41.13-20211213 +- sql: Number parsing for SQL was fixed. If a number was immediately followed + by letters (i.e. without a space), the number was accepted and the + alphanumeric string starting with the letter was interpreted as an alias + (if aliases were allowed in that position). + * Thu Sep 30 2021 Sjoerd Mullender <sjo...@acm.org> - 11.41.11-20210930 - Rebuilt. @@ -1152,296 +1324,3 @@ fi - monetdb5: By using the option "--dbextra=in-memory", mserver5 can be instructed to keep transient BATs completely in memory. -* Mon May 03 2021 Sjoerd Mullender <sjo...@acm.org> - 11.39.17-20210503 -- Rebuilt. -- GH#3336: DB files not removed if all rows are deleted, even after restart -- GH#7104: Monetdbe NTILE function does not produce correct ordering -- GH#7108: Monetdb crashes on query execution -- GH#7109: MERGE Statement incorrectly reports that input relation matches - multiple rows -- GH#7110: Monetdb Query parsing consistency issues in the latest release - (Remote Table) - -* Mon May 3 2021 Sjoerd Mullender <sjo...@acm.org> - 11.39.17-20210503 -- gdk: A bug that would very occasionally produce an error "strPut: incorrectly - encoded UTF-8", even when no incorrectly coded characters are used - at all, has been fixed. It was the result of a rare combination of - strings having been added to the column that caused essentially an - off-by-one type of error to occur. - -* Mon May 3 2021 Sjoerd Mullender <sjo...@acm.org> - 11.39.17-20210503 -- merovingian: When stopping monetdbd using the `monetdbd stop' command, this command - now waits for 5 seconds longer than the exittimeout value before it - kills the monetdbd daemon instead of only 30 seconds total (or until - that daemon stops earlier). This gives the daemon enough time to - terminate the mserver5 processes that it is managing. If exittimeout - is negative, the daemon and the monetdbd process initiating the stop - wait indefinitely until the mserver5 processes have stopped. - -* Mon May 3 2021 Sjoerd Mullender <sjo...@acm.org> - 11.39.17-20210503 -- sql: A bug where a sequence of TRUNCATE TABLE and COPY INTO the just - truncated table would result in success being reported to both queries, - but the table still being empty afterwards, has been fixed. - -* Fri Apr 23 2021 Sjoerd Mullender <sjo...@acm.org> - 11.39.17-20210503 _______________________________________________ checkin-list mailing list checkin-list@monetdb.org https://www.monetdb.org/mailman/listinfo/checkin-list
