This is an automated email from the ASF dual-hosted git repository.
csringhofer pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/impala.git
The following commit(s) were added to refs/heads/master by this push:
new 988d353e0 IMPALA-13693: Fix load-ext-data-sources.sh on Rocky 9.5
988d353e0 is described below
commit 988d353e02430731a212371ad3c37310ad58a07a
Author: Csaba Ringhofer <[email protected]>
AuthorDate: Fri Jan 24 17:14:46 2025 +0100
IMPALA-13693: Fix load-ext-data-sources.sh on Rocky 9.5
Two permission issues caused this dataload step to fail:
- Lack of X permission on home directory (seems linux specific).
- LOAD statement has no right to use \tmp for some reason - using
\LOAD instead solves this. I don't know what postgres/configuration
change caused this.
Testing:
- dataload and ext-data-source related tests passed on Rocky Linux 9.5
Change-Id: I3829116f4c6d6f6cba2da824cd9f31259a15ca1b
Reviewed-on: http://gerrit.cloudera.org:8080/22383
Tested-by: Impala Public Jenkins <[email protected]>
Reviewed-by: Wenzhe Zhou <[email protected]>
---
bin/bootstrap_system.sh | 3 +++
testdata/bin/load-ext-data-sources.sh | 6 +++---
2 files changed, 6 insertions(+), 3 deletions(-)
diff --git a/bin/bootstrap_system.sh b/bin/bootstrap_system.sh
index a8ed4fabc..9b45f31f8 100755
--- a/bin/bootstrap_system.sh
+++ b/bin/bootstrap_system.sh
@@ -204,6 +204,9 @@ function notindocker {
fi
}
+# X permission on home directory is needed for some uses of postgresql
(IMPALA-13693)
+chmod o+X ~
+
# Note that yum has its own retries; see yum.conf(5).
REAL_APT_GET=$(ubuntu which apt-get)
function apt-get {
diff --git a/testdata/bin/load-ext-data-sources.sh
b/testdata/bin/load-ext-data-sources.sh
index 246961bb6..3855fd9d3 100755
--- a/testdata/bin/load-ext-data-sources.sh
+++ b/testdata/bin/load-ext-data-sources.sh
@@ -110,14 +110,14 @@ sudo -u postgres psql -U hiveuser -d functional -f
/tmp/jdbc_test_strategy.sql
# Load data to jdbc table
cat ${IMPALA_HOME}/testdata/target/AllTypes/* > /tmp/jdbc_alltypes.csv
-loadCmd="COPY alltypes FROM '/tmp/jdbc_alltypes.csv' DELIMITER ',' CSV"
+loadCmd="\COPY alltypes FROM '/tmp/jdbc_alltypes.csv' DELIMITER ',' CSV"
sudo -u postgres psql -d functional -c "$loadCmd"
-loadCmd="COPY \"AllTypesWithQuote\" FROM '/tmp/jdbc_alltypes.csv' DELIMITER
',' CSV"
+loadCmd="\COPY \"AllTypesWithQuote\" FROM '/tmp/jdbc_alltypes.csv' DELIMITER
',' CSV"
sudo -u postgres psql -d functional -c "$loadCmd"
cat ${IMPALA_HOME}/testdata/data/decimal_tbl.txt > /tmp/jdbc_decimal_tbl.csv
-loadCmd="COPY decimal_tbl FROM '/tmp/jdbc_decimal_tbl.csv' DELIMITER ',' CSV"
+loadCmd="\COPY decimal_tbl FROM '/tmp/jdbc_decimal_tbl.csv' DELIMITER ',' CSV"
sudo -u postgres psql -d functional -c "$loadCmd"
# Create impala tables and load data
