Ewen Cheslack-Postava created KAFKA-1763: --------------------------------------------
Summary: validate_index_log in system tests runs remotely but uses local paths Key: KAFKA-1763 URL: https://issues.apache.org/jira/browse/KAFKA-1763 Project: Kafka Issue Type: Bug Components: system tests Affects Versions: 0.8.1.1 Reporter: Ewen Cheslack-Postava Assignee: Ewen Cheslack-Postava Fix For: 0.8.3 validate_index_log is the only validation step in the system tests that needs to execute a Kafka binary and it's currently doing so remotely, like the rest of the test binaries. However, this is probably incorrect since it looks like logs are synced back to the driver host and in other cases are operated on locally. It looks like validate_index_log mixes up local/remote paths, causing an exception in DumpLogSegments: {quote} 2014-11-10 12:09:57,665 - DEBUG - executing command [ssh vagrant@worker1 -o 'HostName 127.0.0.1' -o 'Port 2222' -o 'UserKnownHostsFile /dev/null' -o 'StrictHostKeyChecking no' -o 'PasswordAuthentication no' -o 'IdentityFile /Users/ewencp/.vagrant.d/insecure_private_key' -o 'IdentitiesOnly yes' -o 'LogLevel FATAL' '/opt/kafka/bin/kafka-run-class.sh kafka.tools.DumpLogSegments --file /Users/ewencp/kafka.git/system_test/replication_testsuite/testcase_0008/logs/broker-3/kafka_server_3_logs/test_1-2/00000000000000001294.index --verify-index-only 2>&1'] (system_test_utils) 2014-11-10 12:09:58,673 - DEBUG - Dumping /Users/ewencp/kafka.git/system_test/replication_testsuite/testcase_0008/logs/broker-3/kafka_server_3_logs/test_1-2/00000000000000001294.index (kafka_system_test_utils) 2014-11-10 12:09:58,673 - DEBUG - Exception in thread "main" java.io.FileNotFoundException: /Users/ewencp/kafka.git/system_test/replication_testsuite/testcase_0008/logs/broker-3/kafka_server_3_logs/test_1-2/00000000000000001294.log (No such file or directory) (kafka_system_test_utils) 2014-11-10 12:09:58,673 - DEBUG - at java.io.FileInputStream.open(Native Method) (kafka_system_test_utils) 2014-11-10 12:09:58,673 - DEBUG - at java.io.FileInputStream.<init>(FileInputStream.java:146) (kafka_system_test_utils) 2014-11-10 12:09:58,673 - DEBUG - at kafka.utils.Utils$.openChannel(Utils.scala:162) (kafka_system_test_utils) 2014-11-10 12:09:58,673 - DEBUG - at kafka.log.FileMessageSet.<init>(FileMessageSet.scala:74) (kafka_system_test_utils) 2014-11-10 12:09:58,673 - DEBUG - at kafka.tools.DumpLogSegments$.kafka$tools$DumpLogSegments$$dumpIndex(DumpLogSegments.scala:108) (kafka_system_test_utils) 2014-11-10 12:09:58,673 - DEBUG - at kafka.tools.DumpLogSegments$$anonfun$main$1.apply(DumpLogSegments.scala:80) (kafka_system_test_utils) 2014-11-10 12:09:58,674 - DEBUG - at kafka.tools.DumpLogSegments$$anonfun$main$1.apply(DumpLogSegments.scala:73) (kafka_system_test_utils) 2014-11-10 12:09:58,674 - DEBUG - at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33) (kafka_system_test_utils) 2014-11-10 12:09:58,674 - DEBUG - at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:105) (kafka_system_test_utils) 2014-11-10 12:09:58,674 - DEBUG - at kafka.tools.DumpLogSegments$.main(DumpLogSegments.scala:73) (kafka_system_test_utils) 2014-11-10 12:09:58,674 - DEBUG - at kafka.tools.DumpLogSegments.main(DumpLogSegments.scala) (kafka_system_test_utils) {quote} -- This message was sent by Atlassian JIRA (v6.3.4#6332)