Hi Torsten, When i run bmt_example, M/R job gets executed, cassandra server gets the data but it goes as HintedHandoff to 127.0.0.2 and it is trying to send data to 127.0.0.2 as if 127.0.0.2 is an actual node. When the job was done, close() stop the StorageService instance. Any idea, why does StorageService returns 127.0.0.2 as a EndPoint even though 127.0.0.1 is up?
I am using 127.0.0.1 is a Cassandra server and 127.0.0.2 is a fat client (used from word_count/storage-conf.xml) from CassandraBulkLoader --------------------------------------- 10/07/19 10:58:50 INFO mapred.JobClient: map 100% reduce 0% 10/07/19 10:58:50 INFO config.DatabaseDescriptor: Auto DiskAccessMode determined to be mmap 10/07/19 10:58:51 INFO service.StorageService: Starting up client gossip 10/07/19 10:58:53 INFO gms.Gossiper: Node /127.0.0.1 is now part of the cluster 10/07/19 10:58:54 INFO gms.Gossiper: InetAddress /127.0.0.1 is now UP 10/07/19 10:59:04 INFO net.MessagingService: Shutting down MessageService... 10/07/19 10:59:04 INFO net.MessagingService: MessagingService shutting down server thread. 10/07/19 10:59:04 INFO net.MessagingService: Shutdown complete (no further commands will be processed) 10/07/19 10:59:04 INFO mapred.TaskRunner: Task:attempt_local_0001_r_000000_0 is done. And is in the process of commiting 10/07/19 10:59:04 INFO mapred.LocalJobRunner: 10/07/19 10:59:04 INFO mapred.TaskRunner: Task attempt_local_0001_r_000000_0 is allowed to commit now 10/07/19 10:59:04 INFO mapred.FileOutputCommitter: Saved output of task 'attempt_local_0001_r_000000_0' to file:/Users/xxxxxxxx/Documents/apache-cassandra-0.6.3-src/contrib/bmt_example/test 10/07/19 10:59:04 INFO mapred.LocalJobRunner: reduce > reduce 10/07/19 10:59:04 INFO mapred.TaskRunner: Task 'attempt_local_0001_r_000000_0' done. 10/07/19 10:59:05 INFO mapred.JobClient: map 100% reduce 100% 10/07/19 10:59:05 INFO mapred.JobClient: Job complete: job_local_0001 from Cassandra_home/logs/system.log -------------------------------------------------------- DEBUG [WRITE-/127.0.0.2] 2010-07-19 10:58:52,501 OutboundTcpConnection.java (line 142) attempting to connect to /127.0.0.2 INFO [GMFD:1] 2010-07-19 10:58:52,530 Gossiper.java (line 587) Node / 127.0.0.2 is now part of the cluster INFO [GMFD:1] 2010-07-19 10:58:53,444 Gossiper.java (line 579) InetAddress /127.0.0.2 is now UP INFO [HINTED-HANDOFF-POOL:1] 2010-07-19 10:58:53,444 HintedHandOffManager.java (line 153) Started hinted handoff for endPoint / 127.0.0.2 INFO [HINTED-HANDOFF-POOL:1] 2010-07-19 10:58:53,445 HintedHandOffManager.java (line 210) Finished hinted handoff of 0 rows to endpoint /127.0.0.2 DEBUG [Timer-1] 2010-07-19 10:59:06,990 LoadDisseminator.java (line 36) Disseminating load info ... INFO [Timer-0] 2010-07-19 10:59:10,223 Gossiper.java (line 181) InetAddress /127.0.0.2 is now dead. INFO [WRITE-/127.0.0.2] 2010-07-19 10:59:31,225 OutboundTcpConnection.java (line 102) error writing to /127.0.0.2 On Thu, Jul 15, 2010 at 12:19 PM, Torsten Curdt <[email protected]> wrote: > > If you could can you please share the command line function (to load > TSV)? > > There is no command line function ... you have to write code for this. > > > and Can you please help me on storing storage-conf.xml on HDFS part? > > As I said. Maybe you better start with a simpler scenario and leave > out HDFS for now. > > cheers > -- > Torsten > -- Thanks, Mubarak Seyed.
