Feb 25 12:13:50 linux crmd: [27244]: info: do_lrm_rsc_op: Performing op=Apache_start_0 key=6:1:fcdd21a9-8824-4a6e-90a8-e461e6f2dfcf)
Feb 25 12:13:50 linux lrmd: [27241]: info: rsc:Apache: start
Feb 25 12:13:53 linux apache[27373]: [27398]: INFO: apache not running
Feb 25 12:13:53 linux apache[27373]: [27400]: INFO: waiting for apache /opt/apache/conf/httpd.conf to come up
Feb 25 12:13:54 linux apache[27373]: [27406]: INFO: apache not running
Feb 25 12:13:54 linux apache[27373]: [27408]: INFO: waiting for apache /opt/apache/conf/httpd.conf to come up
Feb 25 12:13:55 linux apache[27373]: [27419]: INFO: apache not running
Feb 25 12:13:55 linux apache[27373]: [27421]: INFO: waiting for apache /opt/apache/conf/httpd.conf to come up
Feb 25 12:13:57 linux apache[27373]: [27427]: INFO: apache not running
Feb 25 12:13:57 linux apache[27373]: [27429]: INFO: waiting for apache /opt/apache/conf/httpd.conf to come up
Feb 25 12:13:58 linux apache[27373]: [27435]: INFO: apache not running
Feb 25 12:13:58 linux apache[27373]: [27437]: INFO: waiting for apache /opt/apache/conf/httpd.conf to come up
Feb 25 12:13:59 linux apache[27373]: [27443]: INFO: apache not running
Feb 25 12:13:59 linux apache[27373]: [27445]: INFO: waiting for apache /opt/apache/conf/httpd.conf to come up
Feb 25 12:14:00 linux apache[27373]: [27451]: INFO: apache not running
Feb 25 12:14:00 linux apache[27373]: [27453]: INFO: waiting for apache /opt/apache/conf/httpd.conf to come up
Feb 25 12:14:01 linux apache[27373]: [27459]: INFO: apache not running
Feb 25 12:14:01 linux apache[27373]: [27461]: INFO: waiting for apache /opt/apache/conf/httpd.conf to come up
Feb 25 12:14:03 linux apache[27373]: [27467]: INFO: apache not running
Feb 25 12:14:03 linux apache[27373]: [27469]: INFO: waiting for apache /opt/apache/conf/httpd.conf to come up
Feb 25 12:14:04 linux apache[27373]: [27475]: INFO: apache not running
Feb 25 12:14:04 linux apache[27373]: [27477]: INFO: waiting for apache /opt/apache/conf/httpd.conf to come up
Feb 25 12:14:05 linux apache[27373]: [27483]: INFO: apache not running
Feb 25 12:14:05 linux apache[27373]: [27485]: INFO: waiting for apache /opt/apache/conf/httpd.conf to come up
Feb 25 12:14:06 linux apache[27373]: [27491]: INFO: apache not running
Feb 25 12:14:06 linux apache[27373]: [27493]: INFO: waiting for apache /opt/apache/conf/httpd.conf to come up
Feb 25 12:14:07 linux apache[27373]: [27499]: INFO: apache not running
Feb 25 12:14:07 linux apache[27373]: [27501]: INFO: waiting for apache /opt/apache/conf/httpd.conf to come up
Feb 25 12:14:08 linux apache[27373]: [27507]: INFO: apache not running
Feb 25 12:14:08 linux apache[27373]: [27509]: INFO: waiting for apache /opt/apache/conf/httpd.conf to come up
Feb 25 12:14:10 linux apache[27373]: [27515]: INFO: apache not running
Feb 25 12:14:10 linux apache[27373]: [27517]: INFO: waiting for apache /opt/apache/conf/httpd.conf to come up
Feb 25 12:14:10 linux tengine: [27248]: WARN: action_timer_callback: Timer popped (abort_level=0, complete=false)
Feb 25 12:14:10 linux tengine: [27248]: WARN: print_elem: Action missed its timeout[Action 6]: In-flight (id: Apache_start_0, loc: linux.mtu.edu, priority: 0)
Feb 25 12:14:10 linux lrmd: [27241]: WARN: Apache:start process (PID 27373) timed out (try 1).  Killing with signal SIGTERM (15).
Feb 25 12:14:10 linux lrmd: [27241]: WARN: operation start[6] on ocf::apache::Apache for client 27244, its parameters: CRM_meta_timeout=[20000] crm_feature_set=[2.0] configfile=[/opt/apache/conf/httpd.conf] statusurl=[http://ha.mtu.edu/index.html] httpd=[/opt/apache/bin/httpd] : pid [27373] timed out
Feb 25 12:14:10 linux crmd: [27244]: ERROR: process_lrm_event: LRM operation Apache_start_0 (6) Timed Out (timeout=20000ms)
Feb 25 12:14:10 linux tengine: [27248]: info: status_from_rc: Re-mapping op status to LRM_OP_ERROR for rc=-2
Feb 25 12:14:10 linux tengine: [27248]: WARN: status_from_rc: Action start on linux.mtu.edu failed (target: <null> vs. rc: -2): Error
Feb 25 12:14:10 linux tengine: [27248]: WARN: update_failcount: Updating failcount for Apache on 488d1100-f844-4e7b-a726-44cf37cb3d0b after failed start: rc=-2
Feb 25 12:14:10 linux tengine: [27248]: info: update_abort_priority: Abort priority upgraded to 1Feb 25 12:14:10 linux tengine: [27248]: info: update_abort_priority: Abort action 0 superceeded by 2
Feb 25 12:14:10 linux tengine: [27248]: info: match_graph_event: Action Apache_start_0 (6) confirmed on linux.mtu.edu (rc=4)
Feb 25 12:14:10 linux tengine: [27248]: info: run_graph: ====================================================
Feb 25 12:14:10 linux tengine: [27248]: notice: run_graph: Transition 1: (Complete=3, Pending=0, Fired=0, Skipped=1, Incomplete=0)
Feb 25 12:14:11 linux crmd: [27244]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ]
Feb 25 12:14:11 linux crmd: [27244]: info: do_state_transition: All 1 cluster nodes are eligible to run resources.
Feb 25 12:14:11 linux pengine: [27249]: info: determine_online_status: Node linux.mtu.edu is online
Feb 25 12:14:11 linux pengine: [27249]: WARN: unpack_rsc_op: Processing failed op Apache_start_0 on linux.mtu.edu: Timed Out
Feb 25 12:14:11 linux pengine: [27249]: WARN: unpack_rsc_op: Compatability handling for failed op Apache_start_0 on linux.mtu.edu
Feb 25 12:14:11 linux pengine: [27249]: notice: group_print: Resource Group: Web
Feb 25 12:14:11 linux pengine: [27249]: notice: native_print:     Ip    (heartbeat::ocf:IPaddr2)Started linux.mtu.edu
Feb 25 12:14:11 linux pengine: [27249]: notice: native_print:     Apache        (heartbeat::ocf:apache): Started linux.mtu.edu FAILED
Feb 25 12:14:11 linux pengine: [27249]: WARN: native_color: Resource Apache cannot run anywhere
Feb 25 12:14:11 linux pengine: [27249]: notice: NoRoleChange: Leave resource Ip (linux.mtu.edu)
Feb 25 12:14:11 linux pengine: [27249]: notice: StopRsc:   linux.mtu.edu        Stop Apache
Feb 25 12:14:11 linux crmd: [27244]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ]
Feb 25 12:14:11 linux tengine: [27248]: info: unpack_graph: Unpacked transition 2: 4 actions in 4 synapses
Feb 25 12:14:11 linux lrmd: [27241]: info: rsc:Apache: stop
Feb 25 12:14:11 linux crmd: [27244]: info: do_lrm_rsc_op: Performing op=Apache_stop_0 key=1:2:fcdd21a9-8824-4a6e-90a8-e461e6f2dfcf)
Feb 25 12:14:11 linux tengine: [27248]: info: te_pseudo_action: Pseudo action 9 fired and confirmed
Feb 25 12:14:11 linux tengine: [27248]: info: send_rsc_command: Initiating action 1: Apache_stop_0 on linux.mtu.edu
Feb 25 12:14:11 linux tengine: [27248]: info: extract_event: Aborting on transient_attributes changes for 488d1100-f844-4e7b-a726-44cf37cb3d0b
Feb 25 12:14:11 linux tengine: [27248]: info: update_abort_priority: Abort priority upgraded to 1000000
Feb 25 12:14:11 linux tengine: [27248]: info: update_abort_priority: Abort action 0 superceeded by 2
Feb 25 12:14:11 linux pengine: [27249]: WARN: process_pe_message: Transition 2: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-2607.bz2
Feb 25 12:14:11 linux pengine: [27249]: info: process_pe_message: Configuration WARNINGs found during PE processing.  Please run "crm_verify -L" to identify issues.
Feb 25 12:14:12 linux apache[27527]: [27544]: INFO: apache is not running.
Feb 25 12:14:12 linux apache[27527]: [27547]: INFO: apache children were signalled (SIGTERM)
Feb 25 12:14:14 linux crmd: [27244]: info: process_lrm_event: LRM operation Apache_stop_0 (call=7, rc=0) complete
Feb 25 12:14:14 linux crmd: [27244]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ]
Feb 25 12:14:14 linux tengine: [27248]: info: match_graph_event: Action Apache_stop_0 (1) confirmed on linux.mtu.edu (rc=0)
Feb 25 12:14:14 linux crmd: [27244]: info: do_state_transition: All 1 cluster nodes are eligible to run resources.
Feb 25 12:14:14 linux tengine: [27248]: info: run_graph: ====================================================
Feb 25 12:14:14 linux tengine: [27248]: notice: run_graph: Transition 2: (Complete=2, Pending=0, Fired=0, Skipped=2, Incomplete=0)
Feb 25 12:14:14 linux pengine: [27249]: info: determine_online_status: Node linux.mtu.edu is online
Feb 25 12:14:14 linux pengine: [27249]: WARN: unpack_rsc_op: Processing failed op Apache_start_0 on linux.mtu.edu: Timed Out
Feb 25 12:14:14 linux pengine: [27249]: WARN: unpack_rsc_op: Compatability handling for failed op Apache_start_0 on linux.mtu.edu
Feb 25 12:14:14 linux pengine: [27249]: notice: group_print: Resource Group: Web
Feb 25 12:14:14 linux pengine: [27249]: notice: native_print:     Ip    (heartbeat::ocf:IPaddr2)Started linux.mtu.edu
Feb 25 12:14:14 linux pengine: [27249]: notice: native_print:     Apache        (heartbeat::ocf:apache): Stopped
Feb 25 12:14:14 linux pengine: [27249]: WARN: native_color: Resource Apache cannot run anywhere
Feb 25 12:14:14 linux pengine: [27249]: notice: NoRoleChange: Leave resource Ip (linux.mtu.edu)
Feb 25 12:14:14 linux crmd: [27244]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ]
Feb 25 12:14:14 linux tengine: [27248]: info: unpack_graph: Unpacked transition 3: 0 actions in 0 synapses
Feb 25 12:14:14 linux tengine: [27248]: info: run_graph: Transition 3: (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0)
Feb 25 12:14:14 linux tengine: [27248]: info: notify_crmd: Transition 3 status: te_complete - <null>
Feb 25 12:14:14 linux crmd: [27244]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ]
Feb 25 12:14:14 linux pengine: [27249]: WARN: process_pe_message: Transition 3: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-2608.bz2
Feb 25 12:14:14 linux pengine: [27249]: info: process_pe_message: Configuration WARNINGs found during PE processing.  Please run "crm_verify -L" to identify issues.