<html dir="ltr">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
<style type="text/css" id="owaParaStyle">P {margin-top:0;margin-bottom:0;}</style>
</head>
<body fpstyle="1" ocsi="0">
<div style="direction: ltr;font-family: Tahoma;color: #000000;font-size: 10pt;"><font size="2" face="Courier New">Hello, and thank you for adding me to the list.<br>
<br>
We are using Pacemaker in a two-node hot-warm redundancy configuration. Both nodes run ocf:pacemaker:ping (cloned) to monitor a ping group of devices. The nodes share a virtual IP using ocf:heartbeat:IPAddr2. Our applications run in either Primary mode (does
all the work and sends status updates to its peer), or Standby mode (receives status updates and is ready to take over if current primary fails). We have constraints set up so that IPAddr2 fails over on any failure Pacemaker detects (including ping group
failure), and the applications follow it.<br>
<br>
This works great for most use cases, but we have issues in one test case where we disconnect the node in standby (by yanking the eth cable) for about 30 seconds to a minute, and then reconnect it. The problem is that Pacemaker seems to put the Primary into
standby for a very short time while reconnecting the two nodes, and then making it primary again.<br>
<br>
Is there any way to prevent Pacemaker from doing this? Detailed config info and log file snippet are below.<br>
<br>
- Regards<br>
- Garret O'Donovan<br>
<br>
<br>
PLATFORM<br>
This is all running this on CentOS 7 (centos-release-7-4.1708.el7.centos.x86_64) on VM’s (VMware ESXi 5.5). The two nodes are hosted on physically different servers.<br>
<br>
VERSION INFO<br>
corosync-2.4.3-2.el7_5.1.x86_64.rpm <br>
pacemaker-1.1.18-11.el7_5.2.x86_64.rpm<br>
pcs-0.9.162-5.el7.centos.1.x86_64.rpm<br>
resource-agents-3.9.5-124.el7.x86_64.rpm<br>
<br>
PACEMAKER CONFIGURATION<br>
[root@DVTVM0302 ~]# pcs config show<br>
Cluster Name: vendor1<br>
Corosync Nodes:<br>
dvtvm0302 dvtvm0303<br>
Pacemaker Nodes:<br>
dvtvm0302 dvtvm0303<br>
<br>
Resources:<br>
Resource: ClusterIP (class=ocf provider=heartbeat type=IPaddr2)<br>
Attributes: cidr_netmask=24 ip=10.144.101.210 nic=eth0<br>
Operations: monitor interval=1s (ClusterIP-monitor-interval-1s)<br>
start interval=0s timeout=20s (ClusterIP-start-interval-0s)<br>
stop interval=0s timeout=20s (ClusterIP-stop-interval-0s)<br>
Resource: application (class=ocf provider=vendor type=application)<br>
Operations: migrate_from interval=0s timeout=20 (application-migrate_from-interval-0s)<br>
migrate_to interval=0s timeout=20 (application-migrate_to-interval-0s)<br>
monitor interval=1s (application-monitor-interval-1s)<br>
reload interval=0s timeout=20 (application-reload-interval-0s)<br>
start interval=0s timeout=20 (application-start-interval-0s)<br>
stop interval=0s timeout=20 (application-stop-interval-0s)<br>
Clone: Connected-clone<br>
Meta Attrs: interleave=true<br>
Resource: Connected (class=ocf provider=pacemaker type=ping)<br>
Attributes: attempts=2 dampen=1s debug=true host_list="10.10.24.5 10.10.24.18" multiplier=1000<br>
Operations: monitor interval=3s timeout=10 (Connected-monitor-interval-3s)<br>
start interval=0 timeout=3 (Connected-start-interval-0)<br>
stop interval=0s timeout=20 (Connected-stop-interval-0s)<br>
<br>
Stonith Devices:<br>
Fencing Levels:<br>
<br>
Location Constraints:<br>
Resource: ClusterIP<br>
Constraint: location-ClusterIP<br>
Rule: boolean-op=or score=-INFINITY (id:location-ClusterIP-rule)<br>
Expression: pingd lt 500 (id:location-ClusterIP-rule-expr)<br>
Expression: not_defined pingd (id:location-ClusterIP-rule-expr-1)<br>
Ordering Constraints:<br>
start ClusterIP then start application (kind:Mandatory)<br>
Colocation Constraints:<br>
ClusterIP with application (score:INFINITY)<br>
Ticket Constraints:<br>
<br>
Alerts:<br>
No alerts defined<br>
<br>
Resources Defaults:<br>
migration-threshold: 1<br>
failure-timeout: 5s<br>
cluster-recheck-interval: 5s<br>
resource-stickiness: INFINITY<br>
Operations Defaults:<br>
No defaults set<br>
<br>
Cluster Properties:<br>
cluster-infrastructure: corosync<br>
cluster-name: vendor1<br>
dc-version: 1.1.18-11.el7_5.2-2b07d5c5a9<br>
have-watchdog: false<br>
no-quorum-policy: ignore<br>
stonith-enabled: false<br>
<br>
Quorum:<br>
Options:<br>
<br>
COROSYNC CONFIG FILE:<br>
<br>
[root@DVTVM0302 corosync]# cat corosync.conf<br>
totem {<br>
version: 2<br>
cluster_name: vendor1<br>
secauth: off<br>
transport: udpu<br>
}<br>
<br>
nodelist {<br>
node {<br>
ring0_addr: dvtvm0302<br>
nodeid: 1<br>
}<br>
<br>
node {<br>
ring0_addr: dvtvm0303<br>
nodeid: 2<br>
}<br>
}<br>
<br>
quorum {<br>
provider: corosync_votequorum<br>
two_node: 1<br>
}<br>
<br>
logging {<br>
to_logfile: yes<br>
logfile: /var/log/cluster/corosync.log<br>
to_syslog: yes<br>
}<br>
<br>
<br>
LOGFILE:<br>
/var/log/cluster/corosync.log<br>
<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: pcmk_cpg_membership: Node 2 joined group crmd (counter=5.0)<br>
Jul 20 07:46:49 [1564] DVTVM0302.mse.am.mot.com stonith-ng: info: pcmk_cpg_membership: Node 2 joined group stonith-ng (counter=5.0)<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: pcmk_cpg_membership: Node 1 still member of group crmd (peer=dvtvm0302, counter=5.0)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: pcmk_cpg_membership: Node 2 joined group cib (counter=5.0)<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: pcmk_cpg_membership: Node 2 still member of group crmd (peer=dvtvm0303, counter=5.1)<br>
Jul 20 07:46:49 [1564] DVTVM0302.mse.am.mot.com stonith-ng: info: pcmk_cpg_membership: Node 1 still member of group stonith-ng (peer=dvtvm0302, counter=5.0)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: pcmk_cpg_membership: Node 1 still member of group cib (peer=dvtvm0302, counter=5.0)<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: crm_update_peer_proc: pcmk_cpg_membership: Node dvtvm0303[2] - corosync-cpg is now online<br>
Jul 20 07:46:49 [1385] DVTVM0302.mse.am.mot.com pacemakerd: info: pcmk_cpg_membership: Node 2 joined group pacemakerd (counter=5.0)<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: peer_update_callback: Client dvtvm0303/peer now has status [online] (DC=true, changed=4000000)<br>
Jul 20 07:46:49 [1385] DVTVM0302.mse.am.mot.com pacemakerd: info: pcmk_cpg_membership: Node 1 still member of group pacemakerd (peer=dvtvm0302, counter=5.0)<br>
Jul 20 07:46:49 [1385] DVTVM0302.mse.am.mot.com pacemakerd: info: pcmk_cpg_membership: Node 2 still member of group pacemakerd (peer=dvtvm0303, counter=5.1)<br>
Jul 20 07:46:49 [1385] DVTVM0302.mse.am.mot.com pacemakerd: info: crm_update_peer_proc: pcmk_cpg_membership: Node dvtvm0303[2] - corosync-cpg is now online<br>
Jul 20 07:46:49 [1385] DVTVM0302.mse.am.mot.com pacemakerd: error: pcmk_cpg_membership: Node dvtvm0303[2] appears to be online even though we think it is dead<br>
Jul 20 07:46:49 [1385] DVTVM0302.mse.am.mot.com pacemakerd: notice: crm_update_peer_state_iter: Node dvtvm0303 state is now member | nodeid=2 previous=lost source=pcmk_cpg_membership<br>
Jul 20 07:46:49 [1385] DVTVM0302.mse.am.mot.com pacemakerd: info: crm_cs_flush: Sent 0 CPG messages (1 remaining, last=11): Try again (6)<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: error: pcmk_cpg_membership: Node dvtvm0303[2] appears to be online even though we think it is dead<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: notice: crm_update_peer_state_iter: Node dvtvm0303 state is now member | nodeid=2 previous=lost source=pcmk_cpg_membership<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: peer_update_callback: Cluster node dvtvm0303 is now member (was lost)<br>
Jul 20 07:46:49 [1566] DVTVM0302.mse.am.mot.com attrd: info: pcmk_cpg_membership: Node 2 joined group attrd (counter=5.0)<br>
Jul 20 07:46:49 [1566] DVTVM0302.mse.am.mot.com attrd: info: pcmk_cpg_membership: Node 1 still member of group attrd (peer=dvtvm0302, counter=5.0)<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: pcmk_quorum_notification: Quorum retained | membership=144 members=2<br>
Jul 20 07:46:49 [1385] DVTVM0302.mse.am.mot.com pacemakerd: info: pcmk_quorum_notification: Quorum retained | membership=144 members=2<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: crm_get_peer: Created entry 603f53c1-5c06-4423-b6f0-420c6194303d/0x56163cadf350 for node dvtvm0303/2 (2 total)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: crm_get_peer: Node 2 is now known as dvtvm0303<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: crm_get_peer: Node 2 has uuid 2<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: pcmk_cpg_membership: Node 2 still member of group cib (peer=dvtvm0303, counter=5.1)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: crm_update_peer_proc: pcmk_cpg_membership: Node dvtvm0303[2] - corosync-cpg is now online<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: notice: crm_update_peer_state_iter: Node dvtvm0303 state is now member | nodeid=2 previous=unknown source=crm_update_peer_proc<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: --- 0.29.54 2<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: +++ 0.29.55 (null)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib: @num_updates=55<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='1']: @crm-debug-origin=peer_update_callback<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=dvtvm0303/crmd/108, version=0.29.55)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=dvtvm0303/crmd/109, version=0.29.55)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section nodes: OK (rc=0, origin=dvtvm0303/crmd/112, version=0.29.55)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: --- 0.29.55 2<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: +++ 0.29.56 (null)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib: @num_updates=56<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='2']: @in_ccm=true, @crmd=online, @crm-debug-origin=post_cache_update<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='1']: @crm-debug-origin=post_cache_update<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=dvtvm0303/crmd/113, version=0.29.56)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Forwarding cib_modify operation for section status to all (origin=local/crmd/82)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Forwarding cib_modify operation for section status to all (origin=local/crmd/83)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: --- 0.29.56 2<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: +++ 0.29.57 (null)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib: @num_updates=57<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='2']: @crm-debug-origin=peer_update_callback<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=dvtvm0302/crmd/82, version=0.29.57)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=dvtvm0302/crmd/83, version=0.29.57)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/86)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Forwarding cib_modify operation for section status to all (origin=local/crmd/87)<br>
Jul 20 07:46:49 [1564] DVTVM0302.mse.am.mot.com stonith-ng: info: crm_get_peer: Created entry 1fd3c98b-2a62-4f07-9343-0850d9a68e83/0x55d0123ef950 for node dvtvm0303/2 (2 total)<br>
Jul 20 07:46:49 [1564] DVTVM0302.mse.am.mot.com stonith-ng: info: crm_get_peer: Node 2 is now known as dvtvm0303<br>
Jul 20 07:46:49 [1564] DVTVM0302.mse.am.mot.com stonith-ng: info: crm_get_peer: Node 2 has uuid 2<br>
Jul 20 07:46:49 [1564] DVTVM0302.mse.am.mot.com stonith-ng: info: pcmk_cpg_membership: Node 2 still member of group stonith-ng (peer=dvtvm0303, counter=5.1)<br>
Jul 20 07:46:49 [1564] DVTVM0302.mse.am.mot.com stonith-ng: info: crm_update_peer_proc: pcmk_cpg_membership: Node dvtvm0303[2] - corosync-cpg is now online<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section nodes: OK (rc=0, origin=dvtvm0302/crmd/86, version=0.29.57)<br>
Jul 20 07:46:49 [1566] DVTVM0302.mse.am.mot.com attrd: info: crm_get_peer: Created entry 523ee210-80c3-4ba0-a130-989aefa5d05f/0x55b7f9daa8e0 for node dvtvm0303/2 (2 total)<br>
Jul 20 07:46:49 [1566] DVTVM0302.mse.am.mot.com attrd: info: crm_get_peer: Node 2 is now known as dvtvm0303<br>
Jul 20 07:46:49 [1566] DVTVM0302.mse.am.mot.com attrd: info: crm_get_peer: Node 2 has uuid 2<br>
Jul 20 07:46:49 [1566] DVTVM0302.mse.am.mot.com attrd: info: pcmk_cpg_membership: Node 2 still member of group attrd (peer=dvtvm0303, counter=5.1)<br>
Jul 20 07:46:49 [1566] DVTVM0302.mse.am.mot.com attrd: info: crm_update_peer_proc: pcmk_cpg_membership: Node dvtvm0303[2] - corosync-cpg is now online<br>
Jul 20 07:46:49 [1566] DVTVM0302.mse.am.mot.com attrd: notice: crm_update_peer_state_iter: Node dvtvm0303 state is now member | nodeid=2 previous=unknown source=crm_update_peer_proc<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: --- 0.29.57 2<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: +++ 0.29.58 (null)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib: @num_updates=58<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='2']: @crm-debug-origin=post_cache_update<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=dvtvm0302/crmd/87, version=0.29.58)<br>
Jul 20 07:46:49 [1566] DVTVM0302.mse.am.mot.com attrd: notice: attrd_peer_message: Detected another attribute writer: dvtvm0303<br>
Jul 20 07:46:49 [1566] DVTVM0302.mse.am.mot.com attrd: info: attrd_peer_message: Processing sync-response from dvtvm0303<br>
Jul 20 07:46:49 [1566] DVTVM0302.mse.am.mot.com attrd: info: attrd_peer_update: Setting #attrd-protocol[dvtvm0303]: (null) -> 2 from dvtvm0303<br>
Jul 20 07:46:49 [1566] DVTVM0302.mse.am.mot.com attrd: info: attrd_peer_update: Setting pingd[dvtvm0303]: (null) -> 0 from dvtvm0303<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: register_fsa_error_adv: Resetting the current action list<br>
Jul 20 07:46:49 [1564] DVTVM0302.mse.am.mot.com stonith-ng: notice: crm_update_peer_state_iter: Node dvtvm0303 state is now member | nodeid=2 previous=unknown source=crm_update_peer_proc<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: warning: crmd_ha_msg_filter: Another DC detected: dvtvm0303 (op=noop)<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: notice: do_state_transition: State transition S_IDLE -> S_ELECTION | input=I_ELECTION cause=C_FSA_INTERNAL origin=crmd_ha_msg_filter<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: update_dc: Unset DC. Was dvtvm0302<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: election_count_vote: Election 6 (owner: 2) lost: vote from dvtvm0303 (Uptime)<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: notice: do_state_transition: State transition S_ELECTION -> S_RELEASE_DC | input=I_RELEASE_DC cause=C_FSA_INTERNAL origin=do_election_count_vote<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: do_dc_release: DC role released<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: pe_ipc_destroy: Connection to the Policy Engine released<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: do_te_control: Transitioner is now inactive<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_readwrite: We are now in R/O mode<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: do_log: Input I_RELEASE_SUCCESS received in state S_RELEASE_DC from do_dc_release<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: do_state_transition: State transition S_RELEASE_DC -> S_PENDING | input=I_RELEASE_SUCCESS cause=C_FSA_INTERNAL origin=do_dc_release<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: do_log: Input I_PENDING received in state S_PENDING from do_election_count_vote<br>
Jul 20 07:46:49 [1566] DVTVM0302.mse.am.mot.com attrd: info: election_count_vote: Election 4 (owner: 2) lost: vote from dvtvm0303 (Uptime)<br>
Jul 20 07:46:49 [1566] DVTVM0302.mse.am.mot.com attrd: info: election_count_vote: Election 5 (owner: 2) lost: vote from dvtvm0303 (Uptime)<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: election_count_vote: Election 7 (owner: 2) lost: vote from dvtvm0303 (Uptime)<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: do_log: Input I_PENDING received in state S_PENDING from do_election_count_vote<br>
Jul 20 07:46:49 [1566] DVTVM0302.mse.am.mot.com attrd: info: attrd_peer_message: Processing sync-response from dvtvm0303<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section cib: OK (rc=0, origin=dvtvm0303/crmd/115, version=0.29.58)<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: update_dc: Set DC to dvtvm0303 (3.0.14)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section crm_config: OK (rc=0, origin=dvtvm0303/crmd/117, version=0.29.58)<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: election_count_vote: Election 8 (owner: 2) lost: vote from dvtvm0303 (Uptime)<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: update_dc: Unset DC. Was dvtvm0303<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: do_log: Input I_PENDING received in state S_PENDING from do_election_count_vote<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: update_dc: Set DC to dvtvm0303 (3.0.14)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section crm_config: OK (rc=0, origin=dvtvm0303/crmd/119, version=0.29.58)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section crm_config: OK (rc=0, origin=dvtvm0303/crmd/121, version=0.29.58)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_replace: Digest matched on replace from dvtvm0303: 741acf29cc9726f86772f735a16a723a<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_replace: Replaced 0.29.58 with 0.29.64 from dvtvm0303<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: --- 0.29.58 2<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: +++ 0.29.64 (null)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: -- /cib/status/node_state[@id='1']/transient_attributes[@id='1']<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib: @num_updates=64, @dc-uuid=2<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='2']: @join=member<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='ClusterIP']/lrm_rsc_op[@id='ClusterIP_last_0']: @operation_key=ClusterIP_stop_0, @operation=stop,
@crm-debug-origin=do_update_resource, @transition-key=3:7:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076, @transition-magic=0:0;3:7:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076, @call-id=18, @rc-code=0, @last-run=1532087185, @last-rc-change=1532087185, @exec-t<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='2']/transient_attributes[@id='2']/instance_attributes[@id='status-2']/nvpair[@id='status-2-pingd']: @value=0<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='1']: @join=down<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: action_synced_wait: Managed application_meta-data_0 process 9340 exited with rc=4<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: error: lrmd_api_get_metadata: Failed to receive meta-data for ocf:vendor:application<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: warning: build_operation_update: Failed to get metadata for application (ocf:vendor:application)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_replace_notify: Replaced: 0.29.58 -> 0.29.64 from dvtvm0303<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_replace operation for section 'all': OK (rc=0, origin=dvtvm0303/crmd/125, version=0.29.64)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section nodes: OK (rc=0, origin=dvtvm0303/crmd/126, version=0.29.64)<br>
Jul 20 07:46:49 [1566] DVTVM0302.mse.am.mot.com attrd: notice: attrd_cib_replaced_cb: Updating all attributes after cib_refresh_notify event<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: action_synced_wait: Managed application_meta-data_0 process 9341 exited with rc=4<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section nodes: OK (rc=0, origin=dvtvm0303/crmd/127, version=0.29.64)<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: error: lrmd_api_get_metadata: Failed to receive meta-data for ocf:vendor:application<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: warning: build_operation_update: Failed to get metadata for application (ocf:vendor:application)<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: do_log: Input I_NOT_DC received in state S_PENDING from do_cl_join_finalize_respond<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: notice: do_state_transition: State transition S_PENDING -> S_NOT_DC | input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: --- 0.29.64 2<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: +++ 0.29.65 (null)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: -- /cib/status/node_state[@id='2']/lrm[@id='2']<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib: @num_updates=65<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='dvtvm0303']/lrm: OK (rc=0, origin=dvtvm0303/crmd/128, version=0.29.65)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: --- 0.29.65 2<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: +++ 0.29.66 (null)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib: @num_updates=66<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_lrm_query_internal<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ /cib/status/node_state[@id='2']: <lrm id="2"/><br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ <lrm_resources><br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ <lrm_resource id="Connected" type="ping" class="ocf" provider="pacemaker"><br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ <lrm_rsc_op id="Connected_last_0" operation_key="Connected_start_0" operation="start" crm-debug-origin="build_active_RAs" crm_feature_set="3.0.14"
transition-key="8:0:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076" transition-magic="0:0;8:0:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076" exit-reason="" on_node="dvtvm0303" call-id="15" rc-code="0" op-status="0" interval="0" last-run="1532086605"<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ <lrm_rsc_op id="Connected_monitor_3000" operation_key="Connected_monitor_3000" operation="monitor" crm-debug-origin="build_active_RAs"
crm_feature_set="3.0.14" transition-key="9:0:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076" transition-magic="0:0;9:0:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076" exit-reason="" on_node="dvtvm0303" call-id="16" rc-code="0" op-status="0" interval="3000" last-r<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ </lrm_resource><br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ <lrm_resource id="ClusterIP" type="IPaddr2" class="ocf" provider="heartbeat"><br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ <lrm_rsc_op id="ClusterIP_last_0" operation_key="ClusterIP_stop_0" operation="stop" crm-debug-origin="build_active_RAs" crm_feature_set="3.0.14"
transition-key="3:7:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076" transition-magic="0:0;3:7:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076" exit-reason="" on_node="dvtvm0303" call-id="18" rc-code="0" op-status="0" interval="0" last-run="1532087185" la<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ </lrm_resource><br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ <lrm_resource id="application" type="application" class="ocf" provider="vendor"><br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ <lrm_rsc_op id="application_last_0" operation_key="application_monitor_0" operation="monitor" crm-debug-origin="build_active_RAs"
crm_feature_set="3.0.14" transition-key="7:0:7:4ad59ad3-3a70-4282-a52c-1f14cce6b076" transition-magic="0:7;7:0:7:4ad59ad3-3a70-4282-a52c-1f14cce6b076" exit-reason="" on_node="dvtvm0303" call-id="14" rc-code="7" op-status="0" interval="0" last-run="1532<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ </lrm_resource><br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ </lrm_resources><br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ </lrm><br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=dvtvm0303/crmd/129, version=0.29.66)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: --- 0.29.66 2<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: +++ 0.29.67 (null)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: -- /cib/status/node_state[@id='1']/lrm[@id='1']<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib: @num_updates=67<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='dvtvm0302']/lrm: OK (rc=0, origin=dvtvm0303/crmd/130, version=0.29.67)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: --- 0.29.67 2<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: +++ 0.29.68 (null)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib: @num_updates=68<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='1']: @crm-debug-origin=do_lrm_query_internal, @join=member<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ /cib/status/node_state[@id='1']: <lrm id="1"/><br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ <lrm_resources><br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ <lrm_resource id="Connected" type="ping" class="ocf" provider="pacemaker"><br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ <lrm_rsc_op id="Connected_last_0" operation_key="Connected_start_0" operation="start" crm-debug-origin="build_active_RAs" crm_feature_set="3.0.14"
transition-key="10:0:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076" transition-magic="0:0;10:0:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076" exit-reason="" on_node="dvtvm0302" call-id="15" rc-code="0" op-status="0" interval="0" last-run="1532086605<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ <lrm_rsc_op id="Connected_monitor_3000" operation_key="Connected_monitor_3000" operation="monitor" crm-debug-origin="build_active_RAs"
crm_feature_set="3.0.14" transition-key="11:0:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076" transition-magic="0:0;11:0:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076" exit-reason="" on_node="dvtvm0302" call-id="16" rc-code="0" op-status="0" interval="3000" last<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ </lrm_resource><br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ <lrm_resource id="ClusterIP" type="IPaddr2" class="ocf" provider="heartbeat"><br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ <lrm_rsc_op id="ClusterIP_last_0" operation_key="ClusterIP_start_0" operation="start" crm-debug-origin="build_active_RAs" crm_feature_set="3.0.14"
transition-key="4:1:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076" transition-magic="0:0;4:1:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076" exit-reason="" on_node="dvtvm0302" call-id="17" rc-code="0" op-status="0" interval="0" last-run="1532086609"<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ <lrm_rsc_op id="ClusterIP_monitor_1000" operation_key="ClusterIP_monitor_1000" operation="monitor" crm-debug-origin="build_active_RAs"
crm_feature_set="3.0.14" transition-key="5:1:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076" transition-magic="0:0;5:1:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076" exit-reason="" on_node="dvtvm0302" call-id="18" rc-code="0" op-status="0" interval="1000" last-r<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ </lrm_resource><br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ <lrm_resource id="application" type="application" class="ocf" provider="vendor"><br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ <lrm_rsc_op id="application_last_0" operation_key="application_start_0" operation="start" crm-debug-origin="build_active_RAs"
crm_feature_set="3.0.14" transition-key="14:1:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076" transition-magic="0:0;14:1:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076" exit-reason="" on_node="dvtvm0302" call-id="19" rc-code="0" op-status="0" interval="0" last-run="153208<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ <lrm_rsc_op id="application_monitor_1000" operation_key="application_monitor_1000" operation="monitor" crm-debug-origin="build_active_RAs"
crm_feature_set="3.0.14" transition-key="15:1:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076" transition-magic="0:0;15:1:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076" exit-reason="" on_node="dvtvm0302" call-id="20" rc-code="0" op-status="0" interval="1000"<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ </lrm_resource><br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ </lrm_resources><br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ </lrm><br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=dvtvm0303/crmd/131, version=0.29.68)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section nodes: OK (rc=0, origin=dvtvm0303/crmd/134, version=0.29.68)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: --- 0.29.68 2<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: +++ 0.29.69 (null)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib: @num_updates=69<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_state_transition<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='1']: @crm-debug-origin=do_state_transition<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=dvtvm0303/crmd/135, version=0.29.69)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section cib: OK (rc=0, origin=dvtvm0303/crmd/136, version=0.29.69)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_file_backup: Archived previous version as /var/lib/pacemaker/cib/cib-49.raw<br>
Jul 20 07:46:49 [1565] DVTVM0302.mse.am.mot.com lrmd: info: cancel_recurring_action: Cancelling ocf operation application_monitor_1000<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: do_lrm_rsc_op: Performing key=15:8:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076 op=application_stop_0<br>
Jul 20 07:46:49 [1565] DVTVM0302.mse.am.mot.com lrmd: info: log_execute: executing - rsc:application action:stop call_id:22<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Forwarding cib_modify operation for section status to all (origin=local/crmd/92)<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: process_lrm_event: Result of monitor operation for application on dvtvm0302: Cancelled | call=20 key=application_monitor_1000 confirmed=true<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: --- 0.29.69 2<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: +++ 0.29.70 (null)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib: @num_updates=70<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='1']: @crm-debug-origin=do_update_resource<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='application']/lrm_rsc_op[@id='application_last_0']: @operation_key=application_stop_0,
@operation=stop, @crm-debug-origin=do_update_resource, @transition-key=15:8:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076, @transition-magic=-1:193;15:8:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076, @call-id=-1, @rc-code=193, @op-status=-1, @last-run=1532087209, @last-r<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=dvtvm0302/crmd/92, version=0.29.70)<br>
Jul 20 07:46:49 application(application)[9364]: INFO: Stopping APP - setting to Standby<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_file_write_with_digest: Wrote version 0.29.0 of the CIB to disk (digest: 67b46b2a11db4ce9d1a5fb649ae91bd3)<br>
Jul 20 07:46:49 [1565] DVTVM0302.mse.am.mot.com lrmd: notice: operation_finished: application_stop_0:9364:stderr [ /usr/local/vendor/bin/PrimaryMode.sh: line 27: $Filename: ambiguous redirect ]<br>
Jul 20 07:46:49 [1565] DVTVM0302.mse.am.mot.com lrmd: info: log_finished: finished - rsc:application action:stop call_id:22 pid:9364 exit-code:0 exec-time:50ms queue-time:0ms<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: notice: process_lrm_event: Result of stop operation for application on dvtvm0302: 0 (ok) | call=22 key=application_stop_0 confirmed=true cib-update=93<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Forwarding cib_modify operation for section status to all (origin=local/crmd/93)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: --- 0.29.70 2<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: +++ 0.29.71 (null)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib: @num_updates=71<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='application']/lrm_rsc_op[@id='application_last_0']: @transition-magic=0:0;15:8:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076,
@call-id=22, @rc-code=0, @op-status=0, @exec-time=50<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=dvtvm0302/crmd/93, version=0.29.71)<br>
Jul 20 07:46:49 [1385] DVTVM0302.mse.am.mot.com pacemakerd: info: mcp_cpg_deliver: Ignoring process list sent by peer for local node<br>
Jul 20 07:46:49 [1565] DVTVM0302.mse.am.mot.com lrmd: info: cancel_recurring_action: Cancelling ocf operation ClusterIP_monitor_1000<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: do_lrm_rsc_op: Performing key=6:8:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076 op=ClusterIP_stop_0<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Forwarding cib_modify operation for section status to all (origin=local/crmd/94)<br>
Jul 20 07:46:49 [1565] DVTVM0302.mse.am.mot.com lrmd: info: log_execute: executing - rsc:ClusterIP action:stop call_id:24<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: --- 0.29.71 2<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: +++ 0.29.72 (null)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib: @num_updates=72<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='ClusterIP']/lrm_rsc_op[@id='ClusterIP_last_0']: @operation_key=ClusterIP_stop_0, @operation=stop,
@crm-debug-origin=do_update_resource, @transition-key=6:8:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076, @transition-magic=-1:193;6:8:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076, @call-id=-1, @rc-code=193, @op-status=-1, @last-run=1532087209, @last-rc-change<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: info: process_lrm_event: Result of monitor operation for ClusterIP on dvtvm0302: Cancelled | call=18 key=ClusterIP_monitor_1000 confirmed=true<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=dvtvm0302/crmd/94, version=0.29.72)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_file_write_with_digest: Reading cluster configuration file /var/lib/pacemaker/cib/cib.mJOEZ4 (digest: /var/lib/pacemaker/cib/cib.Tr4rcL)<br>
Jul 20 07:46:49 IPaddr2(ClusterIP)[9375]: INFO: IP status = ok, IP_CIP=<br>
Jul 20 07:46:49 [1565] DVTVM0302.mse.am.mot.com lrmd: info: log_finished: finished - rsc:ClusterIP action:stop call_id:24 pid:9375 exit-code:0 exec-time:108ms queue-time:0ms<br>
Jul 20 07:46:49 [1569] DVTVM0302.mse.am.mot.com crmd: notice: process_lrm_event: Result of stop operation for ClusterIP on dvtvm0302: 0 (ok) | call=24 key=ClusterIP_stop_0 confirmed=true cib-update=95<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Forwarding cib_modify operation for section status to all (origin=local/crmd/95)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: --- 0.29.72 2<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: +++ 0.29.73 (null)<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib: @num_updates=73<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='ClusterIP']/lrm_rsc_op[@id='ClusterIP_last_0']: @transition-magic=0:0;6:8:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076,
@call-id=24, @rc-code=0, @op-status=0, @exec-time=108<br>
Jul 20 07:46:49 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=dvtvm0302/crmd/95, version=0.29.73)<br>
Jul 20 07:46:50 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: --- 0.29.73 2<br>
Jul 20 07:46:50 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: +++ 0.29.74 (null)<br>
Jul 20 07:46:50 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib: @num_updates=74<br>
Jul 20 07:46:50 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ /cib/status/node_state[@id='1']: <transient_attributes id="1"/><br>
Jul 20 07:46:50 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ <instance_attributes id="status-1"><br>
Jul 20 07:46:50 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ <nvpair id="status-1-pingd" name="pingd" value="2000"/><br>
Jul 20 07:46:50 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ </instance_attributes><br>
Jul 20 07:46:50 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: ++ </transient_attributes><br>
Jul 20 07:46:50 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=dvtvm0303/attrd/8, version=0.29.74)<br>
Jul 20 07:46:50 [1569] DVTVM0302.mse.am.mot.com crmd: info: do_lrm_rsc_op: Performing key=4:9:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076 op=ClusterIP_start_0<br>
Jul 20 07:46:50 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Forwarding cib_modify operation for section status to all (origin=local/crmd/96)<br>
Jul 20 07:46:50 [1565] DVTVM0302.mse.am.mot.com lrmd: info: log_execute: executing - rsc:ClusterIP action:start call_id:25<br>
Jul 20 07:46:50 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: --- 0.29.74 2<br>
Jul 20 07:46:50 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: +++ 0.29.75 (null)<br>
Jul 20 07:46:50 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib: @num_updates=75<br>
Jul 20 07:46:50 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='ClusterIP']/lrm_rsc_op[@id='ClusterIP_last_0']: @operation_key=ClusterIP_start_0, @operation=start,
@transition-key=4:9:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076, @transition-magic=-1:193;4:9:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076, @call-id=-1, @rc-code=193, @op-status=-1, @last-run=1532087210, @last-rc-change=1532087210, @exec-time=0<br>
Jul 20 07:46:50 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=dvtvm0302/crmd/96, version=0.29.75)<br>
Jul 20 07:46:50 IPaddr2(ClusterIP)[9442]: INFO: Adding inet address 10.144.101.210/24 with broadcast address 10.144.101.255 to device eth0<br>
Jul 20 07:46:50 IPaddr2(ClusterIP)[9442]: INFO: Bringing device eth0 up<br>
Jul 20 07:46:50 IPaddr2(ClusterIP)[9442]: INFO: /usr/libexec/heartbeat/send_arp -i 200 -c 5 -p /var/run/resource-agents/send_arp-10.144.101.210 -I eth0 -m auto 10.144.101.210<br>
Jul 20 07:46:52 [1566] DVTVM0302.mse.am.mot.com attrd: info: attrd_peer_update: Setting pingd[dvtvm0303]: 0 -> 2000 from dvtvm0303<br>
Jul 20 07:46:53 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: --- 0.29.75 2<br>
Jul 20 07:46:53 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: +++ 0.29.76 (null)<br>
Jul 20 07:46:53 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib: @num_updates=76<br>
Jul 20 07:46:53 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='2']/transient_attributes[@id='2']/instance_attributes[@id='status-2']/nvpair[@id='status-2-pingd']: @value=2000<br>
Jul 20 07:46:53 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=dvtvm0303/attrd/9, version=0.29.76)<br>
Jul 20 07:46:54 [1565] DVTVM0302.mse.am.mot.com lrmd: info: log_finished: finished - rsc:ClusterIP action:start call_id:25 pid:9442 exit-code:0 exec-time:4131ms queue-time:0ms<br>
Jul 20 07:46:54 [1569] DVTVM0302.mse.am.mot.com crmd: notice: process_lrm_event: Result of start operation for ClusterIP on dvtvm0302: 0 (ok) | call=25 key=ClusterIP_start_0 confirmed=true cib-update=97<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Forwarding cib_modify operation for section status to all (origin=local/crmd/97)<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: --- 0.29.76 2<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: +++ 0.29.77 (null)<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib: @num_updates=77<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='ClusterIP']/lrm_rsc_op[@id='ClusterIP_last_0']: @transition-magic=0:0;4:9:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076,
@call-id=25, @rc-code=0, @op-status=0, @exec-time=4131<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=dvtvm0302/crmd/97, version=0.29.77)<br>
Jul 20 07:46:54 [1569] DVTVM0302.mse.am.mot.com crmd: info: do_lrm_rsc_op: Performing key=6:10:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076 op=ClusterIP_monitor_1000<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Forwarding cib_modify operation for section status to all (origin=local/crmd/98)<br>
Jul 20 07:46:54 [1569] DVTVM0302.mse.am.mot.com crmd: info: do_lrm_rsc_op: Performing key=15:10:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076 op=application_start_0<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: --- 0.29.77 2<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: +++ 0.29.78 (null)<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib: @num_updates=78<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='ClusterIP']/lrm_rsc_op[@id='ClusterIP_monitor_1000']: @crm-debug-origin=do_update_resource,
@transition-key=6:10:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076, @transition-magic=-1:193;6:10:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1532087214, @exec-time=0<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=dvtvm0302/crmd/98, version=0.29.78)<br>
Jul 20 07:46:54 [1569] DVTVM0302.mse.am.mot.com crmd: info: action_synced_wait: Managed application_meta-data_0 process 9587 exited with rc=4<br>
Jul 20 07:46:54 [1569] DVTVM0302.mse.am.mot.com crmd: error: lrmd_api_get_metadata: Failed to receive meta-data for ocf:vendor:application<br>
Jul 20 07:46:54 [1569] DVTVM0302.mse.am.mot.com crmd: warning: build_operation_update: Failed to get metadata for application (ocf:vendor:application)<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Forwarding cib_modify operation for section status to all (origin=local/crmd/99)<br>
Jul 20 07:46:54 [1565] DVTVM0302.mse.am.mot.com lrmd: info: log_execute: executing - rsc:application action:start call_id:27<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: --- 0.29.78 2<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: +++ 0.29.79 (null)<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib: @num_updates=79<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='application']/lrm_rsc_op[@id='application_last_0']: @operation_key=application_start_0,
@operation=start, @transition-key=15:10:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076, @transition-magic=-1:193;15:10:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076, @call-id=-1, @rc-code=193, @op-status=-1, @last-run=1532087214, @last-rc-change=1532087214, @exec-time=0<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=dvtvm0302/crmd/99, version=0.29.79)<br>
Jul 20 07:46:54 application(application)[9588]: INFO: Starting APP - setting to Primary<br>
Jul 20 07:46:54 [1565] DVTVM0302.mse.am.mot.com lrmd: info: log_finished: finished - rsc:application action:start call_id:27 pid:9588 exit-code:0 exec-time:50ms queue-time:0ms<br>
Jul 20 07:46:54 [1569] DVTVM0302.mse.am.mot.com crmd: info: action_synced_wait: Managed application_meta-data_0 process 9624 exited with rc=4<br>
Jul 20 07:46:54 [1569] DVTVM0302.mse.am.mot.com crmd: error: lrmd_api_get_metadata: Failed to receive meta-data for ocf:vendor:application<br>
Jul 20 07:46:54 [1569] DVTVM0302.mse.am.mot.com crmd: warning: build_operation_update: Failed to get metadata for application (ocf:vendor:application)<br>
Jul 20 07:46:54 [1569] DVTVM0302.mse.am.mot.com crmd: notice: process_lrm_event: Result of start operation for application on dvtvm0302: 0 (ok) | call=27 key=application_start_0 confirmed=true cib-update=100<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Forwarding cib_modify operation for section status to all (origin=local/crmd/100)<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: --- 0.29.79 2<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: +++ 0.29.80 (null)<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib: @num_updates=80<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='application']/lrm_rsc_op[@id='application_last_0']: @transition-magic=0:0;15:10:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076,
@call-id=27, @rc-code=0, @op-status=0, @exec-time=50<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=dvtvm0302/crmd/100, version=0.29.80)<br>
Jul 20 07:46:54 [1569] DVTVM0302.mse.am.mot.com crmd: info: do_lrm_rsc_op: Performing key=16:10:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076 op=application_monitor_1000<br>
Jul 20 07:46:54 [1569] DVTVM0302.mse.am.mot.com crmd: info: action_synced_wait: Managed application_meta-data_0 process 9629 exited with rc=4<br>
Jul 20 07:46:54 [1569] DVTVM0302.mse.am.mot.com crmd: error: lrmd_api_get_metadata: Failed to receive meta-data for ocf:vendor:application<br>
Jul 20 07:46:54 [1569] DVTVM0302.mse.am.mot.com crmd: warning: build_operation_update: Failed to get metadata for application (ocf:vendor:application)<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Forwarding cib_modify operation for section status to all (origin=local/crmd/101)<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: --- 0.29.80 2<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: +++ 0.29.81 (null)<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib: @num_updates=81<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='application']/lrm_rsc_op[@id='application_monitor_1000']: @crm-debug-origin=do_update_resource,
@transition-key=16:10:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076, @transition-magic=-1:193;16:10:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1532087214, @exec-time=0<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=dvtvm0302/crmd/101, version=0.29.81)<br>
Jul 20 07:46:54 [1569] DVTVM0302.mse.am.mot.com crmd: info: process_lrm_event: Result of monitor operation for ClusterIP on dvtvm0302: 0 (ok) | call=26 key=ClusterIP_monitor_1000 confirmed=false cib-update=102<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Forwarding cib_modify operation for section status to all (origin=local/crmd/102)<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: --- 0.29.81 2<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: +++ 0.29.82 (null)<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib: @num_updates=82<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='ClusterIP']/lrm_rsc_op[@id='ClusterIP_monitor_1000']: @transition-magic=0:0;6:10:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076,
@call-id=26, @rc-code=0, @op-status=0, @exec-time=88<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=dvtvm0302/crmd/102, version=0.29.82)<br>
Jul 20 07:46:54 [1569] DVTVM0302.mse.am.mot.com crmd: info: action_synced_wait: Managed application_meta-data_0 process 9654 exited with rc=4<br>
Jul 20 07:46:54 [1569] DVTVM0302.mse.am.mot.com crmd: error: lrmd_api_get_metadata: Failed to receive meta-data for ocf:vendor:application<br>
Jul 20 07:46:54 [1569] DVTVM0302.mse.am.mot.com crmd: warning: build_operation_update: Failed to get metadata for application (ocf:vendor:application)<br>
Jul 20 07:46:54 [1569] DVTVM0302.mse.am.mot.com crmd: info: process_lrm_event: Result of monitor operation for application on dvtvm0302: 0 (ok) | call=28 key=application_monitor_1000 confirmed=false cib-update=103<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Forwarding cib_modify operation for section status to all (origin=local/crmd/103)<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: --- 0.29.82 2<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: Diff: +++ 0.29.83 (null)<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib: @num_updates=83<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_perform_op: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='application']/lrm_rsc_op[@id='application_monitor_1000']: @transition-magic=0:0;16:10:0:4ad59ad3-3a70-4282-a52c-1f14cce6b076,
@call-id=28, @rc-code=0, @op-status=0, @exec-time=28<br>
Jul 20 07:46:54 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=dvtvm0302/crmd/103, version=0.29.83)<br>
Jul 20 07:46:59 [1563] DVTVM0302.mse.am.mot.com cib: info: cib_process_ping: Reporting our current digest to dvtvm0303: ed20687114e2def7cb9106c09ff45a07 for 0.29.83 (0x56163caf1220 0)<br>
<br>
</font><br>
</div>
</body>
</html>