<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
@font-face
{font-family:"Courier\000D\000A New";
panose-1:0 0 0 0 0 0 0 0 0 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;
color:black;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0cm;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";
color:black;}
p.Courier, li.Courier, div.Courier
{mso-style-name:Courier;
mso-style-link:"Courier Char";
margin:0cm;
margin-bottom:.0001pt;
line-height:105%;
font-size:8.0pt;
font-family:"Courier New";
color:black;}
span.CourierChar
{mso-style-name:"Courier Char";
mso-style-link:Courier;
font-family:"Courier New";
color:black;}
p.emailquote, li.emailquote, div.emailquote
{mso-style-name:emailquote;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:1.0pt;
border:none;
padding:0cm;
font-size:12.0pt;
font-family:"Times New Roman",serif;
color:black;}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:Consolas;
color:black;}
span.EmailStyle22
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 2.0cm 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body bgcolor="white" lang="DE-AT" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Hello<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">I think there is a more general misunderstanding on my side.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">I reproduced the “problem” with a very simple test-cluster containing just 2 dummy resources:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="Courier" style="margin-left:35.4pt"><span lang="EN-GB" style="mso-fareast-language:EN-US">Pacemaker Nodes:<o:p></o:p></span></p>
<p class="Courier" style="margin-left:35.4pt"><span lang="EN-GB" style="mso-fareast-language:EN-US">deneb682 deneb683<o:p></o:p></span></p>
<p class="Courier" style="margin-left:35.4pt"><span lang="EN-GB" style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="Courier" style="margin-left:35.4pt"><span lang="EN-GB" style="mso-fareast-language:EN-US">Resources:<o:p></o:p></span></p>
<p class="Courier" style="margin-left:35.4pt"><span lang="EN-GB" style="mso-fareast-language:EN-US">Resource: Res1 (class=ocf provider=pacemaker type=Dummy)<o:p></o:p></span></p>
<p class="Courier" style="margin-left:35.4pt"><span lang="EN-GB" style="mso-fareast-language:EN-US"> Operations: start interval=0s timeout=20 (Res1-start-interval-0s)<o:p></o:p></span></p>
<p class="Courier" style="margin-left:35.4pt"><span lang="EN-GB" style="mso-fareast-language:EN-US"> stop interval=0s timeout=20 (Res1-stop-interval-0s)<o:p></o:p></span></p>
<p class="Courier" style="margin-left:35.4pt"><span lang="EN-GB" style="mso-fareast-language:EN-US"> monitor interval=10 timeout=20 (Res1-monitor-interval-10)<o:p></o:p></span></p>
<p class="Courier" style="margin-left:35.4pt"><span lang="EN-GB" style="mso-fareast-language:EN-US">Resource: Res2 (class=ocf provider=pacemaker type=Dummy)<o:p></o:p></span></p>
<p class="Courier" style="margin-left:35.4pt"><span lang="EN-GB" style="mso-fareast-language:EN-US"> Operations: start interval=0s timeout=20 (Res2-start-interval-0s)<o:p></o:p></span></p>
<p class="Courier" style="margin-left:35.4pt"><span lang="EN-GB" style="mso-fareast-language:EN-US"> stop interval=0s timeout=20 (Res2-stop-interval-0s)<o:p></o:p></span></p>
<p class="Courier" style="margin-left:35.4pt"><span lang="EN-GB" style="mso-fareast-language:EN-US"> monitor interval=10 timeout=20 (Res2-monitor-interval-10)<o:p></o:p></span></p>
<p class="Courier" style="margin-left:35.4pt"><span lang="EN-GB" style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="Courier" style="margin-left:35.4pt"><span lang="EN-GB" style="mso-fareast-language:EN-US">Ordering Constraints:<o:p></o:p></span></p>
<p class="Courier" style="margin-left:35.4pt"><span lang="EN-GB" style="mso-fareast-language:EN-US"> start Res1 then start Res2 (kind:Mandatory) (id:order-Res1-Res2-mandatory)<o:p></o:p></span></p>
<p class="Courier" style="margin-left:35.4pt"><span lang="EN-GB" style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="Courier" style="margin-left:35.4pt"><span lang="EN-GB" style="mso-fareast-language:EN-US">Cluster Properties:<o:p></o:p></span></p>
<p class="Courier" style="margin-left:35.4pt"><span lang="EN-GB" style="mso-fareast-language:EN-US">cluster-infrastructure: cman<o:p></o:p></span></p>
<p class="Courier" style="margin-left:35.4pt"><span lang="EN-GB" style="mso-fareast-language:EN-US">default-resource-stickiness: 100<o:p></o:p></span></p>
<p class="Courier" style="margin-left:35.4pt"><span lang="EN-GB" style="mso-fareast-language:EN-US">no-quorum-policy: ignore<o:p></o:p></span></p>
<p class="Courier" style="margin-left:35.4pt"><span lang="EN-GB" style="mso-fareast-language:EN-US">symmetric-cluster: true<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">When I call “pcs resource cleanup Res1” this will result in an interruption of service at the side of Res2 (i.e. stop
Res2 …)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">My – unconfirmed – assumption was, that pacemaker would first detect the current state of the resource(s) by calling monitor
and then decide if there are any actions to be performed.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">But from reading the logfiles I would interpret that Res1 is temporarily removed from the cib and re-inserted again. And
this results in stopping Res2 until Res1 has confirmed state “started”.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">As I interpret the documentation it would be possible to avoid this behaviour by configuring the order constraint with
kind=Optional.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">But I am not sure if this would result in any other undeserved side effects. (e.g on reverse order when stopping)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Another work-around seems to be setting the dependent resource to unmanaged, perform the cleanup and then set it back
to managed.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">And I wonder if “pcs resource failcount reset” would do the trick WITHOUT any actions being performed if no change in
state is necessary.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">But I think to remember that we already tried this now and then and sometimes such a failed resource was not started after
the failcount reset. (But I am not sure and had not yet time to try to reproduce.)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Is there any deeper insight which might help with a sound understanding of this issue?<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Kind regards<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Andreas Cart<o:p></o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext">From:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext"> Klaus Wenninger [mailto:kwenning@redhat.com]
<br>
<b>Sent:</b> Mittwoch, 13. September 2017 13:33<br>
<b>To:</b> Cluster Labs - All topics related to open-source clustering welcomed <users@clusterlabs.org>; CART Andreas <andreas.cart@sonorys.at><br>
<b>Subject:</b> Re: [ClusterLabs] How to avoid stopping ordered resources on cleanup?<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On 09/13/2017 10:26 AM, CART Andreas wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0">Hello</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0"> </span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0">We have a basic 2 node active/passive cluster with Pacemaker (1.1.16 , pcs: 0.9.148) / CMAN (3.0.12.1) / Corosync (1.4.7) on RHEL 6.8.</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0"> </span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0">On the occasion of testing the cluster we noticed that dependent resources are stopped when calling cleanup for a resource lower down the order chain.</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0">But for the production system we have to avoid this by all means.</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0"> </span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0">Actually we have a master/slave resource and dependent on that and colocated with the master a clustered IP address.</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0">Here is the relevant part of the cluster config:</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Cluster Name: bam-cluster</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Corosync Nodes:</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">bam1-backend bam2-backend</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Pacemaker Nodes:</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">bam1-backend bam2-backend</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif"> </span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Resources:</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Master: mvno-100-master</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif"> Meta Attrs: master-node-max=1 clone-max=2 notify=true master-max=1 clone-node-max=1</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif"> Resource: mvno-100 (class=ocf provider=sonorys type=sba)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif"> Operations: start interval=0s timeout=120s (mvno-100-start-interval-0s)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif"> stop interval=0s timeout=120s (mvno-100-stop-interval-0s)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif"> promote interval=0s timeout=5s (mvno-100-promote-interval-0s)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif"> demote interval=0s timeout=5s (mvno-100-demote-interval-0s)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif"> monitor interval=9 role=Master (mvno-100-monitor-interval-9)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif"> monitor interval=10 role=Slave (mvno-100-monitor-interval-10)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Resource: IPaddrAdminToolMvno100 (class=ocf provider=heartbeat type=IPaddr2)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif"> Attributes: ip=xxx.xxx.xxx.xxx cidr_netmask=yy</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif"> Operations: start interval=0s timeout=20s (IPaddrAdminToolMvno100-start-interval-0s)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif"> stop interval=0s timeout=20s (IPaddrAdminToolMvno100-stop-interval-0s)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif"> monitor interval=10s timeout=20s (IPaddrAdminToolMvno100-monitor-interval-10s)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Ordering Constraints:</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif"> start IPaddrAdminToolMvno100 then promote mvno-100-master (kind:Mandatory) (id:order-IPaddrAdminToolMvno100-mvno-100-master-mandatory)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Colocation Constraints:</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif"> IPaddrAdminToolMvno100 with mvno-100-master (score:INFINITY) (rsc-role:Started) (with-rsc-role:Master) (id:colocation-IPaddrAdminToolMvno100-mvno-100-master-INFINITY)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Cluster Properties:</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">cluster-infrastructure: cman</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">default-resource-stickiness: 100</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">no-quorum-policy: ignore</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">symmetric-cluster: true</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
</blockquote>
<p class="MsoNormal"><br>
Have you tried the other way round?<br>
like: promote mvno-100 then start IPaddrAdminToolMvno100<br>
<br>
Regards,<br>
Klaus<br>
<br>
<br>
<o:p></o:p></p>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0"> </span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0">For example we had the following failure notice:</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Failed Actions:</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">* mvno-100_monitor_10000 on bam1-backend 'not running' (7): call=40, status=complete, exitreason='none',</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif"> last-rc-change='Tue Sep 12 09:55:49 2017', queued=0ms, exec=0ms</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0"> </span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0">And cleared it by calling:</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif"># pcs resource cleanup mvno-100</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Wed Sep 13 06:43:53 UTC 2017</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Cleaning up mvno-100:0 on bam1-backend, removing fail-count-mvno-100</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Cleaning up mvno-100:0 on bam2-backend, removing fail-count-mvno-100</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Waiting for 2 replies from the CRMd.. OK</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0"> </span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0">This resulted in stopping IPaddrAdminToolMvno100 and starting it again, which actually means a (short) interruption of service … which we would like to avoid.</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0"> </span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0">Here is the corresponding logfile for the cluster:</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3829] bam1-omc attrd: notice: attrd_cs_dispatch: Update relayed from bam2-backend</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3829] bam1-omc attrd: notice: attrd_trigger_update: Sending flush op to all hosts for: fail-count-mvno-100 (<null>)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_perform_op: Diff: --- 0.167.0 2</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_perform_op: Diff: +++ 0.167.1 590cae41f6fad2b00a8cf067302756e4</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_perform_op: -- /cib/status/node_state[@id='bam1-backend']/lrm[@id='bam1-backend']/lrm_resources/lrm_resource[@id='mvno-100']</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_perform_op: + /cib: @num_updates=1</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='bam1-backend']//lrm_resource[@id='mvno-10</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">0']: OK (rc=0, origin=local/crmd/1485, version=0.167.0)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_perform_op: Diff: --- 0.167.0 2</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_perform_op: Diff: +++ 0.167.1 (null)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_perform_op: -- /cib/status/node_state[@id='bam2-backend']/lrm[@id='bam2-backend']/lrm_resources/lrm_resource[@id='mvno-100']</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_perform_op: + /cib: @num_updates=1</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='bam2-backend']//lrm_resource[@id='mvno-10</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">0']: OK (rc=0, origin=bam2-backend/crmd/39, version=0.167.0)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3831] bam1-omc crmd: info: delete_resource: Removing resource mvno-100 for 1c0903b8-1dcc-432a-b6a8-e409ce917dda (root) on bam2-backend</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3828] bam1-omc lrmd: info: cancel_recurring_action: Cancelling ocf operation mvno-100_monitor_9000</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3829] bam1-omc attrd: notice: attrd_perform_update: Sent delete 57: node=bam1-backend, attr=fail-count-mvno-100, id=<n/a>, set=(null),
section=status</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3831] bam1-omc crmd: info: lrm_remove_deleted_op: Removing op mvno-100_monitor_9000:95 for deleted resource mvno-100</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3831] bam1-omc crmd: info: notify_deleted: Notifying 1c0903b8-1dcc-432a-b6a8-e409ce917dda on bam2-backend that mvno-100 was deleted</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_perform_op: Diff: --- 0.167.0 2</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_perform_op: Diff: +++ 0.167.1 (null)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_perform_op: -- /cib/status/node_state[@id='bam1-backend']/transient_attributes[@id='bam1-backend']/instance_attributes[@id='s</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">tatus-bam1-backend']/nvpair[@id='status-bam1-backend-fail-count-mvno-100']</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_perform_op: + /cib: @num_updates=1</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_process_request: Completed cib_delete operation for section status: OK (rc=0, origin=local/attrd/57,
version=0.167.1)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_perform_op: Diff: --- 0.167.1 2</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_perform_op: Diff: +++ 0.167.2 (null)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_perform_op: -- /cib/status/node_state[@id='bam1-backend']/lrm[@id='bam1-backend']/lrm_resources/lrm_resource[@id='mvno-100']</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_perform_op: + /cib: @num_updates=2</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='bam1-backend']//lrm_resource[@id='mvno-10</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">0']: OK (rc=0, origin=local/crmd/1486, version=0.167.2)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3831] bam1-omc crmd: info: abort_transition_graph: Transition aborted by deletion of nvpair[@id='status-bam1-backend-fail-count-mvno-100']:
Transient attrib</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">ute change | cib=0.167.1 source=abort_unless_down:345 path=/cib/status/node_state[@id='bam1-backend']/transient_attributes[@id='bam1-backend']/instance_attributes[@id='status-bam1-backe</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">nd']/nvpair[@id='status-bam1-backend-fail-count-mvno-100'] complete=true</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3831] bam1-omc crmd: info: abort_transition_graph: Transition aborted by deletion of lrm_resource[@id='mvno-100']: Resource state
removal | cib=0.167.2 sour</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">ce=abort_unless_down:345 path=/cib/status/node_state[@id='bam1-backend']/lrm[@id='bam1-backend']/lrm_resources/lrm_resource[@id='mvno-100'] complete=true</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3828] bam1-omc lrmd: info: process_lrmd_get_rsc_info: Resource 'mvno-100' not found (3 active resources)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3831] bam1-omc crmd: info: process_lrm_event: Result of monitor operation for mvno-100 on bam1-backend: Cancelled | call=95 key=mvno-100_monitor_9000
c</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">onfirmed=true</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3831] bam1-omc crmd: info: update_history_cache: Resource mvno-100 no longer exists, not updating cache</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3831] bam1-omc crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_FSA_INTERNAL
origin=abort_transition</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">_graph</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_perform_op: Diff: --- 0.167.2 2</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_perform_op: Diff: +++ 0.168.0 (null)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_perform_op: + /cib: @epoch=168, @num_updates=0</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_perform_op: + /cib/configuration/crm_config/cluster_property_set[@id='cib-bootstrap-options']/nvpair[@id='cib-bootstrap-opti</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">ons-last-lrm-refresh']: @value=1505285033</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_process_request: Completed cib_modify operation for section crm_config: OK (rc=0, origin=local/crmd/1488,
version=0.168.0)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3831] bam1-omc crmd: info: abort_transition_graph: Transition aborted by cib-bootstrap-options-last-lrm-refresh doing modify last-lrm-refresh=1505285033:
Configuration change | cib=0.168.0 source=te_update_diff:444 path=/cib/configuration/crm_config/cluster_property_set[@id='cib-bootstrap-options']/nvpair[@id='cib-bootstrap-options-last-lrm-refresh'] complete=true</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_file_backup: Archived previous version as /var/lib/pacemaker/cib/cib-65.raw</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_perform_op: Diff: --- 0.168.0 2</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_perform_op: Diff: +++ 0.168.1 (null)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_perform_op: -- /cib/status/node_state[@id='bam2-backend']/lrm[@id='bam2-backend']/lrm_resources/lrm_resource[@id='mvno-100']</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_perform_op: + /cib: @num_updates=1</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='bam2-backend']//lrm_resource[@id='mvno-100']:
OK (rc=0, origin=bam2-backend/crmd/40, version=0.168.1)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_process_request: Completed cib_modify operation for section crm_config: OK (rc=0, origin=bam2-backend/crmd/42,
version=0.168.1)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_file_write_with_digest: Wrote version 0.168.0 of the CIB to disk (digest: 7d2e14eee5a440883e9659536e70260f)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:53 [3826] bam1-omc cib: info: cib_file_write_with_digest: Reading cluster configuration file /var/lib/pacemaker/cib/cib.BuFPbI (digest:
/var/lib/pacemaker/cib/cib.jHzYAc)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3831] bam1-omc crmd: info: parse_notifications: No optional alerts section in cib</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3831] bam1-omc crmd: info: abort_transition_graph: Transition aborted by deletion of lrm_resource[@id='mvno-100']: Resource state
removal | cib=0.168.1 source=abort_unless_down:345 path=/cib/status/node_state[@id='bam2-backend']/lrm[@id='bam2-backend']/lrm_resources/lrm_resource[@id='mvno-100'] complete=true</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3830] bam1-omc pengine: notice: unpack_config: On loss of CCM Quorum: Ignore</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3830] bam1-omc pengine: info: determine_online_status_fencing: Node bam2-backend is active</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3830] bam1-omc pengine: info: determine_online_status: Node bam2-backend is online</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3830] bam1-omc pengine: info: determine_online_status_fencing: Node bam1-backend is active</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3830] bam1-omc pengine: info: determine_online_status: Node bam1-backend is online</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3830] bam1-omc pengine: info: determine_op_status: Operation monitor found resource IPaddrAdminToolMvno100 active on bam1-backend</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3830] bam1-omc pengine: info: clone_print: Master/Slave Set: mvno-100-master [mvno-100]</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3830] bam1-omc pengine: info: short_print: Stopped: [ bam1-backend bam2-backend ]</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3830] bam1-omc pengine: info: native_print: IPaddrAdminToolMvno100 (ocf::heartbeat:IPaddr2): Started bam1-backend</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3830] bam1-omc pengine: info: native_print: IPMI_fence_bam1 (stonith:fence_ipmilan): Started bam2-backend</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3830] bam1-omc pengine: info: native_print: IPMI_fence_bam2 (stonith:fence_ipmilan): Started bam1-backend</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3830] bam1-omc pengine: info: master_color: mvno-100-master: Promoted 0 instances of a possible 1 to master</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3830] bam1-omc pengine: info: native_color: Resource IPaddrAdminToolMvno100 cannot run anywhere</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3830] bam1-omc pengine: info: RecurringOp: Start recurring monitor (10s) for mvno-100:0 on bam1-backend</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3830] bam1-omc pengine: info: RecurringOp: Start recurring monitor (10s) for mvno-100:1 on bam2-backend</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3830] bam1-omc pengine: info: RecurringOp: Start recurring monitor (10s) for mvno-100:0 on bam1-backend</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3830] bam1-omc pengine: info: RecurringOp: Start recurring monitor (10s) for mvno-100:1 on bam2-backend</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3830] bam1-omc pengine: notice: LogActions: Start mvno-100:0 (bam1-backend)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3830] bam1-omc pengine: notice: LogActions: Start mvno-100:1 (bam2-backend)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3830] bam1-omc pengine: notice: LogActions: Stop IPaddrAdminToolMvno100 (bam1-backend)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0">I suspect the cluster “forgets” all status information about the cleaned up resource and therefore supposes it is in stopped state and has to be started.</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0">And due to the order constraint the dependent IP address has to be stopped as long as the cluster does not see the first resource in state started.</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0">Shouldn’t there be a monitor operation to determine the actual state before performing any actions based on unconfirmed assumptions of state?</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3830] bam1-omc pengine: info: LogActions: Leave IPMI_fence_bam1 (Started bam2-backend)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3830] bam1-omc pengine: info: LogActions: Leave IPMI_fence_bam2 (Started bam1-backend)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3830] bam1-omc pengine: notice: process_pe_message: Calculated transition 1379, saving inputs in /var/lib/pacemaker/pengine/pe-input-31.bz2</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3831] bam1-omc crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE
origin=handle_response</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3831] bam1-omc crmd: info: do_te_invoke: Processing graph 1379 (ref=pe_calc-dc-1505285034-1562) derived from /var/lib/pacemaker/pengine/pe-input-31.bz2</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3831] bam1-omc crmd: notice: te_rsc_command: Initiating monitor operation mvno-100:0_monitor_0 locally on bam1-backend | action 5</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3828] bam1-omc lrmd: info: process_lrmd_get_rsc_info: Resource 'mvno-100' not found (3 active resources)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3828] bam1-omc lrmd: info: process_lrmd_get_rsc_info: Resource 'mvno-100:0' not found (3 active resources)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3828] bam1-omc lrmd: info: process_lrmd_rsc_register: Added 'mvno-100' to the rsc list (4 active resources)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3831] bam1-omc crmd: info: do_lrm_rsc_op: Performing key=5:1379:7:e2c19428-0707-4677-a89a-ff1c19ebe57c op=mvno-100_monitor_0</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3831] bam1-omc crmd: notice: te_rsc_command: Initiating monitor operation mvno-100:1_monitor_0 on bam2-backend | action 6</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3831] bam1-omc crmd: notice: te_rsc_command: Initiating stop operation IPaddrAdminToolMvno100_stop_0 locally on bam1-backend | action
35</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3828] bam1-omc lrmd: info: cancel_recurring_action: Cancelling ocf operation IPaddrAdminToolMvno100_monitor_10000</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3831] bam1-omc crmd: info: do_lrm_rsc_op: Performing key=35:1379:0:e2c19428-0707-4677-a89a-ff1c19ebe57c op=IPaddrAdminToolMvno100_stop_0</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3828] bam1-omc lrmd: info: log_execute: executing - rsc:IPaddrAdminToolMvno100 action:stop call_id:104</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3831] bam1-omc crmd: info: process_lrm_event: Result of monitor operation for IPaddrAdminToolMvno100 on bam1-backend: Cancelled
| call=90 key=IPaddrAdminToolMvno100_monitor_10000 confirmed=true</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">sba(mvno-100)[56850]: 2017/09/13_06:43:54 INFO: mvno-100 monitor started</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">sba(mvno-100)[56850]: 2017/09/13_06:43:54 INFO: Check status</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">IPaddr2(IPaddrAdminToolMvno100)[56851]: 2017/09/13_06:43:54 INFO: IP status = ok, IP_CIP=</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3828] bam1-omc lrmd: info: log_finished: finished - rsc:IPaddrAdminToolMvno100 action:stop call_id:104 pid:56851 exit-code:0 exec-time:72ms
queue-time:0ms</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3831] bam1-omc crmd: notice: process_lrm_event: Result of stop operation for IPaddrAdminToolMvno100 on bam1-backend: 0 (ok) | call=104
key=IPaddrAdminToolMvno100_stop_0 confirmed=true cib-update=1494</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3826] bam1-omc cib: info: cib_perform_op: Diff: --- 0.168.1 2</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3826] bam1-omc cib: info: cib_perform_op: Diff: +++ 0.168.2 (null)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3826] bam1-omc cib: info: cib_perform_op: + /cib: @num_updates=2</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3826] bam1-omc cib: info: cib_perform_op: + /cib/status/node_state[@id='bam1-backend']/lrm[@id='bam1-backend']/lrm_resources/lrm_resource[@id='IPaddrAdminToolMvno100']/lrm_rsc_op[@id='IPaddrAdminToolMvno100_last_0']: @operation_key=IPaddrAdminToolMvno100_stop_0,
@operation=stop, @transition-key=35:1379:0:e2c19428-0707-4677-a89a-ff1c19ebe57c, @transition-magic=0:0;35:1379:0:e2c19428-0707-4677-a89a-ff1c19ebe57c, @call-id=104, @last-run=1505285034, @last-rc-change=1505285034, @ex</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3826] bam1-omc cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/1494,
version=0.168.2)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3831] bam1-omc crmd: info: match_graph_event: Action IPaddrAdminToolMvno100_stop_0 (35) confirmed on bam1-backend (rc=0)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">sba(mvno-100)[56850]: 2017/09/13_06:43:54 INFO: mvno-100 monitor returned 8</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3831] bam1-omc crmd: notice: process_lrm_event: Result of probe operation for mvno-100 on bam1-backend: 8 (master) | call=102 key=mvno-100_monitor_0
confirmed=true cib-update=1495</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3826] bam1-omc cib: info: cib_perform_op: Diff: --- 0.168.2 2</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3826] bam1-omc cib: info: cib_perform_op: Diff: +++ 0.168.3 (null)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3826] bam1-omc cib: info: cib_perform_op: + /cib: @num_updates=3</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3826] bam1-omc cib: info: cib_perform_op: ++ /cib/status/node_state[@id='bam1-backend']/lrm[@id='bam1-backend']/lrm_resources: <lrm_resource
id="mvno-100" type="sba" class="ocf" provider="sonorys"/></span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3826] bam1-omc cib: info: cib_perform_op: ++ <lrm_rsc_op
id="mvno-100_last_failure_0" operation_key="mvno-100_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.11" transition-key="5:1379:7:e2c19428-0707-4677-a89a-ff1c19ebe57c" transition-magic="0:8;5:1379:7:e2c19428-0707-4677-a89a-ff1c19ebe57c"
on_node="bam1-backend" call-id="102" rc-code="8" op-status="0"</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3826] bam1-omc cib: info: cib_perform_op: ++ <lrm_rsc_op
id="mvno-100_last_0" operation_key="mvno-100_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.11" transition-key="5:1379:7:e2c19428-0707-4677-a89a-ff1c19ebe57c" transition-magic="0:8;5:1379:7:e2c19428-0707-4677-a89a-ff1c19ebe57c"
on_node="bam1-backend" call-id="102" rc-code="8" op-status="0" interva</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3826] bam1-omc cib: info: cib_perform_op: ++ </lrm_resource></span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3826] bam1-omc cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/1495,
version=0.168.3)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3831] bam1-omc crmd: warning: status_from_rc: Action 5 (mvno-100:0_monitor_0) on bam1-backend failed (target: 7 vs. rc: 8): Error</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3831] bam1-omc crmd: notice: abort_transition_graph: Transition aborted by operation mvno-100_monitor_0 'create' on bam1-backend: Event
failed | magic=0:8;5:1379:7:e2c19428-0707-4677-a89a-ff1c19ebe57c cib=0.168.3 source=match_graph_event:310 complete=false</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3831] bam1-omc crmd: info: match_graph_event: Action mvno-100_monitor_0 (5) confirmed on bam1-backend (rc=8)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3831] bam1-omc crmd: info: process_graph_event: Detected action (1379.5) mvno-100_monitor_0.102=master: failed</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3831] bam1-omc crmd: warning: status_from_rc: Action 5 (mvno-100:0_monitor_0) on bam1-backend failed (target: 7 vs. rc: 8): Error</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3831] bam1-omc crmd: info: abort_transition_graph: Transition aborted by operation mvno-100_monitor_0 'create' on bam1-backend: Event
failed | magic=0:8;5:1379:7:e2c19428-0707-4677-a89a-ff1c19ebe57c cib=0.168.3 source=match_graph_event:310 complete=false</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3831] bam1-omc crmd: info: match_graph_event: Action mvno-100_monitor_0 (5) confirmed on bam1-backend (rc=8)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:54 [3831] bam1-omc crmd: info: process_graph_event: Detected action (1379.5) mvno-100_monitor_0.102=master: failed</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: Diff: --- 0.168.3 2</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: Diff: +++ 0.168.4 (null)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: + /cib: @num_updates=4</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: ++ /cib/status/node_state[@id='bam2-backend']/lrm[@id='bam2-backend']/lrm_resources: <lrm_resource
id="mvno-100" type="sba" class="ocf" provider="sonorys"/></span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: ++ <lrm_rsc_op
id="mvno-100_last_failure_0" operation_key="mvno-100_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.11" transition-key="6:1379:7:e2c19428-0707-4677-a89a-ff1c19ebe57c" transition-magic="0:0;6:1379:7:e2c19428-0707-4677-a89a-ff1c19ebe57c"
on_node="bam2-backend" call-id="82" rc-code="0" op-status="0"</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: ++ <lrm_rsc_op
id="mvno-100_last_0" operation_key="mvno-100_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.11" transition-key="6:1379:7:e2c19428-0707-4677-a89a-ff1c19ebe57c" transition-magic="0:0;6:1379:7:e2c19428-0707-4677-a89a-ff1c19ebe57c"
on_node="bam2-backend" call-id="82" rc-code="0" op-status="0" interval</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: ++ </lrm_resource></span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bam2-backend/crmd/44,
version=0.168.4)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: warning: status_from_rc: Action 6 (mvno-100:1_monitor_0) on bam2-backend failed (target: 7 vs. rc: 0): Error</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: abort_transition_graph: Transition aborted by operation mvno-100_monitor_0 'create' on bam2-backend: Event
failed | magic=0:0;6:1379:7:e2c19428-0707-4677-a89a-ff1c19ebe57c cib=0.168.4 source=match_graph_event:310 complete=false</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: match_graph_event: Action mvno-100_monitor_0 (6) confirmed on bam2-backend (rc=0)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: process_graph_event: Detected action (1379.6) mvno-100_monitor_0.82=ok: failed</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: warning: status_from_rc: Action 6 (mvno-100:1_monitor_0) on bam2-backend failed (target: 7 vs. rc: 0): Error</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: abort_transition_graph: Transition aborted by operation mvno-100_monitor_0 'create' on bam2-backend: Event
failed | magic=0:0;6:1379:7:e2c19428-0707-4677-a89a-ff1c19ebe57c cib=0.168.4 source=match_graph_event:310 complete=false</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: match_graph_event: Action mvno-100_monitor_0 (6) confirmed on bam2-backend (rc=0)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: process_graph_event: Detected action (1379.6) mvno-100_monitor_0.82=ok: failed</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: notice: run_graph: Transition 1379 (Complete=6, Pending=0, Fired=0, Skipped=0, Incomplete=10, Source=/var/lib/pacemaker/pengine/pe-input-31.bz2):
Complete</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_FSA_INTERNAL
origin=notify_crmd</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: notice: unpack_config: On loss of CCM Quorum: Ignore</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: determine_online_status_fencing: Node bam2-backend is active</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: determine_online_status: Node bam2-backend is online</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: determine_online_status_fencing: Node bam1-backend is active</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: determine_online_status: Node bam1-backend is online</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: determine_op_status: Operation monitor found resource mvno-100:0 active on bam2-backend</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: determine_op_status: Operation monitor found resource mvno-100:0 active on bam2-backend</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: determine_op_status: Operation monitor found resource IPaddrAdminToolMvno100 active on bam1-backend</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: determine_op_status: Operation monitor found resource mvno-100:1 active in master mode on bam1-backend</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: determine_op_status: Operation monitor found resource mvno-100:1 active in master mode on bam1-backend</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: clone_print: Master/Slave Set: mvno-100-master [mvno-100]</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: short_print: Masters: [ bam1-backend ]</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: short_print: Slaves: [ bam2-backend ]</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: native_print: IPaddrAdminToolMvno100 (ocf::heartbeat:IPaddr2): Stopped</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: native_print: IPMI_fence_bam1 (stonith:fence_ipmilan): Started bam2-backend</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: native_print: IPMI_fence_bam2 (stonith:fence_ipmilan): Started bam1-backend</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: master_color: Promoting mvno-100:1 (Master bam1-backend)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: master_color: mvno-100-master: Promoted 1 instances of a possible 1 to master</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: RecurringOp: Start recurring monitor (10s) for mvno-100:0 on bam2-backend</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: RecurringOp: Start recurring monitor (9s) for mvno-100:1 on bam1-backend</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: RecurringOp: Start recurring monitor (10s) for mvno-100:0 on bam2-backend</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: RecurringOp: Start recurring monitor (9s) for mvno-100:1 on bam1-backend</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: RecurringOp: Start recurring monitor (10s) for IPaddrAdminToolMvno100 on bam1-backend</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: LogActions: Leave mvno-100:0 (Slave bam2-backend)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: LogActions: Leave mvno-100:1 (Master bam1-backend)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: notice: LogActions: Start IPaddrAdminToolMvno100 (bam1-backend)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: LogActions: Leave IPMI_fence_bam1 (Started bam2-backend)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: info: LogActions: Leave IPMI_fence_bam2 (Started bam1-backend)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3830] bam1-omc pengine: notice: process_pe_message: Calculated transition 1380, saving inputs in /var/lib/pacemaker/pengine/pe-input-32.bz2</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE
origin=handle_response</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: do_te_invoke: Processing graph 1380 (ref=pe_calc-dc-1505285035-1566) derived from /var/lib/pacemaker/pengine/pe-input-32.bz2</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: notice: te_rsc_command: Initiating start operation IPaddrAdminToolMvno100_start_0 locally on bam1-backend | action
36</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: do_lrm_rsc_op: Performing key=36:1380:0:e2c19428-0707-4677-a89a-ff1c19ebe57c op=IPaddrAdminToolMvno100_start_0</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3828] bam1-omc lrmd: info: log_execute: executing - rsc:IPaddrAdminToolMvno100 action:start call_id:105</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: notice: te_rsc_command: Initiating notify operation mvno-100_pre_notify_promote_0 on bam2-backend | action 52</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: notice: te_rsc_command: Initiating notify operation mvno-100_pre_notify_promote_0 locally on bam1-backend | action
54</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: do_lrm_rsc_op: Performing key=54:1380:0:e2c19428-0707-4677-a89a-ff1c19ebe57c op=mvno-100_notify_0</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3828] bam1-omc lrmd: info: log_execute: executing - rsc:mvno-100 action:notify call_id:106</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">sba(mvno-100)[56964]: 2017/09/13_06:43:55 INFO: mvno-100 notify started</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3828] bam1-omc lrmd: info: log_finished: finished - rsc:mvno-100 action:notify call_id:106 pid:56964 exit-code:3 exec-time:21ms
queue-time:0ms</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: match_graph_event: Action mvno-100_notify_0 (54) confirmed on bam1-backend (rc=0)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: notice: process_lrm_event: Result of notify operation for mvno-100 on bam1-backend: 0 (ok) | call=106 key=mvno-100_notify_0
confirmed=true cib-update=0</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: match_graph_event: Action mvno-100_notify_0 (52) confirmed on bam2-backend (rc=0)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">IPaddr2(IPaddrAdminToolMvno100)[56963]: 2017/09/13_06:43:55 INFO: Adding inet address xxx.xxx.xxx.xxx/yy with broadcast address zzz.zzz.zzz.zzz to device bond2</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">IPaddr2(IPaddrAdminToolMvno100)[56963]: 2017/09/13_06:43:55 INFO: Bringing device bond2 up</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">IPaddr2(IPaddrAdminToolMvno100)[56963]: 2017/09/13_06:43:55 INFO: /usr/libexec/heartbeat/send_arp -i 200 -r 5 -p /var/run/resource-agents/send_arp-xxx.xxx.xxx.xxx
bond2 xxx.xxx.xxx.xxx auto not_used not_used</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3828] bam1-omc lrmd: info: log_finished: finished - rsc:IPaddrAdminToolMvno100 action:start call_id:105 pid:56963 exit-code:0 exec-time:91ms
queue-time:0ms</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: action_synced_wait: Managed IPaddr2_meta-data_0 process 57044 exited with rc=0</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: notice: process_lrm_event: Result of start operation for IPaddrAdminToolMvno100 on bam1-backend: 0 (ok) |
call=105 key=IPaddrAdminToolMvno100_start_0 confirmed=true cib-update=1497</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: Diff: --- 0.168.4 2</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: Diff: +++ 0.168.5 (null)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: + /cib: @num_updates=5</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: + /cib/status/node_state[@id='bam1-backend']/lrm[@id='bam1-backend']/lrm_resources/lrm_resource[@id='IPaddrAdminToolMvno100']/lrm_rsc_op[@id='IPaddrAdminToolMvno100_last_0']: @operation_key=IPaddrAdminToolMvno100_start_0,
@operation=start, @transition-key=36:1380:0:e2c19428-0707-4677-a89a-ff1c19ebe57c, @transition-magic=0:0;36:1380:0:e2c19428-0707-4677-a89a-ff1c19ebe57c, @call-id=105, @last-run=1505285035, @last-rc-change=1505285035, @</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/1497,
version=0.168.5)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: match_graph_event: Action IPaddrAdminToolMvno100_start_0 (36) confirmed on bam1-backend (rc=0)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: notice: te_rsc_command: Initiating monitor operation IPaddrAdminToolMvno100_monitor_10000 locally on bam1-backend
| action 37</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: do_lrm_rsc_op: Performing key=37:1380:0:e2c19428-0707-4677-a89a-ff1c19ebe57c op=IPaddrAdminToolMvno100_monitor_10000</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: notice: te_rsc_command: Initiating promote operation mvno-100_promote_0 locally on bam1-backend | action 10</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: do_lrm_rsc_op: Performing key=10:1380:0:e2c19428-0707-4677-a89a-ff1c19ebe57c op=mvno-100_promote_0</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3828] bam1-omc lrmd: info: log_execute: executing - rsc:mvno-100 action:promote call_id:108</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">sba(mvno-100)[57049]: 2017/09/13_06:43:55 INFO: mvno-100 promote started</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">sba(mvno-100)[57049]: 2017/09/13_06:43:55 INFO: Check status</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: process_lrm_event: Result of monitor operation for IPaddrAdminToolMvno100 on bam1-backend: 0 (ok)
| call=107 key=IPaddrAdminToolMvno100_monitor_10000 confirmed=false cib-update=1498</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: Diff: --- 0.168.5 2</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: Diff: +++ 0.168.6 (null)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: + /cib: @num_updates=6</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: + /cib/status/node_state[@id='bam1-backend']/lrm[@id='bam1-backend']/lrm_resources/lrm_resource[@id='IPaddrAdminToolMvno100']/lrm_rsc_op[@id='IPaddrAdminToolMvno100_monitor_10000']: @transition-key=37:1380:0:e2c19428-0707-4677-a89a-ff1c19ebe57c,
@transition-magic=0:0;37:1380:0:e2c19428-0707-4677-a89a-ff1c19ebe57c, @call-id=107, @last-rc-change=1505285035, @exec-time=65</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/1498,
version=0.168.6)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: match_graph_event: Action IPaddrAdminToolMvno100_monitor_10000 (37) confirmed on bam1-backend (rc=0)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">sba(mvno-100)[57049]: 2017/09/13_06:43:55 INFO: Resource is already running as Master</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">sba(mvno-100)[57049]: 2017/09/13_06:43:55 INFO: mvno-100 promote returned 0</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3828] bam1-omc lrmd: info: log_finished: finished - rsc:mvno-100 action:promote call_id:108 pid:57049 exit-code:0 exec-time:287ms
queue-time:0ms</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: notice: process_lrm_event: Result of promote operation for mvno-100 on bam1-backend: 0 (ok) | call=108 key=mvno-100_promote_0
confirmed=true cib-update=1499</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: Diff: --- 0.168.6 2</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: Diff: +++ 0.168.7 (null)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: + /cib: @num_updates=7</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: + /cib/status/node_state[@id='bam1-backend']/lrm[@id='bam1-backend']/lrm_resources/lrm_resource[@id='mvno-100']/lrm_rsc_op[@id='mvno-100_last_0']: @operation_key=mvno-100_promote_0,
@operation=promote, @transition-key=10:1380:0:e2c19428-0707-4677-a89a-ff1c19ebe57c, @transition-magic=0:0;10:1380:0:e2c19428-0707-4677-a89a-ff1c19ebe57c, @call-id=108, @rc-code=0, @last-run=1505285035, @last-rc-change=1505285035, @exec-time=287</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/1499,
version=0.168.7)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: match_graph_event: Action mvno-100_promote_0 (10) confirmed on bam1-backend (rc=0)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: notice: te_rsc_command: Initiating notify operation mvno-100_post_notify_promote_0 on bam2-backend | action 53</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: notice: te_rsc_command: Initiating notify operation mvno-100_post_notify_promote_0 locally on bam1-backend | action
55</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: do_lrm_rsc_op: Performing key=55:1380:0:e2c19428-0707-4677-a89a-ff1c19ebe57c op=mvno-100_notify_0</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3828] bam1-omc lrmd: info: log_execute: executing - rsc:mvno-100 action:notify call_id:109</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">sba(mvno-100)[57157]: 2017/09/13_06:43:55 INFO: mvno-100 notify started</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: match_graph_event: Action mvno-100_notify_0 (53) confirmed on bam2-backend (rc=0)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3828] bam1-omc lrmd: info: log_finished: finished - rsc:mvno-100 action:notify call_id:109 pid:57157 exit-code:3 exec-time:25ms
queue-time:0ms</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: match_graph_event: Action mvno-100_notify_0 (55) confirmed on bam1-backend (rc=0)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: notice: process_lrm_event: Result of notify operation for mvno-100 on bam1-backend: 0 (ok) | call=109 key=mvno-100_notify_0
confirmed=true cib-update=0</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: notice: te_rsc_command: Initiating monitor operation mvno-100_monitor_10000 on bam2-backend | action 6</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: notice: te_rsc_command: Initiating monitor operation mvno-100_monitor_9000 locally on bam1-backend | action 11</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: do_lrm_rsc_op: Performing key=11:1380:8:e2c19428-0707-4677-a89a-ff1c19ebe57c op=mvno-100_monitor_9000</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">sba(mvno-100)[57166]: 2017/09/13_06:43:55 INFO: mvno-100 monitor started</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">sba(mvno-100)[57166]: 2017/09/13_06:43:55 INFO: Check status</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: Diff: --- 0.168.7 2</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: Diff: +++ 0.168.8 (null)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: + /cib: @num_updates=8</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: ++ /cib/status/node_state[@id='bam2-backend']/lrm[@id='bam2-backend']/lrm_resources/lrm_resource[@id='mvno-100']: <lrm_rsc_op
id="mvno-100_monitor_10000" operation_key="mvno-100_monitor_10000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.11" transition-key="6:1380:0:e2c19428-0707-4677-a89a-ff1c19ebe57c" transition-magic="0:0;6:1380:0:e2c19428-0707-4677-a89a-ff1c19ebe57c"
on_node="bam2-backend" call-id="</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bam2-backend/crmd/45,
version=0.168.8)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: match_graph_event: Action mvno-100_monitor_10000 (6) confirmed on bam2-backend (rc=0)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">sba(mvno-100)[57166]: 2017/09/13_06:43:55 INFO: mvno-100 monitor returned 8</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: process_lrm_event: Result of monitor operation for mvno-100 on bam1-backend: 8 (master) | call=110
key=mvno-100_monitor_9000 confirmed=false cib-update=1500</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: Diff: --- 0.168.8 2</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: Diff: +++ 0.168.9 (null)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: + /cib: @num_updates=9</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_perform_op: ++ /cib/status/node_state[@id='bam1-backend']/lrm[@id='bam1-backend']/lrm_resources/lrm_resource[@id='mvno-100']: <lrm_rsc_op
id="mvno-100_monitor_9000" operation_key="mvno-100_monitor_9000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.11" transition-key="11:1380:8:e2c19428-0707-4677-a89a-ff1c19ebe57c" transition-magic="0:8;11:1380:8:e2c19428-0707-4677-a89a-ff1c19ebe57c"
on_node="bam1-backend" call-id="</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3826] bam1-omc cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/1500,
version=0.168.9)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: match_graph_event: Action mvno-100_monitor_9000 (11) confirmed on bam1-backend (rc=8)</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: notice: run_graph: Transition 1380 (Complete=15, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-32.bz2):
Complete</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: info: do_log: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Courier
New",serif">Sep 13 06:43:55 [3831] bam1-omc crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL
origin=notify_crmd</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0"> </span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0">How can we avoid this interruption of service on cleanup?</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0"> </span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0">Kind regards</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0">Andreas Cart</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0"> </span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<p class="MsoNormal"><br>
<br>
<br>
<o:p></o:p></p>
<pre>_______________________________________________<o:p></o:p></pre>
<pre>Users mailing list: <a href="mailto:Users@clusterlabs.org">Users@clusterlabs.org</a><o:p></o:p></pre>
<pre><a href="http://lists.clusterlabs.org/mailman/listinfo/users">http://lists.clusterlabs.org/mailman/listinfo/users</a><o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>Project Home: <a href="http://www.clusterlabs.org">http://www.clusterlabs.org</a><o:p></o:p></pre>
<pre>Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><o:p></o:p></pre>
<pre>Bugs: <a href="http://bugs.clusterlabs.org">http://bugs.clusterlabs.org</a><o:p></o:p></pre>
</blockquote>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>