<div dir="ltr">Hi, <div><br></div><div>I have updated the known_hosts:</div><div><br></div><div>Now, I get the following error:</div><div><br></div><div><div><font face="monospace, monospace">Sep 02 01:03:41 [1535] vdicnode01        cib:     info: cib_perform_op: +  /cib/status/node_state[@id=&#39;1&#39;]/lrm[@id=&#39;1&#39;]/lrm_resources/lrm_resource[@id=&#39;vm-vdicdb01&#39;]/lrm_rsc_op[@id=&#39;vm-vdicdb01_last_0&#39;]:  @operation_key=vm-vdicdb01_migrate_to_0, @operation=migrate_to, @crm-debug-origin=cib_action_update, @transition-key=6:27:0:a7fef266-46c3-429e-ab00-c1a0aab24da5, @transition-magic=-1:193;6:27:0:a7fef266-46c3-429e-ab00-c1a0aab24da5, @call-id=-1, @rc-code=193, @op-status=-1, @last-run=1504307021, @last-rc-c</font></div><div><font face="monospace, monospace">Sep 02 01:03:41 [1535] vdicnode01        cib:     info: cib_process_request:    Completed cib_modify operation for section status: OK (rc=0, origin=vdicnode01/crmd/77, version=0.169.1)</font></div><div><font face="monospace, monospace">VirtualDomain(vm-vdicdb01)[13085]:      2017/09/02_01:03:41 INFO: vdicdb01: Starting live migration to vdicnode02 (using: virsh --connect=qemu:///system --quiet migrate --live  vdicdb01 qemu+ssh://vdicnode02/system ).</font></div><div><font face="monospace, monospace">VirtualDomain(vm-vdicdb01)[13085]:      2017/09/02_01:03:41 ERROR: vdicdb01: live migration to vdicnode02 failed: 1</font></div><div><font face="monospace, monospace"> ]p 02 01:03:41 [1537] vdicnode01       lrmd:   notice: operation_finished:     vm-vdicdb01_migrate_to_0:13085:stderr [ error: Cannot recv data: Permission denied, please try again.</font></div><div><font face="monospace, monospace"> ]p 02 01:03:41 [1537] vdicnode01       lrmd:   notice: operation_finished:     vm-vdicdb01_migrate_to_0:13085:stderr [ Permission denied, please try again.</font></div><div><font face="monospace, monospace">Sep 02 01:03:41 [1537] vdicnode01       lrmd:   notice: operation_finished:     vm-vdicdb01_migrate_to_0:13085:stderr [ Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).: Connection reset by peer ]</font></div><div><font face="monospace, monospace">Sep 02 01:03:41 [1537] vdicnode01       lrmd:   notice: operation_finished:     vm-vdicdb01_migrate_to_0:13085:stderr [ ocf-exit-reason:vdicdb01: live migration to vdicnode02 failed: 1 ]</font></div><div><font face="monospace, monospace">Sep 02 01:03:41 [1537] vdicnode01       lrmd:     info: log_finished:   finished - rsc:vm-vdicdb01 action:migrate_to call_id:16 pid:13085 exit-code:1 exec-time:119ms queue-time:0ms</font></div><div><font face="monospace, monospace">Sep 02 01:03:41 [1540] vdicnode01       crmd:   notice: process_lrm_event:      Result of migrate_to operation for vm-vdicdb01 on vdicnode01: 1 (unknown error) | call=16 key=vm-vdicdb01_migrate_to_0 confirmed=true cib-update=78</font></div><div><font face="monospace, monospace">Sep 02 01:03:41 [1540] vdicnode01       crmd:   notice: process_lrm_event:      vdicnode01-vm-vdicdb01_migrate_to_0:16 [ error: Cannot recv data: Permission denied, please try again.\r\nPermission denied, please try again.\r\nPermission denied (publickey,gssapi-keyex,gssapi-with-mic,password).: Connection reset by peer\nocf-exit-reason:vdicdb01: live migration to vdicnode02 failed: 1\n ]</font></div><div><font face="monospace, monospace">Sep 02 01:03:41 [1535] vdicnode01        cib:     info: cib_process_request:    Forwarding cib_modify operation for section status to all (origin=local/crmd/78)</font></div><div><font face="monospace, monospace">Sep 02 01:03:41 [1535] vdicnode01        cib:     info: cib_perform_op: Diff: --- 0.169.1 2</font></div><div><font face="monospace, monospace">Sep 02 01:03:41 [1535] vdicnode01        cib:     info: cib_perform_op: Diff: +++ 0.169.2 (null)</font></div><div><font face="monospace, monospace">Sep 02 01:03:41 [1535] vdicnode01        cib:     info: cib_perform_op: +  /cib:  @num_updates=2</font></div><div><font face="monospace, monospace">Sep 02 01:03:41 [1535] vdicnode01        cib:     info: cib_perform_op: +  /cib/status/node_state[@id=&#39;1&#39;]/lrm[@id=&#39;1&#39;]/lrm_resources/lrm_resource[@id=&#39;vm-vdicdb01&#39;]/lrm_rsc_op[@id=&#39;vm-vdicdb01_last_0&#39;]:  @crm-debug-origin=do_update_resource, @transition-magic=0:1;6:27:0:a7fef266-46c3-429e-ab00-c1a0aab24da5, @call-id=16, @rc-code=1, @op-status=0, @exec-time=119, @exit-reason=vdicdb01: live migration to vdicnode02 failed: 1</font></div><div><font face="monospace, monospace">Sep 02 01:03:4</font></div></div><div><br></div><div>as root &lt;-- system prompts the password<br></div><div><div><font face="monospace, monospace">[root@vdicnode01 .ssh]# virsh --connect=qemu:///system --quiet migrate --live  vdicdb01 qemu+ssh://vdicnode02/system</font></div><div><font face="monospace, monospace">root@vdicnode02&#39;s password:</font></div></div><div><br></div><div>as oneadmin (the user that executes the qemu-kvm) &lt;-- does not prompt the password</div><div><font face="monospace, monospace">virsh --connect=qemu:///system --quiet migrate --live  vdicdb01 qemu+ssh://vdicnode02/system<br></font></div><div><br></div><div>Must I configure passwordless connection with root in order to make live migration work?<br></div><div><br></div><div>Or maybe is there any way to instruct pacemaker to use my oneadmin user for migrations inestad of root?</div><div><br></div><div>Thanks a lot:<br></div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">2017-09-01 23:14 GMT+02:00 Ken Gaillot <span dir="ltr">&lt;<a href="mailto:kgaillot@redhat.com" target="_blank">kgaillot@redhat.com</a>&gt;</span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class="">On Fri, 2017-09-01 at 00:26 +0200, Oscar Segarra wrote:<br>
&gt; Hi,<br>
&gt;<br>
&gt;<br>
</span><span class="">&gt; Yes, it is....<br>
&gt;<br>
&gt;<br>
&gt; The qemu-kvm process is executed by the oneadmin user.<br>
&gt;<br>
&gt;<br>
&gt; When I cluster tries the live migration, what users do play?<br>
&gt;<br>
&gt;<br>
&gt; Oneadmin<br>
&gt; Root<br>
&gt; Hacluster<br>
&gt;<br>
&gt;<br>
&gt; I have just configured pasworless ssh connection with oneadmin.<br>
&gt;<br>
&gt;<br>
&gt; Do I need to configure any other passwordless ssh connection with any<br>
&gt; other user?<br>
&gt;<br>
&gt;<br>
&gt; What user executes the virsh migrate - - live?<br>
<br>
</span>The cluster executes resource actions as root.<br>
<span class=""><br>
&gt; Is there any way to check ssk keys?<br>
<br>
</span>I&#39;d just login once to the host as root from the cluster nodes, to make<br>
it sure it works, and accept the host when asked.<br>
<div class="HOEnZb"><div class="h5"><br>
&gt;<br>
&gt; Sorry for all theese questions.<br>
&gt;<br>
&gt;<br>
&gt; Thanks a lot<br>
&gt;<br>
&gt;<br>
&gt;<br>
&gt;<br>
&gt;<br>
&gt;<br>
&gt; El 1 sept. 2017 0:12, &quot;Ken Gaillot&quot; &lt;<a href="mailto:kgaillot@redhat.com">kgaillot@redhat.com</a>&gt; escribió:<br>
&gt;         On Thu, 2017-08-31 at 23:45 +0200, Oscar Segarra wrote:<br>
&gt;         &gt; Hi Ken,<br>
&gt;         &gt;<br>
&gt;         &gt;<br>
&gt;         &gt; Thanks a lot for you quick answer:<br>
&gt;         &gt;<br>
&gt;         &gt;<br>
&gt;         &gt; Regarding to selinux, it is disabled. The FW is disabled as<br>
&gt;         well.<br>
&gt;         &gt;<br>
&gt;         &gt;<br>
&gt;         &gt; [root@vdicnode01 ~]# sestatus<br>
&gt;         &gt; SELinux status:                 disabled<br>
&gt;         &gt;<br>
&gt;         &gt;<br>
&gt;         &gt; [root@vdicnode01 ~]# service firewalld status<br>
&gt;         &gt; Redirecting to /bin/systemctl status  firewalld.service<br>
&gt;         &gt; ● firewalld.service - firewalld - dynamic firewall daemon<br>
&gt;         &gt;    Loaded: loaded<br>
&gt;         (/usr/lib/systemd/system/<wbr>firewalld.service;<br>
&gt;         &gt; disabled; vendor preset: enabled)<br>
&gt;         &gt;    Active: inactive (dead)<br>
&gt;         &gt;      Docs: man:firewalld(1)<br>
&gt;         &gt;<br>
&gt;         &gt;<br>
&gt;         &gt; On migration, it performs a gracefully shutdown and a start<br>
&gt;         on the new<br>
&gt;         &gt; node.<br>
&gt;         &gt;<br>
&gt;         &gt;<br>
&gt;         &gt; I attach the logs when trying to migrate from vdicnode02 to<br>
&gt;         &gt; vdicnode01:<br>
&gt;         &gt;<br>
&gt;         &gt;<br>
&gt;         &gt; vdicnode02 corosync.log:<br>
&gt;         &gt; Aug 31 23:38:17 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: --- 0.161.2 2<br>
&gt;         &gt; Aug 31 23:38:17 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: +++ 0.162.0 (null)<br>
&gt;         &gt; Aug 31 23:38:17 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op:<br>
&gt;         &gt;<br>
&gt;         -- /cib/configuration/<wbr>constraints/rsc_location[@id=&#39;<wbr>location-vm-vdicdb01-<wbr>vdicnode01--INFINITY&#39;]<br>
&gt;         &gt; Aug 31 23:38:17 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: +  /cib:  @epoch=162, @num_updates=0<br>
&gt;         &gt; Aug 31 23:38:17 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_process_request:    Completed cib_replace operation for<br>
&gt;         section<br>
&gt;         &gt; configuration: OK (rc=0, origin=vdicnode01/cibadmin/2,<br>
&gt;         &gt; version=0.162.0)<br>
&gt;         &gt; Aug 31 23:38:17 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_file_backup:        Archived previous version<br>
&gt;         &gt; as /var/lib/pacemaker/cib/cib-65.<wbr>raw<br>
&gt;         &gt; Aug 31 23:38:17 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_file_write_with_digest:     Wrote version 0.162.0 of the<br>
&gt;         CIB to<br>
&gt;         &gt; disk (digest: 1f87611b60cd7c48b95b6b788b47f6<wbr>5f)<br>
&gt;         &gt; Aug 31 23:38:17 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_file_write_with_digest:     Reading cluster<br>
&gt;         configuration<br>
&gt;         &gt; file /var/lib/pacemaker/cib/cib.<wbr>jt2KPw<br>
&gt;         &gt; (digest: /var/lib/pacemaker/cib/cib.<wbr>Kwqfpl)<br>
&gt;         &gt; Aug 31 23:38:22 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_process_ping:       Reporting our current digest to<br>
&gt;         vdicnode01:<br>
&gt;         &gt; dace3a23264934279d439420d5a716<wbr>cc for 0.162.0 (0x7f96bb26c5c0<br>
&gt;         0)<br>
&gt;         &gt; Aug 31 23:38:27 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: --- 0.162.0 2<br>
&gt;         &gt; Aug 31 23:38:27 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: +++ 0.163.0 (null)<br>
&gt;         &gt; Aug 31 23:38:27 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: +  /cib:  @epoch=163<br>
&gt;         &gt; Aug 31 23:38:27 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: ++ /cib/configuration/<wbr>constraints:<br>
&gt;         &lt;rsc_location<br>
&gt;         &gt; id=&quot;location-vm-vdicdb01-<wbr>vdicnode02--INFINITY&quot;<br>
&gt;         node=&quot;vdicnode02&quot;<br>
&gt;         &gt; rsc=&quot;vm-vdicdb01&quot; score=&quot;-INFINITY&quot;/&gt;<br>
&gt;         &gt; Aug 31 23:38:27 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_process_request:    Completed cib_replace operation for<br>
&gt;         section<br>
&gt;         &gt; configuration: OK (rc=0, origin=vdicnode01/cibadmin/2,<br>
&gt;         &gt; version=0.163.0)<br>
&gt;         &gt; Aug 31 23:38:27 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_file_backup:        Archived previous version<br>
&gt;         &gt; as /var/lib/pacemaker/cib/cib-66.<wbr>raw<br>
&gt;         &gt; Aug 31 23:38:27 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_file_write_with_digest:     Wrote version 0.163.0 of the<br>
&gt;         CIB to<br>
&gt;         &gt; disk (digest: 47a548b36746de9275d66cc6aeb0fd<wbr>c4)<br>
&gt;         &gt; Aug 31 23:38:27 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_file_write_with_digest:     Reading cluster<br>
&gt;         configuration<br>
&gt;         &gt; file /var/lib/pacemaker/cib/cib.<wbr>rcgXiT<br>
&gt;         &gt; (digest: /var/lib/pacemaker/cib/cib.<wbr>7geMfi)<br>
&gt;         &gt; Aug 31 23:38:27 [1523] vdicnode02       lrmd:     info:<br>
&gt;         &gt; cancel_recurring_action:        Cancelling ocf operation<br>
&gt;         &gt; vm-vdicdb01_monitor_10000<br>
&gt;         &gt; Aug 31 23:38:27 [1526] vdicnode02       crmd:     info:<br>
&gt;         &gt; do_lrm_rsc_op:  Performing<br>
&gt;         &gt; key=6:6:0:fe1a9b0a-816c-4b97-<wbr>96cb-b90dbf71417a<br>
&gt;         &gt; op=vm-vdicdb01_migrate_to_0<br>
&gt;         &gt; Aug 31 23:38:27 [1523] vdicnode02       lrmd:     info:<br>
&gt;         log_execute:<br>
&gt;         &gt;    executing - rsc:vm-vdicdb01 action:migrate_to call_id:9<br>
&gt;         &gt; Aug 31 23:38:27 [1526] vdicnode02       crmd:     info:<br>
&gt;         &gt; process_lrm_event:      Result of monitor operation for<br>
&gt;         vm-vdicdb01 on<br>
&gt;         &gt; vdicnode02: Cancelled | call=7 key=vm-vdicdb01_monitor_10000<br>
&gt;         &gt; confirmed=true<br>
&gt;         &gt; Aug 31 23:38:27 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: --- 0.163.0 2<br>
&gt;         &gt; Aug 31 23:38:27 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: +++ 0.163.1 (null)<br>
&gt;         &gt; Aug 31 23:38:27 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: +  /cib:  @num_updates=1<br>
&gt;         &gt; Aug 31 23:38:27 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: +<br>
&gt;         &gt;  /cib/status/node_state[@id=&#39;2&#39;<wbr>]/lrm[@id=&#39;2&#39;]/lrm_resources/<wbr>lrm_resource[@id=&#39;vm-vdicdb01&#39;<wbr>]/lrm_rsc_op[@id=&#39;vm-vdicdb01_<wbr>last_0&#39;]:  @operation_key=vm-vdicdb01_<wbr>migrate_to_0, @operation=migrate_to, @crm-debug-origin=cib_action_<wbr>update, @transition-key=6:6:0:<wbr>fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a, @transition-magic=-1:193;6:6:<wbr>0:fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a, @call-id=-1, @rc-code=193, @op-status=-1, @last-run=1504215507, @last-rc-cha<br>
&gt;         &gt; Aug 31 23:38:27 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_process_request:    Completed cib_modify operation for<br>
&gt;         section<br>
&gt;         &gt; status: OK (rc=0, origin=vdicnode01/crmd/41,<br>
&gt;         version=0.163.1)<br>
&gt;         &gt; VirtualDomain(vm-vdicdb01)[<wbr>5241]:       2017/08/31_23:38:27<br>
&gt;         INFO:<br>
&gt;         &gt; vdicdb01: Starting live migration to vdicnode01 (using:<br>
&gt;         virsh<br>
&gt;         &gt; --connect=qemu:///system --quiet migrate --live  vdicdb01<br>
&gt;         qemu<br>
&gt;         &gt; +ssh://vdicnode01/system ).<br>
&gt;         &gt; VirtualDomain(vm-vdicdb01)[<wbr>5241]:       2017/08/31_23:38:27<br>
&gt;         ERROR:<br>
&gt;         &gt; vdicdb01: live migration to vdicnode01 failed: 1<br>
&gt;         &gt; Aug 31 23:38:27 [1523] vdicnode02       lrmd:   notice:<br>
&gt;         &gt; operation_finished:     vm-vdicdb01_migrate_to_0:5241:<wbr>stderr<br>
&gt;         [ error:<br>
&gt;         &gt; Cannot recv data: Host key verification failed.: Connection<br>
&gt;         reset by<br>
&gt;         &gt; peer ]<br>
&gt;<br>
&gt;<br>
&gt;         ^^^ There you go. Sounds like the ssh key isn&#39;t being<br>
&gt;         accepted. No idea<br>
&gt;         why though.<br>
&gt;<br>
&gt;<br>
&gt;<br>
&gt;         &gt; Aug 31 23:38:27 [1523] vdicnode02       lrmd:   notice:<br>
&gt;         &gt; operation_finished:     vm-vdicdb01_migrate_to_0:5241:<wbr>stderr<br>
&gt;         &gt; [ ocf-exit-reason:vdicdb01: live migration to vdicnode01<br>
&gt;         failed: 1 ]<br>
&gt;         &gt; Aug 31 23:38:27 [1523] vdicnode02       lrmd:     info:<br>
&gt;         log_finished:<br>
&gt;         &gt; finished - rsc:vm-vdicdb01 action:migrate_to call_id:9<br>
&gt;         pid:5241<br>
&gt;         &gt; exit-code:1 exec-time:78ms queue-time:0ms<br>
&gt;         &gt; Aug 31 23:38:27 [1526] vdicnode02       crmd:   notice:<br>
&gt;         &gt; process_lrm_event:      Result of migrate_to operation for<br>
&gt;         vm-vdicdb01<br>
&gt;         &gt; on vdicnode02: 1 (unknown error) | call=9<br>
&gt;         key=vm-vdicdb01_migrate_to_0<br>
&gt;         &gt; confirmed=true cib-update=14<br>
&gt;         &gt; Aug 31 23:38:27 [1526] vdicnode02       crmd:   notice:<br>
&gt;         &gt; process_lrm_event:<br>
&gt;         vdicnode02-vm-vdicdb01_<wbr>migrate_to_0:9 [ error:<br>
&gt;         &gt; Cannot recv data: Host key verification failed.: Connection<br>
&gt;         reset by<br>
&gt;         &gt; peer\nocf-exit-reason:<wbr>vdicdb01: live migration to vdicnode01<br>
&gt;         failed: 1<br>
&gt;         &gt; \n ]<br>
&gt;         &gt; Aug 31 23:38:27 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_process_request:    Forwarding cib_modify operation for<br>
&gt;         section<br>
&gt;         &gt; status to all (origin=local/crmd/14)<br>
&gt;         &gt; Aug 31 23:38:27 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: --- 0.163.1 2<br>
&gt;         &gt; Aug 31 23:38:27 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: +++ 0.163.2 (null)<br>
&gt;         &gt; Aug 31 23:38:27 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: +  /cib:  @num_updates=2<br>
&gt;         &gt; Aug 31 23:38:27 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: +<br>
&gt;         &gt;  /cib/status/node_state[@id=&#39;2&#39;<wbr>]/lrm[@id=&#39;2&#39;]/lrm_resources/<wbr>lrm_resource[@id=&#39;vm-vdicdb01&#39;<wbr>]/lrm_rsc_op[@id=&#39;vm-vdicdb01_<wbr>last_0&#39;]:  @crm-debug-origin=do_update_<wbr>resource, @transition-magic=0:1;6:6:0:<wbr>fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a, @call-id=9, @rc-code=1, @op-status=0, @exec-time=78, @exit-reason=vdicdb01: live migration to vdicnode01 failed: 1<br>
&gt;         &gt; Aug 31 23:38:27 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op:<br>
&gt;         &gt;<br>
&gt;         ++ /cib/status/node_state[@id=&#39;2&#39;<wbr>]/lrm[@id=&#39;2&#39;]/lrm_resources/<wbr>lrm_resource[@id=&#39;vm-vdicdb01&#39;<wbr>]:  &lt;lrm_rsc_op id=&quot;vm-vdicdb01_last_failure_<wbr>0&quot; operation_key=&quot;vm-vdicdb01_<wbr>migrate_to_0&quot; operation=&quot;migrate_to&quot; crm-debug-origin=&quot;do_update_<wbr>resource&quot; crm_feature_set=&quot;3.0.10&quot; transition-key=&quot;6:6:0:<wbr>fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a&quot; transition-magic=&quot;0:1;6:6:0:<wbr>fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a&quot; exit-reason=&quot;vdicdb01: live migration to vdicn<br>
&gt;         &gt; Aug 31 23:38:27 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_process_request:    Completed cib_modify operation for<br>
&gt;         section<br>
&gt;         &gt; status: OK (rc=0, origin=vdicnode02/crmd/14,<br>
&gt;         version=0.163.2)<br>
&gt;         &gt; Aug 31 23:38:27 [1526] vdicnode02       crmd:     info:<br>
&gt;         &gt; do_lrm_rsc_op:  Performing<br>
&gt;         &gt; key=2:7:0:fe1a9b0a-816c-4b97-<wbr>96cb-b90dbf71417a<br>
&gt;         op=vm-vdicdb01_stop_0<br>
&gt;         &gt; Aug 31 23:38:27 [1523] vdicnode02       lrmd:     info:<br>
&gt;         log_execute:<br>
&gt;         &gt;    executing - rsc:vm-vdicdb01 action:stop call_id:10<br>
&gt;         &gt; VirtualDomain(vm-vdicdb01)[<wbr>5285]:       2017/08/31_23:38:27<br>
&gt;         INFO:<br>
&gt;         &gt; Issuing graceful shutdown request for domain vdicdb01.<br>
&gt;         &gt; Aug 31 23:38:27 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: --- 0.163.2 2<br>
&gt;         &gt; Aug 31 23:38:27 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: +++ 0.163.3 (null)<br>
&gt;         &gt; Aug 31 23:38:27 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: +  /cib:  @num_updates=3<br>
&gt;         &gt; Aug 31 23:38:27 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: +<br>
&gt;         &gt;  /cib/status/node_state[@id=&#39;1&#39;<wbr>]/lrm[@id=&#39;1&#39;]/lrm_resources/<wbr>lrm_resource[@id=&#39;vm-vdicdb01&#39;<wbr>]/lrm_rsc_op[@id=&#39;vm-vdicdb01_<wbr>last_0&#39;]:  @operation_key=vm-vdicdb01_<wbr>stop_0, @operation=stop, @transition-key=4:7:0:<wbr>fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a, @transition-magic=0:0;4:7:0:<wbr>fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a, @call-id=6, @rc-code=0, @last-run=1504215507, @last-rc-change=1504215507, @exec-time=57<br>
&gt;         &gt; Aug 31 23:38:27 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_process_request:    Completed cib_modify operation for<br>
&gt;         section<br>
&gt;         &gt; status: OK (rc=0, origin=vdicnode01/crmd/43,<br>
&gt;         version=0.163.3)<br>
&gt;         &gt; Aug 31 23:38:30 [1523] vdicnode02       lrmd:     info:<br>
&gt;         log_finished:<br>
&gt;         &gt; finished - rsc:vm-vdicdb01 action:stop call_id:10 pid:5285<br>
&gt;         exit-code:0<br>
&gt;         &gt; exec-time:3159ms queue-time:0ms<br>
&gt;         &gt; Aug 31 23:38:30 [1526] vdicnode02       crmd:   notice:<br>
&gt;         &gt; process_lrm_event:      Result of stop operation for<br>
&gt;         vm-vdicdb01 on<br>
&gt;         &gt; vdicnode02: 0 (ok) | call=10 key=vm-vdicdb01_stop_0<br>
&gt;         confirmed=true<br>
&gt;         &gt; cib-update=15<br>
&gt;         &gt; Aug 31 23:38:30 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_process_request:    Forwarding cib_modify operation for<br>
&gt;         section<br>
&gt;         &gt; status to all (origin=local/crmd/15)<br>
&gt;         &gt; Aug 31 23:38:30 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: --- 0.163.3 2<br>
&gt;         &gt; Aug 31 23:38:30 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: +++ 0.163.4 (null)<br>
&gt;         &gt; Aug 31 23:38:30 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: +  /cib:  @num_updates=4<br>
&gt;         &gt; Aug 31 23:38:30 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: +<br>
&gt;         &gt;  /cib/status/node_state[@id=&#39;2&#39;<wbr>]/lrm[@id=&#39;2&#39;]/lrm_resources/<wbr>lrm_resource[@id=&#39;vm-vdicdb01&#39;<wbr>]/lrm_rsc_op[@id=&#39;vm-vdicdb01_<wbr>last_0&#39;]:  @operation_key=vm-vdicdb01_<wbr>stop_0, @operation=stop, @transition-key=2:7:0:<wbr>fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a, @transition-magic=0:0;2:7:0:<wbr>fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a, @call-id=10, @rc-code=0, @exec-time=3159<br>
&gt;         &gt; Aug 31 23:38:30 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_process_request:    Completed cib_modify operation for<br>
&gt;         section<br>
&gt;         &gt; status: OK (rc=0, origin=vdicnode02/crmd/15,<br>
&gt;         version=0.163.4)<br>
&gt;         &gt; Aug 31 23:38:31 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: --- 0.163.4 2<br>
&gt;         &gt; Aug 31 23:38:31 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: +++ 0.163.5 (null)<br>
&gt;         &gt; Aug 31 23:38:31 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: +  /cib:  @num_updates=5<br>
&gt;         &gt; Aug 31 23:38:31 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: +<br>
&gt;         &gt;  /cib/status/node_state[@id=&#39;1&#39;<wbr>]/lrm[@id=&#39;1&#39;]/lrm_resources/<wbr>lrm_resource[@id=&#39;vm-vdicdb01&#39;<wbr>]/lrm_rsc_op[@id=&#39;vm-vdicdb01_<wbr>last_0&#39;]:  @operation_key=vm-vdicdb01_<wbr>start_0, @operation=start, @transition-key=5:7:0:<wbr>fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a, @transition-magic=0:0;5:7:0:<wbr>fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a, @call-id=7, @last-run=1504215510, @last-rc-change=1504215510, @exec-time=528<br>
&gt;         &gt; Aug 31 23:38:31 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_process_request:    Completed cib_modify operation for<br>
&gt;         section<br>
&gt;         &gt; status: OK (rc=0, origin=vdicnode01/crmd/44,<br>
&gt;         version=0.163.5)<br>
&gt;         &gt; Aug 31 23:38:31 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: --- 0.163.5 2<br>
&gt;         &gt; Aug 31 23:38:31 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: +++ 0.163.6 (null)<br>
&gt;         &gt; Aug 31 23:38:31 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op: +  /cib:  @num_updates=6<br>
&gt;         &gt; Aug 31 23:38:31 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_perform_op:<br>
&gt;         &gt;<br>
&gt;         ++ /cib/status/node_state[@id=&#39;1&#39;<wbr>]/lrm[@id=&#39;1&#39;]/lrm_resources/<wbr>lrm_resource[@id=&#39;vm-vdicdb01&#39;<wbr>]:  &lt;lrm_rsc_op id=&quot;vm-vdicdb01_monitor_10000&quot; operation_key=&quot;vm-vdicdb01_<wbr>monitor_10000&quot; operation=&quot;monitor&quot; crm-debug-origin=&quot;do_update_<wbr>resource&quot; crm_feature_set=&quot;3.0.10&quot; transition-key=&quot;6:7:0:<wbr>fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a&quot; transition-magic=&quot;0:0;6:7:0:<wbr>fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a&quot; on_node=&quot;vdicnode01&quot; call-id=&quot;8&quot; rc-code=&quot;0&quot; op-s<br>
&gt;         &gt; Aug 31 23:38:31 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_process_request:    Completed cib_modify operation for<br>
&gt;         section<br>
&gt;         &gt; status: OK (rc=0, origin=vdicnode01/crmd/45,<br>
&gt;         version=0.163.6)<br>
&gt;         &gt; Aug 31 23:38:36 [1521] vdicnode02        cib:     info:<br>
&gt;         &gt; cib_process_ping:       Reporting our current digest to<br>
&gt;         vdicnode01:<br>
&gt;         &gt; 9141ea9880f5a44b133003982d863b<wbr>c8 for 0.163.6 (0x7f96bb2625a0<br>
&gt;         0)<br>
&gt;         &gt;<br>
&gt;         &gt;<br>
&gt;         &gt;<br>
&gt;         &gt;<br>
&gt;         &gt;<br>
&gt;         &gt;<br>
&gt;         &gt; vdicnode01 - corosync.log<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_process_request:    Forwarding cib_replace operation for<br>
&gt;         section<br>
&gt;         &gt; configuration to all (origin=local/cibadmin/2)<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: --- 0.162.0 2<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: +++ 0.163.0 (null)<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: +  /cib:  @epoch=163<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: ++ /cib/configuration/<wbr>constraints:<br>
&gt;         &lt;rsc_location<br>
&gt;         &gt; id=&quot;location-vm-vdicdb01-<wbr>vdicnode02--INFINITY&quot;<br>
&gt;         node=&quot;vdicnode02&quot;<br>
&gt;         &gt; rsc=&quot;vm-vdicdb01&quot; score=&quot;-INFINITY&quot;/&gt;<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_process_request:    Completed cib_replace operation for<br>
&gt;         section<br>
&gt;         &gt; configuration: OK (rc=0, origin=vdicnode01/cibadmin/2,<br>
&gt;         &gt; version=0.163.0)<br>
&gt;         &gt; Aug 31 23:38:27 [1536] vdicnode01       crmd:     info:<br>
&gt;         &gt; abort_transition_graph: Transition aborted by<br>
&gt;         &gt; rsc_location.location-vm-<wbr>vdicdb01-vdicnode02--INFINITY<br>
&gt;         &#39;create&#39;:<br>
&gt;         &gt; Non-status change | cib=0.163.0 source=te_update_diff:436<br>
&gt;         &gt; path=/cib/configuration/<wbr>constraints complete=true<br>
&gt;         &gt; Aug 31 23:38:27 [1536] vdicnode01       crmd:   notice:<br>
&gt;         &gt; do_state_transition:    State transition S_IDLE -&gt;<br>
&gt;         S_POLICY_ENGINE |<br>
&gt;         &gt; input=I_PE_CALC cause=C_FSA_INTERNAL<br>
&gt;         origin=abort_transition_graph<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_file_backup:        Archived previous version<br>
&gt;         &gt; as /var/lib/pacemaker/cib/cib-85.<wbr>raw<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_file_write_with_digest:     Wrote version 0.163.0 of the<br>
&gt;         CIB to<br>
&gt;         &gt; disk (digest: 47a548b36746de9275d66cc6aeb0fd<wbr>c4)<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_file_write_with_digest:     Reading cluster<br>
&gt;         configuration<br>
&gt;         &gt; file /var/lib/pacemaker/cib/cib.<wbr>npBIW2<br>
&gt;         &gt; (digest: /var/lib/pacemaker/cib/cib.<wbr>bDogoB)<br>
&gt;         &gt; Aug 31 23:38:27 [1535] vdicnode01    pengine:     info:<br>
&gt;         &gt; determine_online_status:        Node vdicnode02 is online<br>
&gt;         &gt; Aug 31 23:38:27 [1535] vdicnode01    pengine:     info:<br>
&gt;         &gt; determine_online_status:        Node vdicnode01 is online<br>
&gt;         &gt; Aug 31 23:38:27 [1535] vdicnode01    pengine:     info:<br>
&gt;         native_print:<br>
&gt;         &gt; vm-vdicdb01     (ocf::heartbeat:VirtualDomain)<wbr>: Started<br>
&gt;         vdicnode02<br>
&gt;         &gt; Aug 31 23:38:27 [1535] vdicnode01    pengine:     info:<br>
&gt;         RecurringOp:<br>
&gt;         &gt; Start recurring monitor (10s) for vm-vdicdb01 on vdicnode01<br>
&gt;         &gt; Aug 31 23:38:27 [1535] vdicnode01    pengine:   notice:<br>
&gt;         LogActions:<br>
&gt;         &gt; Migrate vm-vdicdb01     (Started vdicnode02 -&gt; vdicnode01)<br>
&gt;         &gt; Aug 31 23:38:27 [1535] vdicnode01    pengine:   notice:<br>
&gt;         &gt; process_pe_message:     Calculated transition 6, saving<br>
&gt;         inputs<br>
&gt;         &gt; in /var/lib/pacemaker/pengine/pe-<wbr>input-96.bz2<br>
&gt;         &gt; Aug 31 23:38:27 [1536] vdicnode01       crmd:     info:<br>
&gt;         &gt; do_state_transition:    State transition S_POLICY_ENGINE -&gt;<br>
&gt;         &gt; S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE<br>
&gt;         &gt; origin=handle_response<br>
&gt;         &gt; Aug 31 23:38:27 [1536] vdicnode01       crmd:     info:<br>
&gt;         do_te_invoke:<br>
&gt;         &gt; Processing graph 6 (ref=pe_calc-dc-1504215507-24) derived<br>
&gt;         &gt; from /var/lib/pacemaker/pengine/pe-<wbr>input-96.bz2<br>
&gt;         &gt; Aug 31 23:38:27 [1536] vdicnode01       crmd:   notice:<br>
&gt;         &gt; te_rsc_command: Initiating migrate_to operation<br>
&gt;         &gt; vm-vdicdb01_migrate_to_0 on vdicnode02 | action 6<br>
&gt;         &gt; Aug 31 23:38:27 [1536] vdicnode01       crmd:     info:<br>
&gt;         &gt; create_operation_update:        cib_action_update: Updating<br>
&gt;         resource<br>
&gt;         &gt; vm-vdicdb01 after migrate_to op pending (interval=0)<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_process_request:    Forwarding cib_modify operation for<br>
&gt;         section<br>
&gt;         &gt; status to all (origin=local/crmd/41)<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: --- 0.163.0 2<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: +++ 0.163.1 (null)<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: +  /cib:  @num_updates=1<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: +<br>
&gt;         &gt;  /cib/status/node_state[@id=&#39;2&#39;<wbr>]/lrm[@id=&#39;2&#39;]/lrm_resources/<wbr>lrm_resource[@id=&#39;vm-vdicdb01&#39;<wbr>]/lrm_rsc_op[@id=&#39;vm-vdicdb01_<wbr>last_0&#39;]:  @operation_key=vm-vdicdb01_<wbr>migrate_to_0, @operation=migrate_to, @crm-debug-origin=cib_action_<wbr>update, @transition-key=6:6:0:<wbr>fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a, @transition-magic=-1:193;6:6:<wbr>0:fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a, @call-id=-1, @rc-code=193, @op-status=-1, @last-run=1504215507, @last-rc-cha<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_process_request:    Completed cib_modify operation for<br>
&gt;         section<br>
&gt;         &gt; status: OK (rc=0, origin=vdicnode01/crmd/41,<br>
&gt;         version=0.163.1)<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: --- 0.163.1 2<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: +++ 0.163.2 (null)<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: +  /cib:  @num_updates=2<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: +<br>
&gt;         &gt;  /cib/status/node_state[@id=&#39;2&#39;<wbr>]/lrm[@id=&#39;2&#39;]/lrm_resources/<wbr>lrm_resource[@id=&#39;vm-vdicdb01&#39;<wbr>]/lrm_rsc_op[@id=&#39;vm-vdicdb01_<wbr>last_0&#39;]:  @crm-debug-origin=do_update_<wbr>resource, @transition-magic=0:1;6:6:0:<wbr>fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a, @call-id=9, @rc-code=1, @op-status=0, @exec-time=78, @exit-reason=vdicdb01: live migration to vdicnode01 failed: 1<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op:<br>
&gt;         &gt;<br>
&gt;         ++ /cib/status/node_state[@id=&#39;2&#39;<wbr>]/lrm[@id=&#39;2&#39;]/lrm_resources/<wbr>lrm_resource[@id=&#39;vm-vdicdb01&#39;<wbr>]:  &lt;lrm_rsc_op id=&quot;vm-vdicdb01_last_failure_<wbr>0&quot; operation_key=&quot;vm-vdicdb01_<wbr>migrate_to_0&quot; operation=&quot;migrate_to&quot; crm-debug-origin=&quot;do_update_<wbr>resource&quot; crm_feature_set=&quot;3.0.10&quot; transition-key=&quot;6:6:0:<wbr>fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a&quot; transition-magic=&quot;0:1;6:6:0:<wbr>fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a&quot; exit-reason=&quot;vdicdb01: live migration to vdicn<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_process_request:    Completed cib_modify operation for<br>
&gt;         section<br>
&gt;         &gt; status: OK (rc=0, origin=vdicnode02/crmd/14,<br>
&gt;         version=0.163.2)<br>
&gt;         &gt; Aug 31 23:38:27 [1536] vdicnode01       crmd:  warning:<br>
&gt;         &gt; status_from_rc: Action 6 (vm-vdicdb01_migrate_to_0) on<br>
&gt;         vdicnode02<br>
&gt;         &gt; failed (target: 0 vs. rc: 1): Error<br>
&gt;         &gt; Aug 31 23:38:27 [1536] vdicnode01       crmd:   notice:<br>
&gt;         &gt; abort_transition_graph: Transition aborted by operation<br>
&gt;         &gt; vm-vdicdb01_migrate_to_0 &#39;modify&#39; on vdicnode02: Event<br>
&gt;         failed |<br>
&gt;         &gt; magic=0:1;6:6:0:fe1a9b0a-816c-<wbr>4b97-96cb-b90dbf71417a<br>
&gt;         cib=0.163.2<br>
&gt;         &gt; source=match_graph_event:310 complete=false<br>
&gt;         &gt; Aug 31 23:38:27 [1536] vdicnode01       crmd:     info:<br>
&gt;         &gt; match_graph_event:      Action vm-vdicdb01_migrate_to_0 (6)<br>
&gt;         confirmed<br>
&gt;         &gt; on vdicnode02 (rc=1)<br>
&gt;         &gt; Aug 31 23:38:27 [1536] vdicnode01       crmd:     info:<br>
&gt;         &gt; process_graph_event:    Detected action (6.6)<br>
&gt;         &gt; vm-vdicdb01_migrate_to_0.9=<wbr>unknown error: failed<br>
&gt;         &gt; Aug 31 23:38:27 [1536] vdicnode01       crmd:  warning:<br>
&gt;         &gt; status_from_rc: Action 6 (vm-vdicdb01_migrate_to_0) on<br>
&gt;         vdicnode02<br>
&gt;         &gt; failed (target: 0 vs. rc: 1): Error<br>
&gt;         &gt; Aug 31 23:38:27 [1536] vdicnode01       crmd:     info:<br>
&gt;         &gt; abort_transition_graph: Transition aborted by operation<br>
&gt;         &gt; vm-vdicdb01_migrate_to_0 &#39;create&#39; on vdicnode02: Event<br>
&gt;         failed |<br>
&gt;         &gt; magic=0:1;6:6:0:fe1a9b0a-816c-<wbr>4b97-96cb-b90dbf71417a<br>
&gt;         cib=0.163.2<br>
&gt;         &gt; source=match_graph_event:310 complete=false<br>
&gt;         &gt; Aug 31 23:38:27 [1536] vdicnode01       crmd:     info:<br>
&gt;         &gt; match_graph_event:      Action vm-vdicdb01_migrate_to_0 (6)<br>
&gt;         confirmed<br>
&gt;         &gt; on vdicnode02 (rc=1)<br>
&gt;         &gt; Aug 31 23:38:27 [1536] vdicnode01       crmd:     info:<br>
&gt;         &gt; process_graph_event:    Detected action (6.6)<br>
&gt;         &gt; vm-vdicdb01_migrate_to_0.9=<wbr>unknown error: failed<br>
&gt;         &gt; Aug 31 23:38:27 [1536] vdicnode01       crmd:   notice:<br>
&gt;         run_graph:<br>
&gt;         &gt;    Transition 6 (Complete=1, Pending=0, Fired=0, Skipped=0,<br>
&gt;         &gt; Incomplete=5,<br>
&gt;         Source=/var/lib/pacemaker/<wbr>pengine/pe-input-96.bz2):<br>
&gt;         &gt; Complete<br>
&gt;         &gt; Aug 31 23:38:27 [1536] vdicnode01       crmd:     info:<br>
&gt;         &gt; do_state_transition:    State transition S_TRANSITION_ENGINE<br>
&gt;         -&gt;<br>
&gt;         &gt; S_POLICY_ENGINE | input=I_PE_CALC cause=C_FSA_INTERNAL<br>
&gt;         &gt; origin=notify_crmd<br>
&gt;         &gt; Aug 31 23:38:27 [1535] vdicnode01    pengine:     info:<br>
&gt;         &gt; determine_online_status:        Node vdicnode02 is online<br>
&gt;         &gt; Aug 31 23:38:27 [1535] vdicnode01    pengine:     info:<br>
&gt;         &gt; determine_online_status:        Node vdicnode01 is online<br>
&gt;         &gt; Aug 31 23:38:27 [1535] vdicnode01    pengine:  warning:<br>
&gt;         &gt; unpack_rsc_op_failure:  Processing failed op migrate_to for<br>
&gt;         &gt; vm-vdicdb01 on vdicnode02: unknown error (1)<br>
&gt;         &gt; Aug 31 23:38:27 [1535] vdicnode01    pengine:  warning:<br>
&gt;         &gt; unpack_rsc_op_failure:  Processing failed op migrate_to for<br>
&gt;         &gt; vm-vdicdb01 on vdicnode02: unknown error (1)<br>
&gt;         &gt; Aug 31 23:38:27 [1535] vdicnode01    pengine:     info:<br>
&gt;         native_print:<br>
&gt;         &gt; vm-vdicdb01     (ocf::heartbeat:VirtualDomain)<wbr>: FAILED<br>
&gt;         &gt; Aug 31 23:38:27 [1535] vdicnode01    pengine:     info:<br>
&gt;         native_print:<br>
&gt;         &gt; 1 : vdicnode01<br>
&gt;         &gt; Aug 31 23:38:27 [1535] vdicnode01    pengine:     info:<br>
&gt;         native_print:<br>
&gt;         &gt; 2 : vdicnode02<br>
&gt;         &gt; Aug 31 23:38:27 [1535] vdicnode01    pengine:    error:<br>
&gt;         &gt; native_create_actions:  Resource vm-vdicdb01<br>
&gt;         (ocf::VirtualDomain) is<br>
&gt;         &gt; active on 2 nodes attempting recovery<br>
&gt;         &gt; Aug 31 23:38:27 [1535] vdicnode01    pengine:  warning:<br>
&gt;         &gt; native_create_actions:  See<br>
&gt;         &gt; <a href="http://clusterlabs.org/wiki/FAQ#Resource_is_Too_Active" rel="noreferrer" target="_blank">http://clusterlabs.org/wiki/<wbr>FAQ#Resource_is_Too_Active</a> for<br>
&gt;         more<br>
&gt;         &gt; information.<br>
&gt;         &gt; Aug 31 23:38:27 [1535] vdicnode01    pengine:     info:<br>
&gt;         RecurringOp:<br>
&gt;         &gt; Start recurring monitor (10s) for vm-vdicdb01 on vdicnode01<br>
&gt;         &gt; Aug 31 23:38:27 [1535] vdicnode01    pengine:   notice:<br>
&gt;         LogActions:<br>
&gt;         &gt; Recover vm-vdicdb01     (Started vdicnode01)<br>
&gt;         &gt; Aug 31 23:38:27 [1535] vdicnode01    pengine:    error:<br>
&gt;         &gt; process_pe_message:     Calculated transition 7 (with<br>
&gt;         errors), saving<br>
&gt;         &gt; inputs in /var/lib/pacemaker/pengine/pe-<wbr>error-8.bz2<br>
&gt;         &gt; Aug 31 23:38:27 [1536] vdicnode01       crmd:     info:<br>
&gt;         &gt; do_state_transition:    State transition S_POLICY_ENGINE -&gt;<br>
&gt;         &gt; S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE<br>
&gt;         &gt; origin=handle_response<br>
&gt;         &gt; Aug 31 23:38:27 [1536] vdicnode01       crmd:     info:<br>
&gt;         do_te_invoke:<br>
&gt;         &gt; Processing graph 7 (ref=pe_calc-dc-1504215507-26) derived<br>
&gt;         &gt; from /var/lib/pacemaker/pengine/pe-<wbr>error-8.bz2<br>
&gt;         &gt; Aug 31 23:38:27 [1536] vdicnode01       crmd:   notice:<br>
&gt;         &gt; te_rsc_command: Initiating stop operation vm-vdicdb01_stop_0<br>
&gt;         locally<br>
&gt;         &gt; on vdicnode01 | action 4<br>
&gt;         &gt; Aug 31 23:38:27 [1536] vdicnode01       crmd:     info:<br>
&gt;         &gt; do_lrm_rsc_op:  Performing<br>
&gt;         &gt; key=4:7:0:fe1a9b0a-816c-4b97-<wbr>96cb-b90dbf71417a<br>
&gt;         op=vm-vdicdb01_stop_0<br>
&gt;         &gt; Aug 31 23:38:27 [1533] vdicnode01       lrmd:     info:<br>
&gt;         log_execute:<br>
&gt;         &gt;    executing - rsc:vm-vdicdb01 action:stop call_id:6<br>
&gt;         &gt; Aug 31 23:38:27 [1536] vdicnode01       crmd:   notice:<br>
&gt;         &gt; te_rsc_command: Initiating stop operation vm-vdicdb01_stop_0<br>
&gt;         on<br>
&gt;         &gt; vdicnode02 | action 2<br>
&gt;         &gt; VirtualDomain(vm-vdicdb01)[<wbr>5268]:       2017/08/31_23:38:27<br>
&gt;         INFO:<br>
&gt;         &gt; Domain vdicdb01 already stopped.<br>
&gt;         &gt; Aug 31 23:38:27 [1533] vdicnode01       lrmd:     info:<br>
&gt;         log_finished:<br>
&gt;         &gt; finished - rsc:vm-vdicdb01 action:stop call_id:6 pid:5268<br>
&gt;         exit-code:0<br>
&gt;         &gt; exec-time:57ms queue-time:0ms<br>
&gt;         &gt; Aug 31 23:38:27 [1536] vdicnode01       crmd:   notice:<br>
&gt;         &gt; process_lrm_event:      Result of stop operation for<br>
&gt;         vm-vdicdb01 on<br>
&gt;         &gt; vdicnode01: 0 (ok) | call=6 key=vm-vdicdb01_stop_0<br>
&gt;         confirmed=true<br>
&gt;         &gt; cib-update=43<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_process_request:    Forwarding cib_modify operation for<br>
&gt;         section<br>
&gt;         &gt; status to all (origin=local/crmd/43)<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: --- 0.163.2 2<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: +++ 0.163.3 (null)<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: +  /cib:  @num_updates=3<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: +<br>
&gt;         &gt;  /cib/status/node_state[@id=&#39;1&#39;<wbr>]/lrm[@id=&#39;1&#39;]/lrm_resources/<wbr>lrm_resource[@id=&#39;vm-vdicdb01&#39;<wbr>]/lrm_rsc_op[@id=&#39;vm-vdicdb01_<wbr>last_0&#39;]:  @operation_key=vm-vdicdb01_<wbr>stop_0, @operation=stop, @transition-key=4:7:0:<wbr>fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a, @transition-magic=0:0;4:7:0:<wbr>fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a, @call-id=6, @rc-code=0, @last-run=1504215507, @last-rc-change=1504215507, @exec-time=57<br>
&gt;         &gt; Aug 31 23:38:27 [1536] vdicnode01       crmd:     info:<br>
&gt;         &gt; match_graph_event:      Action vm-vdicdb01_stop_0 (4)<br>
&gt;         confirmed on<br>
&gt;         &gt; vdicnode01 (rc=0)<br>
&gt;         &gt; Aug 31 23:38:27 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_process_request:    Completed cib_modify operation for<br>
&gt;         section<br>
&gt;         &gt; status: OK (rc=0, origin=vdicnode01/crmd/43,<br>
&gt;         version=0.163.3)<br>
&gt;         &gt; Aug 31 23:38:30 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: --- 0.163.3 2<br>
&gt;         &gt; Aug 31 23:38:30 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: +++ 0.163.4 (null)<br>
&gt;         &gt; Aug 31 23:38:30 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: +  /cib:  @num_updates=4<br>
&gt;         &gt; Aug 31 23:38:30 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: +<br>
&gt;         &gt;  /cib/status/node_state[@id=&#39;2&#39;<wbr>]/lrm[@id=&#39;2&#39;]/lrm_resources/<wbr>lrm_resource[@id=&#39;vm-vdicdb01&#39;<wbr>]/lrm_rsc_op[@id=&#39;vm-vdicdb01_<wbr>last_0&#39;]:  @operation_key=vm-vdicdb01_<wbr>stop_0, @operation=stop, @transition-key=2:7:0:<wbr>fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a, @transition-magic=0:0;2:7:0:<wbr>fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a, @call-id=10, @rc-code=0, @exec-time=3159<br>
&gt;         &gt; Aug 31 23:38:30 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_process_request:    Completed cib_modify operation for<br>
&gt;         section<br>
&gt;         &gt; status: OK (rc=0, origin=vdicnode02/crmd/15,<br>
&gt;         version=0.163.4)<br>
&gt;         &gt; Aug 31 23:38:30 [1536] vdicnode01       crmd:     info:<br>
&gt;         &gt; match_graph_event:      Action vm-vdicdb01_stop_0 (2)<br>
&gt;         confirmed on<br>
&gt;         &gt; vdicnode02 (rc=0)<br>
&gt;         &gt; Aug 31 23:38:30 [1536] vdicnode01       crmd:   notice:<br>
&gt;         &gt; te_rsc_command: Initiating start operation<br>
&gt;         vm-vdicdb01_start_0 locally<br>
&gt;         &gt; on vdicnode01 | action 5<br>
&gt;         &gt; Aug 31 23:38:30 [1536] vdicnode01       crmd:     info:<br>
&gt;         &gt; do_lrm_rsc_op:  Performing<br>
&gt;         &gt; key=5:7:0:fe1a9b0a-816c-4b97-<wbr>96cb-b90dbf71417a<br>
&gt;         op=vm-vdicdb01_start_0<br>
&gt;         &gt; Aug 31 23:38:30 [1533] vdicnode01       lrmd:     info:<br>
&gt;         log_execute:<br>
&gt;         &gt;    executing - rsc:vm-vdicdb01 action:start call_id:7<br>
&gt;         &gt; Aug 31 23:38:31 [1533] vdicnode01       lrmd:     info:<br>
&gt;         log_finished:<br>
&gt;         &gt; finished - rsc:vm-vdicdb01 action:start call_id:7 pid:5401<br>
&gt;         exit-code:0<br>
&gt;         &gt; exec-time:528ms queue-time:0ms<br>
&gt;         &gt; Aug 31 23:38:31 [1536] vdicnode01       crmd:     info:<br>
&gt;         &gt; action_synced_wait:     Managed VirtualDomain_meta-data_0<br>
&gt;         process 5486<br>
&gt;         &gt; exited with rc=0<br>
&gt;         &gt; Aug 31 23:38:31 [1536] vdicnode01       crmd:   notice:<br>
&gt;         &gt; process_lrm_event:      Result of start operation for<br>
&gt;         vm-vdicdb01 on<br>
&gt;         &gt; vdicnode01: 0 (ok) | call=7 key=vm-vdicdb01_start_0<br>
&gt;         confirmed=true<br>
&gt;         &gt; cib-update=44<br>
&gt;         &gt; Aug 31 23:38:31 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_process_request:    Forwarding cib_modify operation for<br>
&gt;         section<br>
&gt;         &gt; status to all (origin=local/crmd/44)<br>
&gt;         &gt; Aug 31 23:38:31 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: --- 0.163.4 2<br>
&gt;         &gt; Aug 31 23:38:31 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: +++ 0.163.5 (null)<br>
&gt;         &gt; Aug 31 23:38:31 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: +  /cib:  @num_updates=5<br>
&gt;         &gt; Aug 31 23:38:31 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: +<br>
&gt;         &gt;  /cib/status/node_state[@id=&#39;1&#39;<wbr>]/lrm[@id=&#39;1&#39;]/lrm_resources/<wbr>lrm_resource[@id=&#39;vm-vdicdb01&#39;<wbr>]/lrm_rsc_op[@id=&#39;vm-vdicdb01_<wbr>last_0&#39;]:  @operation_key=vm-vdicdb01_<wbr>start_0, @operation=start, @transition-key=5:7:0:<wbr>fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a, @transition-magic=0:0;5:7:0:<wbr>fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a, @call-id=7, @last-run=1504215510, @last-rc-change=1504215510, @exec-time=528<br>
&gt;         &gt; Aug 31 23:38:31 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_process_request:    Completed cib_modify operation for<br>
&gt;         section<br>
&gt;         &gt; status: OK (rc=0, origin=vdicnode01/crmd/44,<br>
&gt;         version=0.163.5)<br>
&gt;         &gt; Aug 31 23:38:31 [1536] vdicnode01       crmd:     info:<br>
&gt;         &gt; match_graph_event:      Action vm-vdicdb01_start_0 (5)<br>
&gt;         confirmed on<br>
&gt;         &gt; vdicnode01 (rc=0)<br>
&gt;         &gt; Aug 31 23:38:31 [1536] vdicnode01       crmd:   notice:<br>
&gt;         &gt; te_rsc_command: Initiating monitor operation<br>
&gt;         vm-vdicdb01_monitor_10000<br>
&gt;         &gt; locally on vdicnode01 | action 6<br>
&gt;         &gt; Aug 31 23:38:31 [1536] vdicnode01       crmd:     info:<br>
&gt;         &gt; do_lrm_rsc_op:  Performing<br>
&gt;         &gt; key=6:7:0:fe1a9b0a-816c-4b97-<wbr>96cb-b90dbf71417a<br>
&gt;         &gt; op=vm-vdicdb01_monitor_10000<br>
&gt;         &gt; Aug 31 23:38:31 [1536] vdicnode01       crmd:     info:<br>
&gt;         &gt; process_lrm_event:      Result of monitor operation for<br>
&gt;         vm-vdicdb01 on<br>
&gt;         &gt; vdicnode01: 0 (ok) | call=8 key=vm-vdicdb01_monitor_10000<br>
&gt;         &gt; confirmed=false cib-update=45<br>
&gt;         &gt; Aug 31 23:38:31 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_process_request:    Forwarding cib_modify operation for<br>
&gt;         section<br>
&gt;         &gt; status to all (origin=local/crmd/45)<br>
&gt;         &gt; Aug 31 23:38:31 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: --- 0.163.5 2<br>
&gt;         &gt; Aug 31 23:38:31 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: Diff: +++ 0.163.6 (null)<br>
&gt;         &gt; Aug 31 23:38:31 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op: +  /cib:  @num_updates=6<br>
&gt;         &gt; Aug 31 23:38:31 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_perform_op:<br>
&gt;         &gt;<br>
&gt;         ++ /cib/status/node_state[@id=&#39;1&#39;<wbr>]/lrm[@id=&#39;1&#39;]/lrm_resources/<wbr>lrm_resource[@id=&#39;vm-vdicdb01&#39;<wbr>]:  &lt;lrm_rsc_op id=&quot;vm-vdicdb01_monitor_10000&quot; operation_key=&quot;vm-vdicdb01_<wbr>monitor_10000&quot; operation=&quot;monitor&quot; crm-debug-origin=&quot;do_update_<wbr>resource&quot; crm_feature_set=&quot;3.0.10&quot; transition-key=&quot;6:7:0:<wbr>fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a&quot; transition-magic=&quot;0:0;6:7:0:<wbr>fe1a9b0a-816c-4b97-96cb-<wbr>b90dbf71417a&quot; on_node=&quot;vdicnode01&quot; call-id=&quot;8&quot; rc-code=&quot;0&quot; op-s<br>
&gt;         &gt; Aug 31 23:38:31 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_process_request:    Completed cib_modify operation for<br>
&gt;         section<br>
&gt;         &gt; status: OK (rc=0, origin=vdicnode01/crmd/45,<br>
&gt;         version=0.163.6)<br>
&gt;         &gt; Aug 31 23:38:31 [1536] vdicnode01       crmd:     info:<br>
&gt;         &gt; match_graph_event:      Action vm-vdicdb01_monitor_10000 (6)<br>
&gt;         confirmed<br>
&gt;         &gt; on vdicnode01 (rc=0)<br>
&gt;         &gt; Aug 31 23:38:31 [1536] vdicnode01       crmd:   notice:<br>
&gt;         run_graph:<br>
&gt;         &gt;    Transition 7 (Complete=5, Pending=0, Fired=0, Skipped=0,<br>
&gt;         &gt; Incomplete=0,<br>
&gt;         Source=/var/lib/pacemaker/<wbr>pengine/pe-error-8.bz2):<br>
&gt;         &gt; Complete<br>
&gt;         &gt; Aug 31 23:38:31 [1536] vdicnode01       crmd:     info:<br>
&gt;         do_log: Input<br>
&gt;         &gt; I_TE_SUCCESS received in state S_TRANSITION_ENGINE from<br>
&gt;         notify_crmd<br>
&gt;         &gt; Aug 31 23:38:31 [1536] vdicnode01       crmd:   notice:<br>
&gt;         &gt; do_state_transition:    State transition S_TRANSITION_ENGINE<br>
&gt;         -&gt; S_IDLE<br>
&gt;         &gt; | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd<br>
&gt;         &gt; Aug 31 23:38:36 [1531] vdicnode01        cib:     info:<br>
&gt;         &gt; cib_process_ping:       Reporting our current digest to<br>
&gt;         vdicnode01:<br>
&gt;         &gt; 9141ea9880f5a44b133003982d863b<wbr>c8 for 0.163.6 (0x7f61cec09270<br>
&gt;         0)<br>
&gt;         &gt;<br>
&gt;         &gt;<br>
&gt;         &gt; Thanks a lot<br>
&gt;         &gt;<br>
&gt;         &gt; 2017-08-31 16:20 GMT+02:00 Ken Gaillot<br>
&gt;         &lt;<a href="mailto:kgaillot@redhat.com">kgaillot@redhat.com</a>&gt;:<br>
&gt;         &gt;         On Thu, 2017-08-31 at 01:13 +0200, Oscar Segarra<br>
&gt;         wrote:<br>
&gt;         &gt;         &gt; Hi,<br>
&gt;         &gt;         &gt;<br>
&gt;         &gt;         &gt;<br>
&gt;         &gt;         &gt; In my environment, I have just two hosts, where<br>
&gt;         qemu-kvm<br>
&gt;         &gt;         process is<br>
&gt;         &gt;         &gt; launched by a regular user (oneadmin) - open<br>
&gt;         nebula -<br>
&gt;         &gt;         &gt;<br>
&gt;         &gt;         &gt;<br>
&gt;         &gt;         &gt; I have created a VirtualDomain resource that<br>
&gt;         starts and<br>
&gt;         &gt;         stops the VM<br>
&gt;         &gt;         &gt; perfectly. Nevertheless, when I change the<br>
&gt;         location weight<br>
&gt;         &gt;         in order to<br>
&gt;         &gt;         &gt; force the migration, It raises a migration failure<br>
&gt;         &quot;error:<br>
&gt;         &gt;         1&quot;<br>
&gt;         &gt;         &gt;<br>
&gt;         &gt;         &gt;<br>
&gt;         &gt;         &gt; If I execute the virsh migrate command (that<br>
&gt;         appears in<br>
&gt;         &gt;         corosync.log)<br>
&gt;         &gt;         &gt; from command line, it works perfectly.<br>
&gt;         &gt;         &gt;<br>
&gt;         &gt;         &gt;<br>
&gt;         &gt;         &gt; Anybody has experienced the same issue?<br>
&gt;         &gt;         &gt;<br>
&gt;         &gt;         &gt;<br>
&gt;         &gt;         &gt; Thanks in advance for your help<br>
&gt;         &gt;<br>
&gt;         &gt;<br>
&gt;         &gt;         If something works from the command line but not<br>
&gt;         when run by a<br>
&gt;         &gt;         daemon,<br>
&gt;         &gt;         my first suspicion is SELinux. Check the audit log<br>
&gt;         for denials<br>
&gt;         &gt;         around<br>
&gt;         &gt;         that time.<br>
&gt;         &gt;<br>
&gt;         &gt;         I&#39;d also check the system log and Pacemaker detail<br>
&gt;         log around<br>
&gt;         &gt;         that time<br>
&gt;         &gt;         to see if there is any more information.<br>
&gt;         &gt;         --<br>
&gt;         &gt;         Ken Gaillot &lt;<a href="mailto:kgaillot@redhat.com">kgaillot@redhat.com</a>&gt;<br>
&gt;         &gt;<br>
&gt;         &gt;<br>
&gt;         &gt;<br>
&gt;         &gt;<br>
&gt;         &gt;<br>
&gt;         &gt;         ______________________________<wbr>_________________<br>
&gt;         &gt;         Users mailing list: <a href="mailto:Users@clusterlabs.org">Users@clusterlabs.org</a><br>
&gt;         &gt;         <a href="http://lists.clusterlabs.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.clusterlabs.org/<wbr>mailman/listinfo/users</a><br>
&gt;         &gt;<br>
&gt;         &gt;         Project Home: <a href="http://www.clusterlabs.org" rel="noreferrer" target="_blank">http://www.clusterlabs.org</a><br>
&gt;         &gt;         Getting started:<br>
&gt;         &gt;<br>
&gt;          <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" rel="noreferrer" target="_blank">http://www.clusterlabs.org/<wbr>doc/Cluster_from_Scratch.pdf</a><br>
&gt;         &gt;         Bugs: <a href="http://bugs.clusterlabs.org" rel="noreferrer" target="_blank">http://bugs.clusterlabs.org</a><br>
&gt;         &gt;<br>
&gt;         &gt;<br>
&gt;<br>
&gt;<br>
&gt;         --<br>
&gt;         Ken Gaillot &lt;<a href="mailto:kgaillot@redhat.com">kgaillot@redhat.com</a>&gt;<br>
&gt;<br>
&gt;<br>
&gt;<br>
&gt;<br>
&gt;<br>
&gt;<br>
<br>
</div></div><span class="HOEnZb"><font color="#888888">--<br>
Ken Gaillot &lt;<a href="mailto:kgaillot@redhat.com">kgaillot@redhat.com</a>&gt;<br>
<br>
<br>
<br>
<br>
</font></span></blockquote></div><br></div>