Re: new to pacemaker and heartbeat on debian...getting error..
oh- have been following this tutorial :
http://www.clusterlabs.org/wiki/Debian_Lenny_HowTo#Install_the_packages
it says that you should have heartbeat along with pacemaker and
corosync - i think.
mjh
On Mon, Oct 24, 2011 at 5:02 PM, Joey L <mjh2000@gmail.com> wrote:
>>
>> I'd say version 3 (1:3.0.3-2).
>> But you have heartbeat and corosync installed, you must choose only one (I'd
>> choose corosync).
>
> Okay - choose corosync -- though pacemaker is installed - i can not
> control it - meaning there is no init file in /etc/init.d directory -
> but says installed.
>
>
>
>> cibadmin is less readable than crm configure show.
>>
>> Here is mine, truncated and anonymised to show only one IPaddr resource :
>>
>> root@node1:~# crm configure show
>> node node1 \
>> attributes standby="off"
>> node node2 \
>> attributes standby="off"
>> primitive res_IPaddr2_res1 ocf:heartbeat:IPaddr2 \
>> params ip="A.B.C.D" \
>> operations $id="res_IPaddr2_res1-operations" \
>> op start interval="0" timeout="20" \
>> op stop interval="0" timeout="20" \
>> op monitor interval="10" timeout="20" start-delay="0"
>> property $id="cib-bootstrap-options" \
>> expected-quorum-votes="2" \
>> dc-version="1.0.11-6e010d6b0d49a6b929d17c0114e9d2d934dc8e04" \
>> no-quorum-policy="ignore" \
>> cluster-infrastructure="openais" \
>> last-lrm-refresh="1316614496" \
>> stonith-enabled="false"
>>
>> No clone primitive.
>> Side note : With 2 nodes and 2 votes, you'd better configure no-quorum-
>> policy="ignore", else, your resources won't start with only one node (and
>> then, why using a cluster !). The default config is good with at least 3
>> nodes.
>>
> not sure where to set these options ..but did this and is current:
>
>
> root@deb1:/home/mjh# crm configure show
> node deb1
> node deb2
> primitive failover-ip ocf:heartbeat:IPaddr \
> params ip="192.168.2.113" \
> op monitor interval="10s"
> property $id="cib-bootstrap-options" \
> dc-version="1.0.9-74392a28b7f31d7ddc86689598bd23114f58978b" \
> cluster-infrastructure="openais" \
> expected-quorum-votes="2" \
> stonith-enabled="false"
>
>
> root@deb2:/home/mjh# crm configure show
> node deb1
> node deb2
> primitive failover-ip ocf:heartbeat:IPaddr \
> params ip="192.168.2.113" \
> op monitor interval="10s"
> property $id="cib-bootstrap-options" \
> dc-version="1.0.9-74392a28b7f31d7ddc86689598bd23114f58978b" \
> cluster-infrastructure="openais" \
> expected-quorum-votes="2" \
> stonith-enabled="false"
>
>
>>
>> Yes, the syslog, while very verbose, can certainly tell us why the resource
>> does not start.
>
> here is from one server :
>
>
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 130 to pending delivery queue
> Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_ais_dispatch: Update
> relayed from deb2
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
> update message from deb2: fail-count-failover-ip=INFINITY
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
> Supplied: INFINITY, Current: INFINITY, Stored: (null)
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 130
> Oct 24 16:58:54 deb1 crmd: [4807]: info: do_lrm_rsc_op: Performing
> key=1:44:0:35cceaf4-6158-4b51-8f26-0b0b92034da9 op=failover-ip_stop_0
> )
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback: New
> value of fail-count-failover-ip is INFINITY
> Oct 24 16:58:54 deb1 lrmd: [4804]: debug: on_msg_perform_op: add an
> operation operation stop[32] on ocf::IPaddr::failover-ip for client
> 4807, its parameters: crm_feature_set=[3.0.1] CRM_meta_timeout=[20000]
> to the operation list.
> Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_trigger_update:
> Sending flush op to all hosts for: fail-count-failover-ip (INFINITY)
> Oct 24 16:58:54 deb1 lrmd: [4804]: info: rsc:failover-ip:32: stop
> Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_perform_update:
> Delaying operation fail-count-failover-ip=INFINITY: cib not connected
> Oct 24 16:58:54 deb1 lrmd: [5285]: debug: perform_ra_op: resetting
> scheduler class to SCHED_OTHER
> Oct 24 16:58:54 deb1 crmd: [4807]: debug: attrd_update: Sent update:
> probe_complete=true for localhost
> Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_ais_dispatch: Update
> relayed from deb2
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
> update message from deb2: last-failure-failover-ip=1319489934
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
> Supplied: 1319489934, Current: 1319489934, Stored: (null)
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback: New
> value of last-failure-failover-ip is 1319489934
> Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_trigger_update:
> Sending flush op to all hosts for: last-failure-failover-ip
> (1319489934)
> Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_perform_update:
> Delaying operation last-failure-failover-ip=1319489934: cib not
> connected
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
> update message from crmd: probe_complete=true
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
> Supplied: true, Current: true, Stored: (null)
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback: New
> value of probe_complete is true
> Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_trigger_update:
> Sending flush op to all hosts for: probe_complete (true)
> Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_perform_update:
> Delaying operation probe_complete=true: cib not connected
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 130 to 132
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 131 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 132 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 131
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 132
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 132
> Oct 24 16:58:54 deb1 lrmd: [4804]: info: Managed failover-ip:stop
> process 5285 exited with return code 0.
> Oct 24 16:58:54 deb1 crmd: [4807]: info: process_lrm_event: LRM
> operation failover-ip_stop_0 (call=32, rc=0, cib-update=37,
> confirmed=true) ok
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 132 to 134
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 133 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 134 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 133
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 134
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 134
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 135
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 134 to 135
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 135 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 136
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 135 to 136
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 136 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 137
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 136 to 137
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 137 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 136
> Oct 24 16:58:54 deb1 crmd: [4807]: info: do_lrm_rsc_op: Performing
> key=6:44:0:35cceaf4-6158-4b51-8f26-0b0b92034da9 op=failover-ip_start_0
> )
> Oct 24 16:58:54 deb1 lrmd: [4804]: debug: on_msg_perform_op:2359:
> copying parameters for rsc failover-ip
> Oct 24 16:58:54 deb1 lrmd: [4804]: debug: on_msg_perform_op: add an
> operation operation start[33] on ocf::IPaddr::failover-ip for client
> 4807, its parameters: ip=[192.168.2.113] crm_feature_set=[3.0.1]
> CRM_meta_timeout=[20000] to the operation list.
> Oct 24 16:58:54 deb1 lrmd: [4804]: info: rsc:failover-ip:33: start
> Oct 24 16:58:54 deb1 lrmd: [5292]: debug: perform_ra_op: resetting
> scheduler class to SCHED_OTHER
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 137
> Oct 24 16:58:54 deb1 lrmd: [4804]: info: RA output:
> (failover-ip:start:stderr) ERROR: Cannot use default route w/o netmask
> [192.168.2.113]
> Oct 24 16:58:54 deb1 IPaddr[5292]: ERROR: /usr/lib/heartbeat/findif
> failed [rc=1].
> Oct 24 16:58:54 deb1 lrmd: [4804]: WARN: Managed failover-ip:start
> process 5292 exited with return code 1.
> Oct 24 16:58:54 deb1 crmd: [4807]: info: process_lrm_event: LRM
> operation failover-ip_start_0 (call=33, rc=1, cib-update=38,
> confirmed=true) unknown error
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 137 to 139
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 138 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 139 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 138
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 139
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 139
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 13a
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 139 to 13a
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 13a to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 13b
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 13a to 13b
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 13b to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 13c
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 13b to 13c
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 13c to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 13b
> Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_ais_dispatch: Update
> relayed from deb2
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
> update message from deb2: fail-count-failover-ip=INFINITY
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 13d
> Oct 24 16:58:54 deb1 crmd: [4807]: info: do_lrm_rsc_op: Performing
> key=1:45:0:35cceaf4-6158-4b51-8f26-0b0b92034da9 op=failover-ip_stop_0
> )
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
> Supplied: INFINITY, Current: INFINITY, Stored: (null)
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 13c to 13d
> Oct 24 16:58:54 deb1 lrmd: [4804]: debug: on_msg_perform_op: add an
> operation operation stop[34] on ocf::IPaddr::failover-ip for client
> 4807, its parameters: crm_feature_set=[3.0.1] CRM_meta_timeout=[20000]
> to the operation list.
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback: New
> value of fail-count-failover-ip is INFINITY
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 13d to pending delivery queue
> Oct 24 16:58:54 deb1 lrmd: [4804]: info: rsc:failover-ip:34: stop
> Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_trigger_update:
> Sending flush op to all hosts for: fail-count-failover-ip (INFINITY)
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 13e
> Oct 24 16:58:54 deb1 lrmd: [5316]: debug: perform_ra_op: resetting
> scheduler class to SCHED_OTHER
> Oct 24 16:58:54 deb1 crmd: [4807]: debug: attrd_update: Sent update:
> probe_complete=true for localhost
> Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_perform_update:
> Delaying operation fail-count-failover-ip=INFINITY: cib not connected
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 13d to 13e
> Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_ais_dispatch: Update
> relayed from deb2
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 13e to pending delivery queue
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
> update message from deb2: last-failure-failover-ip=1319489934
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 13f
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
> Supplied: 1319489934, Current: 1319489934, Stored: (null)
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 13e to 13f
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback: New
> value of last-failure-failover-ip is 1319489934
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 13f to pending delivery queue
> Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_trigger_update:
> Sending flush op to all hosts for: last-failure-failover-ip
> (1319489934)
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 13c
> Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_perform_update:
> Delaying operation last-failure-failover-ip=1319489934: cib not
> connected
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 13f
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
> update message from crmd: probe_complete=true
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
> Supplied: true, Current: true, Stored: (null)
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 13f to 140
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback: New
> value of probe_complete is true
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 140 to pending delivery queue
> Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_trigger_update:
> Sending flush op to all hosts for: probe_complete (true)
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 140
> Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_perform_update:
> Delaying operation probe_complete=true: cib not connected
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 140
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 140 to 141
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 141 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 141
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 141 to 142
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 142 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 142
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 141
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 142
> Oct 24 16:58:54 deb1 lrmd: [4804]: info: Managed failover-ip:stop
> process 5316 exited with return code 0.
> Oct 24 16:58:54 deb1 crmd: [4807]: info: process_lrm_event: LRM
> operation failover-ip_stop_0 (call=34, rc=0, cib-update=39,
> confirmed=true) ok
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 142 to 144
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 143 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 144 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 143
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 144
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 144
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 145
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 144 to 145
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 145 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 146
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 145 to 146
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 146 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 147
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 146 to 147
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 147 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 146
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 147
> Oct 24 16:58:54 deb1 crmd: [4807]: info: do_lrm_rsc_op: Performing
> key=6:45:0:35cceaf4-6158-4b51-8f26-0b0b92034da9 op=failover-ip_start_0
> )
> Oct 24 16:58:54 deb1 lrmd: [4804]: debug: on_msg_perform_op:2359:
> copying parameters for rsc failover-ip
> Oct 24 16:58:54 deb1 lrmd: [4804]: debug: on_msg_perform_op: add an
> operation operation start[35] on ocf::IPaddr::failover-ip for client
> 4807, its parameters: ip=[192.168.2.113] crm_feature_set=[3.0.1]
> CRM_meta_timeout=[20000] to the operation list.
> Oct 24 16:58:54 deb1 lrmd: [4804]: info: rsc:failover-ip:35: start
> Oct 24 16:58:54 deb1 lrmd: [5323]: debug: perform_ra_op: resetting
> scheduler class to SCHED_OTHER
> Oct 24 16:58:54 deb1 lrmd: [4804]: info: RA output:
> (failover-ip:start:stderr) ERROR: Cannot use default route w/o netmask
> [192.168.2.113]
> Oct 24 16:58:54 deb1 IPaddr[5323]: ERROR: /usr/lib/heartbeat/findif
> failed [rc=1].
> Oct 24 16:58:54 deb1 lrmd: [4804]: WARN: Managed failover-ip:start
> process 5323 exited with return code 1.
> Oct 24 16:58:54 deb1 crmd: [4807]: info: process_lrm_event: LRM
> operation failover-ip_start_0 (call=35, rc=1, cib-update=40,
> confirmed=true) unknown error
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 147 to 149
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 148 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 149 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 148
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 149
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 149
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 14a
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 149 to 14a
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 14a to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 14b
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 14a to 14b
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 14b to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 14c
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 14b to 14c
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 14c to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 14b
> Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_ais_dispatch: Update
> relayed from deb2
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
> update message from deb2: fail-count-failover-ip=INFINITY
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
> Supplied: INFINITY, Current: INFINITY, Stored: (null)
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback: New
> value of fail-count-failover-ip is INFINITY
> Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_trigger_update:
> Sending flush op to all hosts for: fail-count-failover-ip (INFINITY)
> Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_perform_update:
> Delaying operation fail-count-failover-ip=INFINITY: cib not connected
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 14d
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 14c to 14d
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 14d to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 14e
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 14d to 14e
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 14e to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 14f
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 14e to 14f
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 14f to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 14c
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 14f to 150
> Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_ais_dispatch: Update
> relayed from deb2
> Oct 24 16:58:54 deb1 crmd: [4807]: info: do_lrm_rsc_op: Performing
> key=1:46:0:35cceaf4-6158-4b51-8f26-0b0b92034da9 op=failover-ip_stop_0
> )
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 150 to pending delivery queue
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
> update message from deb2: last-failure-failover-ip=1319489934
> Oct 24 16:58:54 deb1 lrmd: [4804]: debug: on_msg_perform_op: add an
> operation operation stop[36] on ocf::IPaddr::failover-ip for client
> 4807, its parameters: crm_feature_set=[3.0.1] CRM_meta_timeout=[20000]
> to the operation list.
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 150
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
> Supplied: 1319489934, Current: 1319489934, Stored: (null)
> Oct 24 16:58:54 deb1 lrmd: [4804]: info: rsc:failover-ip:36: stop
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 14f
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback: New
> value of last-failure-failover-ip is 1319489934
> Oct 24 16:58:54 deb1 lrmd: [5347]: debug: perform_ra_op: resetting
> scheduler class to SCHED_OTHER
> Oct 24 16:58:54 deb1 crmd: [4807]: debug: attrd_update: Sent update:
> probe_complete=true for localhost
> Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_trigger_update:
> Sending flush op to all hosts for: last-failure-failover-ip
> (1319489934)
> Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_perform_update:
> Delaying operation last-failure-failover-ip=1319489934: cib not
> connected
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
> update message from crmd: probe_complete=true
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
> Supplied: true, Current: true, Stored: (null)
> Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback: New
> value of probe_complete is true
> Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_trigger_update:
> Sending flush op to all hosts for: probe_complete (true)
> Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_perform_update:
> Delaying operation probe_complete=true: cib not connected
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 150
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 150 to 152
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 151 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 152 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 151
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 152
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 152
> Oct 24 16:58:54 deb1 lrmd: [4804]: info: Managed failover-ip:stop
> process 5347 exited with return code 0.
> Oct 24 16:58:54 deb1 crmd: [4807]: info: process_lrm_event: LRM
> operation failover-ip_stop_0 (call=36, rc=0, cib-update=41,
> confirmed=true) ok
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 152 to 154
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 153 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 154 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 153
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 154
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 154
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 155
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 154 to 155
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 155 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 156
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 155 to 156
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 156 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 157
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 156 to 157
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 157 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 156
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 157
> Oct 24 16:58:54 deb1 crmd: [4807]: info: do_lrm_rsc_op: Performing
> key=6:46:0:35cceaf4-6158-4b51-8f26-0b0b92034da9 op=failover-ip_start_0
> )
> Oct 24 16:58:54 deb1 lrmd: [4804]: debug: on_msg_perform_op:2359:
> copying parameters for rsc failover-ip
> Oct 24 16:58:54 deb1 lrmd: [4804]: debug: on_msg_perform_op: add an
> operation operation start[37] on ocf::IPaddr::failover-ip for client
> 4807, its parameters: ip=[192.168.2.113] crm_feature_set=[3.0.1]
> CRM_meta_timeout=[20000] to the operation list.
> Oct 24 16:58:54 deb1 lrmd: [4804]: info: rsc:failover-ip:37: start
> Oct 24 16:58:54 deb1 lrmd: [5354]: debug: perform_ra_op: resetting
> scheduler class to SCHED_OTHER
> Oct 24 16:58:54 deb1 lrmd: [4804]: info: RA output:
> (failover-ip:start:stderr) ERROR: Cannot use default route w/o netmask
> [192.168.2.113]
> Oct 24 16:58:54 deb1 IPaddr[5354]: ERROR: /usr/lib/heartbeat/findif
> failed [rc=1].
> Oct 24 16:58:54 deb1 lrmd: [4804]: WARN: Managed failover-ip:start
> process 5354 exited with return code 1.
> Oct 24 16:58:54 deb1 crmd: [4807]: info: process_lrm_event: LRM
> operation failover-ip_start_0 (call=37, rc=1, cib-update=42,
> confirmed=true) unknown error
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering 157 to 159
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 158 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 159 to pending delivery queue
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 158
> Oct 24 16:58:54 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 159
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 15a
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 159 to 15a
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 15a to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 15b
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 15a to 15b
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 15b to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 159
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 15c
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 15b to 15c
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 15c to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 15d
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 15c to 15d
> Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_ais_dispatch: Update
> relayed from deb2
> Oct 24 16:58:55 deb1 crmd: [4807]: info: do_lrm_rsc_op: Performing
> key=1:47:0:35cceaf4-6158-4b51-8f26-0b0b92034da9 op=failover-ip_stop_0
> )
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 15d to pending delivery queue
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback:
> update message from deb2: fail-count-failover-ip=INFINITY
> Oct 24 16:58:55 deb1 lrmd: [4804]: debug: on_msg_perform_op: add an
> operation operation stop[38] on ocf::IPaddr::failover-ip for client
> 4807, its parameters: crm_feature_set=[3.0.1] CRM_meta_timeout=[20000]
> to the operation list.
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 15b
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback:
> Supplied: INFINITY, Current: INFINITY, Stored: (null)
> Oct 24 16:58:55 deb1 lrmd: [4804]: info: rsc:failover-ip:38: stop
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 15e
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback: New
> value of fail-count-failover-ip is INFINITY
> Oct 24 16:58:55 deb1 lrmd: [5378]: debug: perform_ra_op: resetting
> scheduler class to SCHED_OTHER
> Oct 24 16:58:55 deb1 crmd: [4807]: debug: attrd_update: Sent update:
> probe_complete=true for localhost
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 15d to 15e
> Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_trigger_update:
> Sending flush op to all hosts for: fail-count-failover-ip (INFINITY)
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 15e to pending delivery queue
> Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_perform_update:
> Delaying operation fail-count-failover-ip=INFINITY: cib not connected
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 15f
> Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_ais_dispatch: Update
> relayed from deb2
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 15e to 15f
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback:
> update message from deb2: last-failure-failover-ip=1319489934
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 15f to pending delivery queue
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback:
> Supplied: 1319489934, Current: 1319489934, Stored: (null)
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 15d
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback: New
> value of last-failure-failover-ip is 1319489934
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 15f
> Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_trigger_update:
> Sending flush op to all hosts for: last-failure-failover-ip
> (1319489934)
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_perform_update:
> Delaying operation last-failure-failover-ip=1319489934: cib not
> connected
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 15f to 160
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback:
> update message from crmd: probe_complete=true
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 160 to pending delivery queue
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback:
> Supplied: true, Current: true, Stored: (null)
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 160
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback: New
> value of probe_complete is true
> Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_trigger_update:
> Sending flush op to all hosts for: probe_complete (true)
> Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_perform_update:
> Delaying operation probe_complete=true: cib not connected
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 160
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 160 to 162
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 161 to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 162 to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 161
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 162
> Oct 24 16:58:55 deb1 lrmd: [4804]: info: Managed failover-ip:stop
> process 5378 exited with return code 0.
> Oct 24 16:58:55 deb1 crmd: [4807]: info: process_lrm_event: LRM
> operation failover-ip_stop_0 (call=38, rc=0, cib-update=43,
> confirmed=true) ok
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 162
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 162 to 164
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 163 to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 164 to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 163
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 164
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 164
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 165
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 164 to 165
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 165 to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 166
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 165 to 166
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 166 to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 167
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 166 to 167
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 167 to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 166
> Oct 24 16:58:55 deb1 crmd: [4807]: info: do_lrm_rsc_op: Performing
> key=6:47:0:35cceaf4-6158-4b51-8f26-0b0b92034da9 op=failover-ip_start_0
> )
> Oct 24 16:58:55 deb1 lrmd: [4804]: debug: on_msg_perform_op:2359:
> copying parameters for rsc failover-ip
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 167
> Oct 24 16:58:55 deb1 lrmd: [4804]: debug: on_msg_perform_op: add an
> operation operation start[39] on ocf::IPaddr::failover-ip for client
> 4807, its parameters: ip=[192.168.2.113] crm_feature_set=[3.0.1]
> CRM_meta_timeout=[20000] to the operation list.
> Oct 24 16:58:55 deb1 lrmd: [4804]: info: rsc:failover-ip:39: start
> Oct 24 16:58:55 deb1 lrmd: [5385]: debug: perform_ra_op: resetting
> scheduler class to SCHED_OTHER
> Oct 24 16:58:55 deb1 lrmd: [4804]: info: RA output:
> (failover-ip:start:stderr) ERROR: Cannot use default route w/o netmask
> [192.168.2.113]
> Oct 24 16:58:55 deb1 IPaddr[5385]: ERROR: /usr/lib/heartbeat/findif
> failed [rc=1].
> Oct 24 16:58:55 deb1 lrmd: [4804]: WARN: Managed failover-ip:start
> process 5385 exited with return code 1.
> Oct 24 16:58:55 deb1 crmd: [4807]: info: process_lrm_event: LRM
> operation failover-ip_start_0 (call=39, rc=1, cib-update=44,
> confirmed=true) unknown error
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 167 to 169
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 168 to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 169 to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 168
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 169
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 169
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 16a
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 169 to 16a
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 16a to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 16b
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 16a to 16b
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 16b to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 16c
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 16b to 16c
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 16c to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 16d
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 16c to 16d
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 16d to pending delivery queue
> Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_ais_dispatch: Update
> relayed from deb2
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 16b
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback:
> update message from deb2: fail-count-failover-ip=INFINITY
> Oct 24 16:58:55 deb1 crmd: [4807]: info: do_lrm_rsc_op: Performing
> key=1:48:0:35cceaf4-6158-4b51-8f26-0b0b92034da9 op=failover-ip_stop_0
> )
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 16e
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback:
> Supplied: INFINITY, Current: INFINITY, Stored: (null)
> Oct 24 16:58:55 deb1 lrmd: [4804]: debug: on_msg_perform_op: add an
> operation operation stop[40] on ocf::IPaddr::failover-ip for client
> 4807, its parameters: crm_feature_set=[3.0.1] CRM_meta_timeout=[20000]
> to the operation list.
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 16d to 16e
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback: New
> value of fail-count-failover-ip is INFINITY
> Oct 24 16:58:55 deb1 lrmd: [4804]: info: rsc:failover-ip:40: stop
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 16e to pending delivery queue
> Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_trigger_update:
> Sending flush op to all hosts for: fail-count-failover-ip (INFINITY)
> Oct 24 16:58:55 deb1 lrmd: [5409]: debug: perform_ra_op: resetting
> scheduler class to SCHED_OTHER
> Oct 24 16:58:55 deb1 crmd: [4807]: debug: attrd_update: Sent update:
> probe_complete=true for localhost
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 16f
> Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_perform_update:
> Delaying operation fail-count-failover-ip=INFINITY: cib not connected
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 16e to 16f
> Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_ais_dispatch: Update
> relayed from deb2
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 16f to pending delivery queue
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback:
> update message from deb2: last-failure-failover-ip=1319489935
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 16d
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback:
> Supplied: 1319489935, Current: 1319489934, Stored: (null)
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 16f
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback: New
> value of last-failure-failover-ip is 1319489935
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_trigger_update:
> Sending flush op to all hosts for: last-failure-failover-ip
> (1319489935)
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 16f to 170
> Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_perform_update:
> Delaying operation last-failure-failover-ip=1319489935: cib not
> connected
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 170 to pending delivery queue
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback:
> update message from crmd: probe_complete=true
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 170
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback:
> Supplied: true, Current: true, Stored: (null)
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 170
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback: New
> value of probe_complete is true
> Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_trigger_update:
> Sending flush op to all hosts for: probe_complete (true)
> Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_perform_update:
> Delaying operation probe_complete=true: cib not connected
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 170 to 172
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 171 to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 172 to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 171
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 172
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 172
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: cib_connect: CIB signon attempt 1
> Oct 24 16:58:55 deb1 attrd: [4805]: debug:
> init_client_ipc_comms_nodispatch: Attempting to talk on:
> /var/run/crm/cib_rw
> Oct 24 16:58:55 deb1 attrd: [4805]: debug:
> init_client_ipc_comms_nodispatch: Attempting to talk on:
> /var/run/crm/cib_callback
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: cib_native_signon_raw:
> Connection to CIB successful
> Oct 24 16:58:55 deb1 attrd: [4805]: info: cib_connect: Connected to
> the CIB after 1 signon attempts
> Oct 24 16:58:55 deb1 attrd: [4805]: info: cib_connect: Sending full refresh
> Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_trigger_update:
> Sending flush op to all hosts for: shutdown (<null>)
> Oct 24 16:58:55 deb1 cib: [4803]: debug: cib_process_xpath: cib_query:
> //cib/status//node_state[@id='deb1']//nvpair[@name='shutdown'] does
> not exist
> Oct 24 16:58:55 deb1 cib: [4803]: debug: cib_common_callback_worker:
> Setting cib_refresh_notify callbacks for 4805
> (dac90f01-f8f6-4200-8fe1-8057ae9f243c): on
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_cib_callback: Update
> -22 for shutdown=(null) passed
> Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_trigger_update:
> Sending flush op to all hosts for: fail-count-failover-ip (INFINITY)
> Oct 24 16:58:55 deb1 cib: [4803]: debug: cib_process_xpath: cib_query:
> //cib/status//node_state[@id='deb1']//nvpair[@name='fail-count-failover-ip']
> does not exist
> Oct 24 16:58:55 deb1 cib: [4803]: debug: cib_process_xpath: Processing
> cib_query op for /cib (/cib)
> Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_perform_update: Sent
> update 5: fail-count-failover-ip=INFINITY
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_trigger_update:
> Sending flush op to all hosts for: terminate (<null>)
> Oct 24 16:58:55 deb1 cib: [4803]: debug: cib_process_xpath: cib_query:
> //cib/status//node_state[@id='deb1']//nvpair[@name='terminate'] does
> not exist
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_cib_callback: Update
> -22 for terminate=(null) passed
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_trigger_update:
> Sending flush op to all hosts for: last-failure-failover-ip
> (1319489935)
> Oct 24 16:58:55 deb1 cib: [4803]: debug: cib_process_xpath: cib_query:
> //cib/status//node_state[@id='deb1']//nvpair[@name='last-failure-failover-ip']
> does not exist
> Oct 24 16:58:55 deb1 cib: [4803]: debug: cib_process_xpath: Processing
> cib_query op for /cib (/cib)
> Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_perform_update: Sent
> update 9: last-failure-failover-ip=1319489935
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_trigger_update:
> Sending flush op to all hosts for: probe_complete (true)
> Oct 24 16:58:55 deb1 cib: [4803]: debug: cib_process_xpath: cib_query:
> //cib/status//node_state[@id='deb1']//nvpair[@name='probe_complete']
> does not exist
> Oct 24 16:58:55 deb1 cib: [4803]: debug: cib_process_xpath: Processing
> cib_query op for /cib (/cib)
> Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_perform_update: Sent
> update 12: probe_complete=true
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:55 deb1 lrmd: [4804]: info: Managed failover-ip:stop
> process 5409 exited with return code 0.
> Oct 24 16:58:55 deb1 crmd: [4807]: info: process_lrm_event: LRM
> operation failover-ip_stop_0 (call=40, rc=0, cib-update=45,
> confirmed=true) ok
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] mcasted message added
> to pending queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 172 to 179
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 173 to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 174 to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 175 to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 176 to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 177 to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 178 to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 179 to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 173
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 174
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 175
> Oct 24 16:58:55 deb1 cib: [4803]: debug: cib_process_xpath: cib_query:
> //cib/status//node_state[@id='deb1']//nvpair[@name='shutdown'] does
> not exist
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 176
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_cib_callback: Update
> -22 for shutdown=(null) passed
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 177
> Oct 24 16:58:55 deb1 cib: [4803]: debug: cib_process_xpath: cib_query:
> //cib/status//node_state[@id='deb1']//nvpair[@name='terminate'] does
> not exist
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 178
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_cib_callback: Update
> -22 for terminate=(null) passed
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 179
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 179
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 17a
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 179 to 17a
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 17a to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 17b
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 17a to 17b
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 17b to pending delivery queue
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_cib_callback: Update
> 5 for fail-count-failover-ip=INFINITY passed
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 17c
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 17b to 17c
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 17c to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 17d
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 17c to 17d
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_cib_callback: Update
> 9 for last-failure-failover-ip=1319489935 passed
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 17d to pending delivery queue
> Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_cib_callback: Update
> 12 for probe_complete=true passed
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 17b
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 17e
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 17d to 17e
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 17e to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 17f
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 17e to 17f
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 17f to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 180
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 17f to 180
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 180 to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Received
> ringid(192.168.2.110:108) seq 181
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering 180 to 181
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] Delivering MCAST
> message with seq 181 to pending delivery queue
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 17d
> Oct 24 16:58:55 deb1 corosync[4791]: [TOTEM ] releasing messages up
> to and including 181
>
>
>>
>> Are you sure that the IP address you configure in your failover-ip resource
>> can be brought up ? It's not already used or in another network ?
>>
>
> I have a very small network --- this ip is not being used at all.
> all i did was clone a vbox vm machine to another machine and installed.
> after installing - i realized the nic hardwares are the same do i did
> a refersh and restarted the machines.
>
> Do i have to stop network manager ? or do i have to do anything
> special for pacemaker and corosync ???
>
> thanks
> mjh
>
Reply to: