[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: new to pacemaker and heartbeat on debian...getting error..



>
> I'd say version 3 (1:3.0.3-2).
> But you have heartbeat and corosync installed, you must choose only one (I'd
> choose corosync).

Okay - choose corosync -- though pacemaker is installed - i can not
control it - meaning there is no init file in /etc/init.d directory -
but says installed.



> cibadmin is less readable than crm configure show.
>
> Here is mine, truncated and anonymised to show only one IPaddr resource :
>
> root@node1:~# crm configure show
> node node1 \
>        attributes standby="off"
> node node2 \
>        attributes standby="off"
> primitive res_IPaddr2_res1 ocf:heartbeat:IPaddr2 \
>        params ip="A.B.C.D" \
>        operations $id="res_IPaddr2_res1-operations" \
>        op start interval="0" timeout="20" \
>        op stop interval="0" timeout="20" \
>        op monitor interval="10" timeout="20" start-delay="0"
> property $id="cib-bootstrap-options" \
>        expected-quorum-votes="2" \
>        dc-version="1.0.11-6e010d6b0d49a6b929d17c0114e9d2d934dc8e04" \
>        no-quorum-policy="ignore" \
>        cluster-infrastructure="openais" \
>        last-lrm-refresh="1316614496" \
>        stonith-enabled="false"
>
> No clone primitive.
> Side note : With 2 nodes and 2 votes, you'd better configure no-quorum-
> policy="ignore", else, your resources won't start with only one node (and
> then, why using a cluster !). The default config is good with at least 3
> nodes.
>
not sure where to set these options ..but did this and is current:


root@deb1:/home/mjh#  crm configure show
node deb1
node deb2
primitive failover-ip ocf:heartbeat:IPaddr \
	params ip="192.168.2.113" \
	op monitor interval="10s"
property $id="cib-bootstrap-options" \
	dc-version="1.0.9-74392a28b7f31d7ddc86689598bd23114f58978b" \
	cluster-infrastructure="openais" \
	expected-quorum-votes="2" \
	stonith-enabled="false"


root@deb2:/home/mjh#  crm configure show
node deb1
node deb2
primitive failover-ip ocf:heartbeat:IPaddr \
	params ip="192.168.2.113" \
	op monitor interval="10s"
property $id="cib-bootstrap-options" \
	dc-version="1.0.9-74392a28b7f31d7ddc86689598bd23114f58978b" \
	cluster-infrastructure="openais" \
	expected-quorum-votes="2" \
	stonith-enabled="false"


>
> Yes, the syslog, while very verbose, can certainly tell us why the resource
> does not start.

here is from one server :


Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 130 to pending delivery queue
Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_ais_dispatch: Update
relayed from deb2
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
update message from deb2: fail-count-failover-ip=INFINITY
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
Supplied: INFINITY, Current: INFINITY, Stored: (null)
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 130
Oct 24 16:58:54 deb1 crmd: [4807]: info: do_lrm_rsc_op: Performing
key=1:44:0:35cceaf4-6158-4b51-8f26-0b0b92034da9 op=failover-ip_stop_0
)
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback: New
value of fail-count-failover-ip is INFINITY
Oct 24 16:58:54 deb1 lrmd: [4804]: debug: on_msg_perform_op: add an
operation operation stop[32] on ocf::IPaddr::failover-ip for client
4807, its parameters: crm_feature_set=[3.0.1] CRM_meta_timeout=[20000]
 to the operation list.
Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_trigger_update:
Sending flush op to all hosts for: fail-count-failover-ip (INFINITY)
Oct 24 16:58:54 deb1 lrmd: [4804]: info: rsc:failover-ip:32: stop
Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_perform_update:
Delaying operation fail-count-failover-ip=INFINITY: cib not connected
Oct 24 16:58:54 deb1 lrmd: [5285]: debug: perform_ra_op: resetting
scheduler class to SCHED_OTHER
Oct 24 16:58:54 deb1 crmd: [4807]: debug: attrd_update: Sent update:
probe_complete=true for localhost
Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_ais_dispatch: Update
relayed from deb2
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
update message from deb2: last-failure-failover-ip=1319489934
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
Supplied: 1319489934, Current: 1319489934, Stored: (null)
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback: New
value of last-failure-failover-ip is 1319489934
Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_trigger_update:
Sending flush op to all hosts for: last-failure-failover-ip
(1319489934)
Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_perform_update:
Delaying operation last-failure-failover-ip=1319489934: cib not
connected
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
update message from crmd: probe_complete=true
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
Supplied: true, Current: true, Stored: (null)
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback: New
value of probe_complete is true
Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_trigger_update:
Sending flush op to all hosts for: probe_complete (true)
Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_perform_update:
Delaying operation probe_complete=true: cib not connected
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 130 to 132
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 131 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 132 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 131
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 132
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 132
Oct 24 16:58:54 deb1 lrmd: [4804]: info: Managed failover-ip:stop
process 5285 exited with return code 0.
Oct 24 16:58:54 deb1 crmd: [4807]: info: process_lrm_event: LRM
operation failover-ip_stop_0 (call=32, rc=0, cib-update=37,
confirmed=true) ok
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 132 to 134
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 133 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 134 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 133
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 134
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 134
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 135
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 134 to 135
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 135 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 136
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 135 to 136
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 136 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 137
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 136 to 137
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 137 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 136
Oct 24 16:58:54 deb1 crmd: [4807]: info: do_lrm_rsc_op: Performing
key=6:44:0:35cceaf4-6158-4b51-8f26-0b0b92034da9 op=failover-ip_start_0
)
Oct 24 16:58:54 deb1 lrmd: [4804]: debug: on_msg_perform_op:2359:
copying parameters for rsc failover-ip
Oct 24 16:58:54 deb1 lrmd: [4804]: debug: on_msg_perform_op: add an
operation operation start[33] on ocf::IPaddr::failover-ip for client
4807, its parameters: ip=[192.168.2.113] crm_feature_set=[3.0.1]
CRM_meta_timeout=[20000]  to the operation list.
Oct 24 16:58:54 deb1 lrmd: [4804]: info: rsc:failover-ip:33: start
Oct 24 16:58:54 deb1 lrmd: [5292]: debug: perform_ra_op: resetting
scheduler class to SCHED_OTHER
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 137
Oct 24 16:58:54 deb1 lrmd: [4804]: info: RA output:
(failover-ip:start:stderr) ERROR: Cannot use default route w/o netmask
[192.168.2.113]
Oct 24 16:58:54 deb1 IPaddr[5292]: ERROR: /usr/lib/heartbeat/findif
failed [rc=1].
Oct 24 16:58:54 deb1 lrmd: [4804]: WARN: Managed failover-ip:start
process 5292 exited with return code 1.
Oct 24 16:58:54 deb1 crmd: [4807]: info: process_lrm_event: LRM
operation failover-ip_start_0 (call=33, rc=1, cib-update=38,
confirmed=true) unknown error
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 137 to 139
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 138 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 139 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 138
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 139
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 139
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 13a
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 139 to 13a
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 13a to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 13b
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 13a to 13b
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 13b to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 13c
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 13b to 13c
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 13c to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 13b
Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_ais_dispatch: Update
relayed from deb2
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
update message from deb2: fail-count-failover-ip=INFINITY
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 13d
Oct 24 16:58:54 deb1 crmd: [4807]: info: do_lrm_rsc_op: Performing
key=1:45:0:35cceaf4-6158-4b51-8f26-0b0b92034da9 op=failover-ip_stop_0
)
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
Supplied: INFINITY, Current: INFINITY, Stored: (null)
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 13c to 13d
Oct 24 16:58:54 deb1 lrmd: [4804]: debug: on_msg_perform_op: add an
operation operation stop[34] on ocf::IPaddr::failover-ip for client
4807, its parameters: crm_feature_set=[3.0.1] CRM_meta_timeout=[20000]
 to the operation list.
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback: New
value of fail-count-failover-ip is INFINITY
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 13d to pending delivery queue
Oct 24 16:58:54 deb1 lrmd: [4804]: info: rsc:failover-ip:34: stop
Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_trigger_update:
Sending flush op to all hosts for: fail-count-failover-ip (INFINITY)
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 13e
Oct 24 16:58:54 deb1 lrmd: [5316]: debug: perform_ra_op: resetting
scheduler class to SCHED_OTHER
Oct 24 16:58:54 deb1 crmd: [4807]: debug: attrd_update: Sent update:
probe_complete=true for localhost
Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_perform_update:
Delaying operation fail-count-failover-ip=INFINITY: cib not connected
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 13d to 13e
Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_ais_dispatch: Update
relayed from deb2
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 13e to pending delivery queue
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
update message from deb2: last-failure-failover-ip=1319489934
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 13f
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
Supplied: 1319489934, Current: 1319489934, Stored: (null)
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 13e to 13f
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback: New
value of last-failure-failover-ip is 1319489934
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 13f to pending delivery queue
Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_trigger_update:
Sending flush op to all hosts for: last-failure-failover-ip
(1319489934)
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 13c
Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_perform_update:
Delaying operation last-failure-failover-ip=1319489934: cib not
connected
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 13f
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
update message from crmd: probe_complete=true
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
Supplied: true, Current: true, Stored: (null)
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 13f to 140
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback: New
value of probe_complete is true
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 140 to pending delivery queue
Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_trigger_update:
Sending flush op to all hosts for: probe_complete (true)
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 140
Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_perform_update:
Delaying operation probe_complete=true: cib not connected
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 140
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 140 to 141
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 141 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 141
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 141 to 142
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 142 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 142
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 141
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 142
Oct 24 16:58:54 deb1 lrmd: [4804]: info: Managed failover-ip:stop
process 5316 exited with return code 0.
Oct 24 16:58:54 deb1 crmd: [4807]: info: process_lrm_event: LRM
operation failover-ip_stop_0 (call=34, rc=0, cib-update=39,
confirmed=true) ok
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 142 to 144
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 143 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 144 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 143
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 144
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 144
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 145
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 144 to 145
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 145 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 146
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 145 to 146
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 146 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 147
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 146 to 147
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 147 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 146
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 147
Oct 24 16:58:54 deb1 crmd: [4807]: info: do_lrm_rsc_op: Performing
key=6:45:0:35cceaf4-6158-4b51-8f26-0b0b92034da9 op=failover-ip_start_0
)
Oct 24 16:58:54 deb1 lrmd: [4804]: debug: on_msg_perform_op:2359:
copying parameters for rsc failover-ip
Oct 24 16:58:54 deb1 lrmd: [4804]: debug: on_msg_perform_op: add an
operation operation start[35] on ocf::IPaddr::failover-ip for client
4807, its parameters: ip=[192.168.2.113] crm_feature_set=[3.0.1]
CRM_meta_timeout=[20000]  to the operation list.
Oct 24 16:58:54 deb1 lrmd: [4804]: info: rsc:failover-ip:35: start
Oct 24 16:58:54 deb1 lrmd: [5323]: debug: perform_ra_op: resetting
scheduler class to SCHED_OTHER
Oct 24 16:58:54 deb1 lrmd: [4804]: info: RA output:
(failover-ip:start:stderr) ERROR: Cannot use default route w/o netmask
[192.168.2.113]
Oct 24 16:58:54 deb1 IPaddr[5323]: ERROR: /usr/lib/heartbeat/findif
failed [rc=1].
Oct 24 16:58:54 deb1 lrmd: [4804]: WARN: Managed failover-ip:start
process 5323 exited with return code 1.
Oct 24 16:58:54 deb1 crmd: [4807]: info: process_lrm_event: LRM
operation failover-ip_start_0 (call=35, rc=1, cib-update=40,
confirmed=true) unknown error
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 147 to 149
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 148 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 149 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 148
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 149
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 149
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 14a
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 149 to 14a
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 14a to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 14b
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 14a to 14b
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 14b to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 14c
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 14b to 14c
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 14c to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 14b
Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_ais_dispatch: Update
relayed from deb2
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
update message from deb2: fail-count-failover-ip=INFINITY
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
Supplied: INFINITY, Current: INFINITY, Stored: (null)
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback: New
value of fail-count-failover-ip is INFINITY
Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_trigger_update:
Sending flush op to all hosts for: fail-count-failover-ip (INFINITY)
Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_perform_update:
Delaying operation fail-count-failover-ip=INFINITY: cib not connected
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 14d
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 14c to 14d
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 14d to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 14e
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 14d to 14e
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 14e to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 14f
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 14e to 14f
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 14f to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 14c
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 14f to 150
Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_ais_dispatch: Update
relayed from deb2
Oct 24 16:58:54 deb1 crmd: [4807]: info: do_lrm_rsc_op: Performing
key=1:46:0:35cceaf4-6158-4b51-8f26-0b0b92034da9 op=failover-ip_stop_0
)
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 150 to pending delivery queue
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
update message from deb2: last-failure-failover-ip=1319489934
Oct 24 16:58:54 deb1 lrmd: [4804]: debug: on_msg_perform_op: add an
operation operation stop[36] on ocf::IPaddr::failover-ip for client
4807, its parameters: crm_feature_set=[3.0.1] CRM_meta_timeout=[20000]
 to the operation list.
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 150
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
Supplied: 1319489934, Current: 1319489934, Stored: (null)
Oct 24 16:58:54 deb1 lrmd: [4804]: info: rsc:failover-ip:36: stop
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 14f
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback: New
value of last-failure-failover-ip is 1319489934
Oct 24 16:58:54 deb1 lrmd: [5347]: debug: perform_ra_op: resetting
scheduler class to SCHED_OTHER
Oct 24 16:58:54 deb1 crmd: [4807]: debug: attrd_update: Sent update:
probe_complete=true for localhost
Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_trigger_update:
Sending flush op to all hosts for: last-failure-failover-ip
(1319489934)
Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_perform_update:
Delaying operation last-failure-failover-ip=1319489934: cib not
connected
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
update message from crmd: probe_complete=true
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback:
Supplied: true, Current: true, Stored: (null)
Oct 24 16:58:54 deb1 attrd: [4805]: debug: attrd_local_callback: New
value of probe_complete is true
Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_trigger_update:
Sending flush op to all hosts for: probe_complete (true)
Oct 24 16:58:54 deb1 attrd: [4805]: info: attrd_perform_update:
Delaying operation probe_complete=true: cib not connected
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 150
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 150 to 152
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 151 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 152 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 151
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 152
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 152
Oct 24 16:58:54 deb1 lrmd: [4804]: info: Managed failover-ip:stop
process 5347 exited with return code 0.
Oct 24 16:58:54 deb1 crmd: [4807]: info: process_lrm_event: LRM
operation failover-ip_stop_0 (call=36, rc=0, cib-update=41,
confirmed=true) ok
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 152 to 154
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 153 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 154 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 153
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 154
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 154
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 155
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 154 to 155
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 155 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 156
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 155 to 156
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 156 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 157
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 156 to 157
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 157 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 156
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 157
Oct 24 16:58:54 deb1 crmd: [4807]: info: do_lrm_rsc_op: Performing
key=6:46:0:35cceaf4-6158-4b51-8f26-0b0b92034da9 op=failover-ip_start_0
)
Oct 24 16:58:54 deb1 lrmd: [4804]: debug: on_msg_perform_op:2359:
copying parameters for rsc failover-ip
Oct 24 16:58:54 deb1 lrmd: [4804]: debug: on_msg_perform_op: add an
operation operation start[37] on ocf::IPaddr::failover-ip for client
4807, its parameters: ip=[192.168.2.113] crm_feature_set=[3.0.1]
CRM_meta_timeout=[20000]  to the operation list.
Oct 24 16:58:54 deb1 lrmd: [4804]: info: rsc:failover-ip:37: start
Oct 24 16:58:54 deb1 lrmd: [5354]: debug: perform_ra_op: resetting
scheduler class to SCHED_OTHER
Oct 24 16:58:54 deb1 lrmd: [4804]: info: RA output:
(failover-ip:start:stderr) ERROR: Cannot use default route w/o netmask
[192.168.2.113]
Oct 24 16:58:54 deb1 IPaddr[5354]: ERROR: /usr/lib/heartbeat/findif
failed [rc=1].
Oct 24 16:58:54 deb1 lrmd: [4804]: WARN: Managed failover-ip:start
process 5354 exited with return code 1.
Oct 24 16:58:54 deb1 crmd: [4807]: info: process_lrm_event: LRM
operation failover-ip_start_0 (call=37, rc=1, cib-update=42,
confirmed=true) unknown error
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering 157 to 159
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 158 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 159 to pending delivery queue
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 158
Oct 24 16:58:54 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 159
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 15a
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 159 to 15a
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 15a to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 15b
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 15a to 15b
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 15b to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 159
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 15c
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 15b to 15c
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 15c to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 15d
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 15c to 15d
Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_ais_dispatch: Update
relayed from deb2
Oct 24 16:58:55 deb1 crmd: [4807]: info: do_lrm_rsc_op: Performing
key=1:47:0:35cceaf4-6158-4b51-8f26-0b0b92034da9 op=failover-ip_stop_0
)
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 15d to pending delivery queue
Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback:
update message from deb2: fail-count-failover-ip=INFINITY
Oct 24 16:58:55 deb1 lrmd: [4804]: debug: on_msg_perform_op: add an
operation operation stop[38] on ocf::IPaddr::failover-ip for client
4807, its parameters: crm_feature_set=[3.0.1] CRM_meta_timeout=[20000]
 to the operation list.
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 15b
Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback:
Supplied: INFINITY, Current: INFINITY, Stored: (null)
Oct 24 16:58:55 deb1 lrmd: [4804]: info: rsc:failover-ip:38: stop
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 15e
Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback: New
value of fail-count-failover-ip is INFINITY
Oct 24 16:58:55 deb1 lrmd: [5378]: debug: perform_ra_op: resetting
scheduler class to SCHED_OTHER
Oct 24 16:58:55 deb1 crmd: [4807]: debug: attrd_update: Sent update:
probe_complete=true for localhost
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 15d to 15e
Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_trigger_update:
Sending flush op to all hosts for: fail-count-failover-ip (INFINITY)
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 15e to pending delivery queue
Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_perform_update:
Delaying operation fail-count-failover-ip=INFINITY: cib not connected
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 15f
Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_ais_dispatch: Update
relayed from deb2
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 15e to 15f
Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback:
update message from deb2: last-failure-failover-ip=1319489934
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 15f to pending delivery queue
Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback:
Supplied: 1319489934, Current: 1319489934, Stored: (null)
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 15d
Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback: New
value of last-failure-failover-ip is 1319489934
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 15f
Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_trigger_update:
Sending flush op to all hosts for: last-failure-failover-ip
(1319489934)
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_perform_update:
Delaying operation last-failure-failover-ip=1319489934: cib not
connected
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 15f to 160
Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback:
update message from crmd: probe_complete=true
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 160 to pending delivery queue
Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback:
Supplied: true, Current: true, Stored: (null)
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 160
Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback: New
value of probe_complete is true
Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_trigger_update:
Sending flush op to all hosts for: probe_complete (true)
Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_perform_update:
Delaying operation probe_complete=true: cib not connected
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 160
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 160 to 162
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 161 to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 162 to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 161
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 162
Oct 24 16:58:55 deb1 lrmd: [4804]: info: Managed failover-ip:stop
process 5378 exited with return code 0.
Oct 24 16:58:55 deb1 crmd: [4807]: info: process_lrm_event: LRM
operation failover-ip_stop_0 (call=38, rc=0, cib-update=43,
confirmed=true) ok
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 162
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 162 to 164
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 163 to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 164 to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 163
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 164
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 164
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 165
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 164 to 165
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 165 to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 166
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 165 to 166
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 166 to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 167
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 166 to 167
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 167 to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 166
Oct 24 16:58:55 deb1 crmd: [4807]: info: do_lrm_rsc_op: Performing
key=6:47:0:35cceaf4-6158-4b51-8f26-0b0b92034da9 op=failover-ip_start_0
)
Oct 24 16:58:55 deb1 lrmd: [4804]: debug: on_msg_perform_op:2359:
copying parameters for rsc failover-ip
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 167
Oct 24 16:58:55 deb1 lrmd: [4804]: debug: on_msg_perform_op: add an
operation operation start[39] on ocf::IPaddr::failover-ip for client
4807, its parameters: ip=[192.168.2.113] crm_feature_set=[3.0.1]
CRM_meta_timeout=[20000]  to the operation list.
Oct 24 16:58:55 deb1 lrmd: [4804]: info: rsc:failover-ip:39: start
Oct 24 16:58:55 deb1 lrmd: [5385]: debug: perform_ra_op: resetting
scheduler class to SCHED_OTHER
Oct 24 16:58:55 deb1 lrmd: [4804]: info: RA output:
(failover-ip:start:stderr) ERROR: Cannot use default route w/o netmask
[192.168.2.113]
Oct 24 16:58:55 deb1 IPaddr[5385]: ERROR: /usr/lib/heartbeat/findif
failed [rc=1].
Oct 24 16:58:55 deb1 lrmd: [4804]: WARN: Managed failover-ip:start
process 5385 exited with return code 1.
Oct 24 16:58:55 deb1 crmd: [4807]: info: process_lrm_event: LRM
operation failover-ip_start_0 (call=39, rc=1, cib-update=44,
confirmed=true) unknown error
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 167 to 169
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 168 to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 169 to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 168
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 169
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 169
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 16a
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 169 to 16a
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 16a to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 16b
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 16a to 16b
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 16b to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 16c
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 16b to 16c
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 16c to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 16d
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 16c to 16d
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 16d to pending delivery queue
Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_ais_dispatch: Update
relayed from deb2
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 16b
Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback:
update message from deb2: fail-count-failover-ip=INFINITY
Oct 24 16:58:55 deb1 crmd: [4807]: info: do_lrm_rsc_op: Performing
key=1:48:0:35cceaf4-6158-4b51-8f26-0b0b92034da9 op=failover-ip_stop_0
)
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 16e
Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback:
Supplied: INFINITY, Current: INFINITY, Stored: (null)
Oct 24 16:58:55 deb1 lrmd: [4804]: debug: on_msg_perform_op: add an
operation operation stop[40] on ocf::IPaddr::failover-ip for client
4807, its parameters: crm_feature_set=[3.0.1] CRM_meta_timeout=[20000]
 to the operation list.
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 16d to 16e
Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback: New
value of fail-count-failover-ip is INFINITY
Oct 24 16:58:55 deb1 lrmd: [4804]: info: rsc:failover-ip:40: stop
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 16e to pending delivery queue
Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_trigger_update:
Sending flush op to all hosts for: fail-count-failover-ip (INFINITY)
Oct 24 16:58:55 deb1 lrmd: [5409]: debug: perform_ra_op: resetting
scheduler class to SCHED_OTHER
Oct 24 16:58:55 deb1 crmd: [4807]: debug: attrd_update: Sent update:
probe_complete=true for localhost
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 16f
Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_perform_update:
Delaying operation fail-count-failover-ip=INFINITY: cib not connected
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 16e to 16f
Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_ais_dispatch: Update
relayed from deb2
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 16f to pending delivery queue
Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback:
update message from deb2: last-failure-failover-ip=1319489935
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 16d
Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback:
Supplied: 1319489935, Current: 1319489934, Stored: (null)
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 16f
Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback: New
value of last-failure-failover-ip is 1319489935
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_trigger_update:
Sending flush op to all hosts for: last-failure-failover-ip
(1319489935)
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 16f to 170
Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_perform_update:
Delaying operation last-failure-failover-ip=1319489935: cib not
connected
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 170 to pending delivery queue
Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback:
update message from crmd: probe_complete=true
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 170
Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback:
Supplied: true, Current: true, Stored: (null)
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 170
Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_local_callback: New
value of probe_complete is true
Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_trigger_update:
Sending flush op to all hosts for: probe_complete (true)
Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_perform_update:
Delaying operation probe_complete=true: cib not connected
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 170 to 172
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 171 to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 172 to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 171
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 172
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 172
Oct 24 16:58:55 deb1 attrd: [4805]: debug: cib_connect: CIB signon attempt 1
Oct 24 16:58:55 deb1 attrd: [4805]: debug:
init_client_ipc_comms_nodispatch: Attempting to talk on:
/var/run/crm/cib_rw
Oct 24 16:58:55 deb1 attrd: [4805]: debug:
init_client_ipc_comms_nodispatch: Attempting to talk on:
/var/run/crm/cib_callback
Oct 24 16:58:55 deb1 attrd: [4805]: debug: cib_native_signon_raw:
Connection to CIB successful
Oct 24 16:58:55 deb1 attrd: [4805]: info: cib_connect: Connected to
the CIB after 1 signon attempts
Oct 24 16:58:55 deb1 attrd: [4805]: info: cib_connect: Sending full refresh
Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_trigger_update:
Sending flush op to all hosts for: shutdown (<null>)
Oct 24 16:58:55 deb1 cib: [4803]: debug: cib_process_xpath: cib_query:
//cib/status//node_state[@id='deb1']//nvpair[@name='shutdown'] does
not exist
Oct 24 16:58:55 deb1 cib: [4803]: debug: cib_common_callback_worker:
Setting cib_refresh_notify callbacks for 4805
(dac90f01-f8f6-4200-8fe1-8057ae9f243c): on
Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_cib_callback: Update
-22 for shutdown=(null) passed
Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_trigger_update:
Sending flush op to all hosts for: fail-count-failover-ip (INFINITY)
Oct 24 16:58:55 deb1 cib: [4803]: debug: cib_process_xpath: cib_query:
//cib/status//node_state[@id='deb1']//nvpair[@name='fail-count-failover-ip']
does not exist
Oct 24 16:58:55 deb1 cib: [4803]: debug: cib_process_xpath: Processing
cib_query op for /cib (/cib)
Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_perform_update: Sent
update 5: fail-count-failover-ip=INFINITY
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_trigger_update:
Sending flush op to all hosts for: terminate (<null>)
Oct 24 16:58:55 deb1 cib: [4803]: debug: cib_process_xpath: cib_query:
//cib/status//node_state[@id='deb1']//nvpair[@name='terminate'] does
not exist
Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_cib_callback: Update
-22 for terminate=(null) passed
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_trigger_update:
Sending flush op to all hosts for: last-failure-failover-ip
(1319489935)
Oct 24 16:58:55 deb1 cib: [4803]: debug: cib_process_xpath: cib_query:
//cib/status//node_state[@id='deb1']//nvpair[@name='last-failure-failover-ip']
does not exist
Oct 24 16:58:55 deb1 cib: [4803]: debug: cib_process_xpath: Processing
cib_query op for /cib (/cib)
Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_perform_update: Sent
update 9: last-failure-failover-ip=1319489935
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_trigger_update:
Sending flush op to all hosts for: probe_complete (true)
Oct 24 16:58:55 deb1 cib: [4803]: debug: cib_process_xpath: cib_query:
//cib/status//node_state[@id='deb1']//nvpair[@name='probe_complete']
does not exist
Oct 24 16:58:55 deb1 cib: [4803]: debug: cib_process_xpath: Processing
cib_query op for /cib (/cib)
Oct 24 16:58:55 deb1 attrd: [4805]: info: attrd_perform_update: Sent
update 12: probe_complete=true
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:55 deb1 lrmd: [4804]: info: Managed failover-ip:stop
process 5409 exited with return code 0.
Oct 24 16:58:55 deb1 crmd: [4807]: info: process_lrm_event: LRM
operation failover-ip_stop_0 (call=40, rc=0, cib-update=45,
confirmed=true) ok
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] mcasted message added
to pending queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 172 to 179
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 173 to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 174 to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 175 to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 176 to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 177 to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 178 to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 179 to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 173
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 174
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 175
Oct 24 16:58:55 deb1 cib: [4803]: debug: cib_process_xpath: cib_query:
//cib/status//node_state[@id='deb1']//nvpair[@name='shutdown'] does
not exist
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 176
Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_cib_callback: Update
-22 for shutdown=(null) passed
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 177
Oct 24 16:58:55 deb1 cib: [4803]: debug: cib_process_xpath: cib_query:
//cib/status//node_state[@id='deb1']//nvpair[@name='terminate'] does
not exist
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 178
Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_cib_callback: Update
-22 for terminate=(null) passed
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 179
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 179
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 17a
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 179 to 17a
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 17a to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 17b
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 17a to 17b
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 17b to pending delivery queue
Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_cib_callback: Update
5 for fail-count-failover-ip=INFINITY passed
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 17c
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 17b to 17c
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 17c to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 17d
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 17c to 17d
Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_cib_callback: Update
9 for last-failure-failover-ip=1319489935 passed
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 17d to pending delivery queue
Oct 24 16:58:55 deb1 attrd: [4805]: debug: attrd_cib_callback: Update
12 for probe_complete=true passed
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 17b
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 17e
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 17d to 17e
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 17e to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 17f
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 17e to 17f
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 17f to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 180
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 17f to 180
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 180 to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Received
ringid(192.168.2.110:108) seq 181
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering 180 to 181
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] Delivering MCAST
message with seq 181 to pending delivery queue
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 17d
Oct 24 16:58:55 deb1 corosync[4791]:   [TOTEM ] releasing messages up
to and including 181


>
> Are you sure that the IP address you configure in your failover-ip resource
> can be brought up ? It's not already used or in another network ?
>

I have a very small network --- this ip is not being used at all.
all i did was clone a vbox vm machine to another machine and installed.
after installing - i realized the nic hardwares are the same do i did
a refersh and restarted the machines.

Do i have to stop network manager ? or do i have to do anything
special for pacemaker and corosync ???

thanks
mjh


Reply to: