src/test/test-stop-command1/log.expect

   1 info      0     hardware: starting simulation
   2 info     20      cmdlist: execute power node1 on
   3 info     20    node1/crm: status change startup => wait_for_quorum
   4 info     20    node1/lrm: status change startup => wait_for_agent_lock
   5 info     20      cmdlist: execute power node2 on
   6 info     20    node2/crm: status change startup => wait_for_quorum
   7 info     20    node2/lrm: status change startup => wait_for_agent_lock
   8 info     20      cmdlist: execute power node3 on
   9 info     20    node3/crm: status change startup => wait_for_quorum
  10 info     20    node3/lrm: status change startup => wait_for_agent_lock
  11 info     20    node1/crm: got lock 'ha_manager_lock'
  12 info     20    node1/crm: status change wait_for_quorum => master
  13 info     20    node1/crm: node 'node1': state changed from 'unknown' => 'online'
  14 info     20    node1/crm: node 'node2': state changed from 'unknown' => 'online'
  15 info     20    node1/crm: node 'node3': state changed from 'unknown' => 'online'
  16 info     20    node1/crm: adding new service 'fa:1001' on node 'node3'
  17 info     20    node1/crm: adding new service 'vm:101' on node 'node1'
  18 info     20    node1/crm: adding new service 'vm:102' on node 'node2'
  19 info     20    node1/crm: adding new service 'vm:103' on node 'node3'
  20 info     20    node1/crm: service 'fa:1001': state changed from 'request_start' to 'started'  (node = node3)
  21 info     20    node1/crm: service 'vm:101': state changed from 'request_start' to 'started'  (node = node1)
  22 info     20    node1/crm: service 'vm:102': state changed from 'request_start' to 'started'  (node = node2)
  23 info     20    node1/crm: service 'vm:103': state changed from 'request_start' to 'started'  (node = node3)
  24 info     21    node1/lrm: got lock 'ha_agent_node1_lock'
  25 info     21    node1/lrm: status change wait_for_agent_lock => active
  26 info     21    node1/lrm: starting service vm:101
  27 info     21    node1/lrm: service status vm:101 started
  28 info     22    node2/crm: status change wait_for_quorum => slave
  29 info     23    node2/lrm: got lock 'ha_agent_node2_lock'
  30 info     23    node2/lrm: status change wait_for_agent_lock => active
  31 info     23    node2/lrm: starting service vm:102
  32 info     23    node2/lrm: service status vm:102 started
  33 info     24    node3/crm: status change wait_for_quorum => slave
  34 info     25    node3/lrm: got lock 'ha_agent_node3_lock'
  35 info     25    node3/lrm: status change wait_for_agent_lock => active
  36 info     25    node3/lrm: starting service fa:1001
  37 info     25    node3/lrm: service status fa:1001 started
  38 info     25    node3/lrm: starting service vm:103
  39 info     25    node3/lrm: service status vm:103 started
  40 info    120      cmdlist: execute service vm:101 stop 0
  41 info    120    node1/crm: got crm command: stop vm:101 0
  42 info    120    node1/crm: request immediate service hard-stop for service 'vm:101'
  43 info    120    node1/crm: service 'vm:101': state changed from 'started' to 'request_stop'  (timeout = 0)
  44 info    121    node1/lrm: stopping service vm:101 (timeout=0)
  45 info    121    node1/lrm: service status vm:101 stopped
  46 info    140    node1/crm: service 'vm:101': state changed from 'request_stop' to 'stopped'
  47 info    220      cmdlist: execute service vm:101 stop 1
  48 info    220    node1/crm: got crm command: stop vm:101 1
  49 info    220    node1/crm: ignore service 'vm:101' stop request - service already stopped
  50 info    320      cmdlist: execute service vm:102 stop 37
  51 info    320    node1/crm: got crm command: stop vm:102 37
  52 info    320    node1/crm: request graceful stop with timeout '37' for service 'vm:102'
  53 info    320    node1/crm: service 'vm:102': state changed from 'started' to 'request_stop'  (timeout = 37)
  54 info    323    node2/lrm: stopping service vm:102 (timeout=37)
  55 info    323    node2/lrm: service status vm:102 stopped
  56 info    340    node1/crm: service 'vm:102': state changed from 'request_stop' to 'stopped'
  57 info    420      cmdlist: execute service vm:103 stop 60
  58 info    420    node1/crm: got crm command: stop vm:103 60
  59 info    420    node1/crm: request graceful stop with timeout '60' for service 'vm:103'
  60 info    420    node1/crm: service 'vm:103': state changed from 'started' to 'request_stop'  (timeout = 60)
  61 info    425    node3/lrm: stopping service vm:103 (timeout=60)
  62 info    425    node3/lrm: service status vm:103 stopped
  63 info    440    node1/crm: service 'vm:103': state changed from 'request_stop' to 'stopped'
  64 info    520      cmdlist: execute service fa:1001 stop 0
  65 info    520    node1/crm: got crm command: stop fa:1001 0
  66 info    520    node1/crm: request immediate service hard-stop for service 'fa:1001'
  67 info    520    node1/crm: service 'fa:1001': state changed from 'started' to 'request_stop'  (timeout = 0)
  68 info    525    node3/lrm: stopping service fa:1001 (timeout=0)
  69 info    525    node3/lrm: unable to stop stop service fa:1001 (still running)
  70 err     540    node1/crm: service 'fa:1001' stop failed (exit code 1)
  71 info    540    node1/crm: service 'fa:1001': state changed from 'request_stop' to 'error'
  72 err     545    node3/lrm: service fa:1001 is in an error state and needs manual intervention. Look up 'ERROR RECOVERY' in the documentation.
  73 info   1120     hardware: exit simulation - done