Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Code Block
00000053 10/13/2020 16:09:29.3583295 [print_state_change] [STATE:20] bsr_info<6> bsr r0/0 minor 2, ds(Attaching), dvflag(0x0): change_disk_state, disk( Attaching -> UpToDate )
00000091 10/13/2020 16:09:48.2615732 [print_state_change] [STATE:21] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, pdsk(DUnknown), prpl(Off), pdvflag(0x100200): receive_state, pdsk( DUnknown -> UpToDate ) repl( Off -> Established )
00000099 10/13/2020 16:10:14.3457504 [print_state_change] [STATE:18] bsr_info<6> bsr r0, r(Secondary), f(0x0), scf(0xa1c): change_role, role( Secondary -> Primary )
00000583 10/13/2020 16:14:01.5270141 [print_state_change] [STATE:19] bsr_info<6> bsr r0 pnode-id:1, cs(Connecting), prole(Unknown), cflag(0xe), scf(0xa0a): connect_work, conn( Connecting -> Connected ) peer( Unknown -> Secondary )

resource upconnect

Code Block
0000072200000791 10/13/2020 16:1618:1220.62661069761914 [NetlinkWorkThread] [NETLINK:18] bsr_info<6> [0xFFFFE000CCAAC0400xFFFFE000CCAFB880] bsr netlink cmd(BSR_ADM_NEW_RESOURCEDISCONNECT:711) begin ->
0000072300000792 10/13/2020 16:1618:1220.62662529762023 [bsrstate_threadchange_startlock] [THREADSTATE:1240] bsr_info<6> bsr r0, r(Secondary), f(0x0), scf(0x0): Starting worker thread (from not_bsr_thread [0])
00000724[0xFFFFE000CCAFB880] worker should not initiate state changes with CS_SERIALIZE current:FFFFF801707C9BD0 resource->worker.task:FFFFE000CDE0B820
00000793 10/13/2020 16:1618:1220.62684499762218 [NetlinkWorkThreadchange_cluster_wide_state] [NETLINKTWOPC:2034] bsr_info<6> [0xFFFFE000CCAAC040] bsr netlinkr0, cmd(BSR_ADM_NEW_RESOURCE:7) done (cmd_pending:0) <-
00000725 10/13/2020 16:16:12.6346292 [NetlinkWorkThread] [NETLINK:18] bsr_info<6> [0xFFFFE000CCAAC040] bsr netlink cmd(BSR_ADM_NEW_MINOR:5) begin ->
00000726 r(Secondary), f(0x0), scf(0x28): Preparing cluster-wide state change 2366568536 (0->1 496/16)
00000794 10/13/2020 16:1618:1220.63466519762252 [bsrchange_cluster_createwide_devicestate] [VOLUMETWOPC:1035] bsr_info<6> [0xFFFFE000CCAAC040] device(FFFFE000CE6C8890) max sectors(21211136bsr r0, r(Secondary), f(0x0), sizescf(10860101632 bytes)
00000727 10/13/2020 16:16:12.6348421 [NetlinkWorkThread] [NETLINK:20] bsr_info<6> [0xFFFFE000CCAAC040] bsr netlink cmd(BSR_ADM_NEW_MINOR:5) done (cmd_pending:0) <-
00000728 10/13/2020 16:16:12.6430701 [NetlinkWorkThread] [NETLINK:18] bsr_info<6> [0xFFFFE000CCAAC040] bsr netlink cmd(BSR_ADM_NEW_PEER:44) begin ->
00000729 0x28): [TWOPC:2366568536] target_node_id(1) conn(Disconnecting) repl(-) disk(-) pdsk(-) role(-) peer(-) flags (8) 
00000795 10/13/2020 16:1618:1220.64308899766356 [bsrchange_createcluster_peer_device_default_configwide_state] [GENLTWOPC:4536] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, pdsk(DUnknown, r(Secondary), prplf(Off0x0), pdvflagscf(0x00x28): default, resync_rate : 250k, c_plan_ahead : 20k, c_delay_target : 10k, c_fill_target : 100s, c_max_rate : 102400k, c_min_rate : 250k, ov_req_num : 10b, ov_req_interval : 100ms
00000730[TWOPC:2366568536] target_node_id(1) get_cluster_wide_reply (3) 
00000796 10/13/2020 16:1618:1220.64310849766412 [bsrchange_cluster_threadwide_startstate] [THREADTWOPC:1137] bsr_info<6> bsr r0 pnode-id:1, csr(StandAloneSecondary), prole(Unknown), cflagf(0x0), scf(0x00x28): StartingState senderchange thread (from not_bsr_thread [0])
000007312366568536: primary_nodes=0, weak_nodes=0
00000797 10/13/2020 16:1618:1220.64330569766463 [NetlinkWorkThreadchange_cluster_wide_state] [NETLINKTWOPC:2038] bsr_info<6> bsr [0xFFFFE000CCAAC040] bsr netlink cmd(BSR_ADM_NEW_PEER:44) done (cmd_pending:0) <-
00000732r0 pnode-id:1, cs(Connected), prole(Secondary), cflag(0x10e), scf(0x28): Cluster is now split
00000798 10/13/2020 16:1618:1220.65194829766497 [NetlinkWorkThread] [NETLINK:18change_cluster_wide_state] [TWOPC:39] bsr_info<6> [0xFFFFE000CCAFB880] bsr netlinkr0, cmd(BSR_ADM_NEW_PATH:45) begin ->
00000733 10/13/2020 16:16:12.6521598 [NetlinkWorkThread] [NETLINK:20] bsr_info<6> [0xFFFFE000CCAFB880] bsr netlink cmd(BSR_ADM_NEW_PATH:45) done (cmd_pending:0) <-
00000734 r(Secondary), f(0x0), scf(0x28): Committing cluster-wide state change 2366568536 (0ms) (0->1)
00000799 10/13/2020 16:1618:1220.70334759767770 [NetlinkWorkThreadprint_state_change] [NETLINKSTATE:1819] bsr_info<6> [0xFFFFE000CCAC4880]bsr bsr netlink cmd(BSR_ADM_ATTACH:12) begin ->
00000735 10/13/2020 16:16:12.7037719 [state_change_lock] [STATE:40] bsr_info<6> [0xFFFFE000CCAC4880] worker should not initiate state changes with CS_SERIALIZE current:FFFFF801707C9BD0 resource->worker.task:FFFFE000CDE0B820
00000736 r0 pnode-id:1, cs(Connected), prole(Secondary), cflag(0x10e), scf(0x208): conn_try_disconnect, conn( Connected -> Disconnecting ) peer( Secondary -> Unknown )
00000800 10/13/2020 16:1618:1220.70378839767831 [print_state_change] [STATE:2021] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, pdsk(UpToDate), dsprpl(DisklessEstablished), dvflagpdvflag(0x00x100600): changeconn_disktry_statedisconnect, diskpdsk( DisklessUpToDate -> DUnknown ) repl( Established -> AttachingOff )
0000073700000801 10/13/2020 16:1618:1220.70383829768211 [FsctlLockVolumebsr_recv] [VOLUMESOCKET:2015] bsr_info<6> [0xFFFFE000CCAC4880] no lock. volume(\Device\HarddiskVolume2) already dismounted
00000738 bsr r0 pnode-id:1, cs(Connected), prole(Secondary), cflag(0x10e), scf(0x208): socket data receive error(-15)
00000802 10/13/2020 16:1618:1220.70384149768974 [FsctlFlushDismountVolumebsr_ack_receiver] [VOLUMECONNECTION:1516] bsr_info<6> [0xFFFFE000CCAC4880]bsr no dismount. volume(\Device\HarddiskVolume2) already dismounted
00000739 r0 pnode-id:1, cs(Disconnecting), prole(Unknown), cflag(0x10e), scf(0x0): ack_receiver terminated
00000803 10/13/2020 16:1618:1220.70384419769028 [FsctlUnlockVolumebsr_thread_setup] [VOLUMETHREAD:249] bsr_info<6> [0xFFFFE000CCAC4880] volume(\Device\HarddiskVolume2) not locked
00000740 bsr r0 pnode-id:1, cs(Disconnecting), prole(Unknown), cflag(0x10e), scf(0x0): Terminating ack_recv thread
00000804 10/13/2020 16:1618:1220.70384609771990 [bsrw_admresync_attachtimer] [GENLRESYNC/OV:36105] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, ds(Attachingpdsk(DUnknown), prpl(Off), dvflagpdvflag(0x0): Maximumcompleted numberbecause ofit bitmapis peernot devicesin 1the 00000741 10/13/2020 16:16:12.7047859 [bsr_bump_write_ordering] [VOLUME:66VerifyS or SyncTarget replication state.
00000805 10/13/2020 16:18:20.9774397 [conn_disconnect] [CONNECTION:9] bsr_info<6> bsr r0 pnode-id:1, r(Secondarycs(Disconnecting), prole(Unknown), fcflag(0x00x10e), scf(0x10x0): MethodConnection to ensure write ordering: drain
00000742closed
00000806 10/13/2020 16:1618:1220.70478919774928 [getprint_maxstate_agreeable_sizechange] [GENLSTATE:1619] bsr_info<6> bsr r0/0 minor 2, ds(Attaching pnode-id:1, cs(Disconnecting), prole(Unknown), cflag(0x10e), dvflagscf(0x00x23): local node_id: 0
00000743 10/13/2020 16:16:12.7047913 [get_max_agreeable_size] [GENL:17conn_disconnect, conn( Disconnecting -> StandAlone )
00000807 10/13/2020 16:18:20.9775335 [bsr_thread_setup] [THREAD:9] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, pdskcs(DUnknownStandAlone), prplprole(OffUnknown), pdvflagcflag(0x00x10e): node id(1) bitmap index(0) bitmap uuid, scf(0x0): flags(0x10) max size(0) disk state(DUnknown)
00000744 Terminating receiver thread
00000808 10/13/2020 16:1618:1220.70481039777552 [get_max_agreeable_sizeNetlinkWorkThread] [GENLNETLINK:1620] bsr_info<6> [0xFFFFE000CCAFB880] bsr r0/0 minor 2, ds(Attaching), dvflag(0x0): local node_id: 0
00000745netlink cmd(BSR_ADM_DISCONNECT:11) done (cmd_pending:0) <-
00000809 10/13/2020 16:1618:1222.70481239478253 [get_max_agreeable_sizeNetlinkWorkThread] [GENLNETLINK:1718] bsr_info<6> [0xFFFFE000CCAAC040] bsr r0/0 minor 2 pnode-id:1, pdsk(DUnknown), prpl(Off), pdvflag(0x0): node id(1) bitmap index(0) bitmap uuid(0x0) flags(0x10) max size(0) disk state(DUnknown)
00000746 netlink cmd(BSR_ADM_CONNECT:10) begin ->
00000810 10/13/2020 16:1618:1222.70481599478355 [bsrstate_bmchange_resizelock] [BITMAPSTATE:2340] bsr_info<6> bsr r0/0 minor 2, ds(Attaching), dvflag(0x0): bitmap resize called with capacity(21211136)
00000747[0xFFFFE000CCAAC040] worker should not initiate state changes with CS_SERIALIZE current:FFFFF801707C9BD0 resource->worker.task:FFFFE000CDE0B820
00000811 10/13/2020 16:1618:1222.70540159478519 [bsrprint_bmstate_resizechange] [BITMAPSTATE:2519] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, dscs(AttachingStandAlone), dvflagprole(0x0Unknown): resize bitmap, bitscflag(26513920x10e), wordsscf(82856) pages(81)
000007480x2a): bsr_adm_connect, conn( StandAlone -> Unconnected )
00000812 10/13/2020 16:1618:1222.70540549478904 [bsr_determinethread_dev_sizestart] [GENLTHREAD:1311] bsr_info<6> bsr r0/0 minor 2, ds(Attaching pnode-id:1, cs(Unconnected), prole(Unknown), cflag(0x10e), dvflagscf(0x0): UpdateStarting diskreceiver sizethread 10(from GB (10605568 KBworker [2108])
0000074900000813 10/13/2020 16:1618:1222.70929939480150 [bm_rw_rangeNetlinkWorkThread] [BITMAPNETLINK:2920] bsr_info<6> [0xFFFFE000CCAAC040] bsr r0/0 minor 2, ds(Attaching), dvflag(0x0): recounting of set bits took additional 1ms
00000750 netlink cmd(BSR_ADM_CONNECT:10) done (cmd_pending:0) <-
00000814 10/13/2020 16:1618:1222.70930799480265 [state_change_lock] [STATE:40] bsr_info<6> [0xFFFFE000CCAC48800xFFFFE000CE728040] worker should not initiate state changes with CS_SERIALIZE current:FFFFF801707C9BD0FFFFE000CE0F9170 resource->worker.task:FFFFE000CDE0B820
0000075100000815 10/13/2020 16:1618:1222.70932409480416 [print_state_change] [STATE:2019] bsr_info<6> bsr r0/0 minor 2, ds(Attaching pnode-id:1, cs(Unconnected), prole(Unknown), cflag(0xe), dvflagscf(0x00x2a): changeconn_disk_stateconnect, diskconn( AttachingUnconnected -> UpToDateConnecting )
0000075200000816 10/13/2020 16:1618:1225.70932889566941 [finishbsr_statedo_changefeatures] [UUIDPROTOCOL:1455] bsr_info<6> bsr r0/0 minor 2, ds(Attaching pnode-id:1, cs(Connecting), prole(Unknown), cflag(0xe), dvflagscf(0x0): attachedHandshake to peer current1 UUIDsuccessful: 83F530CA41FA9868
00000753Agreed network protocol version 114
00000817 10/13/2020 16:1618:1225.70976579567017 [NetlinkWorkThreadbsr_do_features] [NETLINKPROTOCOL:2056] bsr_info<6> [0xFFFFE000CCAC4880] bsr netlink cmd(BSR_ADM_ATTACH:12) done (cmd_pending:0) <-
00000754r0 pnode-id:1, cs(Connecting), prole(Unknown), cflag(0xe), scf(0x0): Feature flags enabled on protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
00000818 10/13/2020 16:1618:1225.71867779568141 [NetlinkWorkThreadconn_connect] [NETLINKSEND BUFFER:1827] bsr_info<6> [0xFFFFE000CCAAC040] bsr netlink cmd(BSR_ADM_CONNECT:10) begin ->
00000755warn<4> bsr r0 pnode-id:1, cs(Connecting), prole(Unknown), cflag(0xe), scf(0x0): send-buffering disabled nc->sndbuf_size:0
00000819 10/13/2020 16:1618:1225.7186894 [9568180 [bsr_thread_start] [THREAD:11] bsr_info<6> bsr r0 pnode-id:1, cs(Connecting), prole(Unknown), cflag(0xe), scf(0x0): Starting ack_recv thread (from receiver [1676])
00000820 10/13/2020 16:18:26.0424367 [state_change_lock] [STATE:40] bsr_info<6> [0xFFFFE000CCAAC0400xFFFFE000CDA1A040] worker should not initiate state changes with CS_SERIALIZE current:FFFFF801707C9BD0FFFFE000CDAA58C0 resource->worker.task:FFFFE000CDE0B820
0000075600000821 10/13/2020 16:1618:1226.71871020424586 [printchange_cluster_wide_state_change] [STATETWOPC:1934] bsr_info<6> bsr r0 pnode-id:1, csr(StandAloneSecondary), prole(Unknown), cflag(f(0x0), scf(0x2a0x82a): bsr_adm_connect, conn( StandAlone -> Unconnected )
00000757 Preparing cluster-wide state change 2387348015 (0->1 499/146)
00000822 10/13/2020 16:1618:1226.71891500424733 [NetlinkWorkThreadchange_cluster_wide_state] [NETLINKTWOPC:2035] bsr_info<6> bsr r0, r(Secondary), [0xFFFFE000CCAAC040] bsr netlink cmd(BSR_ADM_CONNECT:10) done (cmd_pending:0) <-
00000758f(0x0), scf(0x82a): [TWOPC:2387348015] target_node_id(1) conn(Connected) repl(-) disk(-) pdsk(-) role(Secondary) peer(-) flags (2058) 
00000823 10/13/2020 16:1618:1226.71903220430489 [bsrchange_cluster_threadwide_startstate] [THREADTWOPC:1136] bsr_info<6> bsr r0 pnode-id:1, csr(UnconnectedSecondary), prole(Unknown), cflagf(0x0), scf(0x00x82a): Starting receiver thread (from worker [2108])
00000759[TWOPC:2387348015] target_node_id(1) get_cluster_wide_reply (3) 
00000824 10/13/2020 16:1618:1226.71911490430560 [statechange_cluster_changewide_lockstate] [STATETWOPC:4037] bsr_info<6> [0xFFFFE000CDDA5880] worker should not initiate state changes with CS_SERIALIZE current:FFFFE000CE0F9170 resource->worker.task:FFFFE000CDE0B820
00000760bsr r0, r(Secondary), f(0x0), scf(0x82a): State change 2387348015: primary_nodes=0, weak_nodes=0
00000825 10/13/2020 16:1618:1226.71913490430611 [printchange_cluster_wide_state_change] [STATETWOPC:1939] bsr_info<6> bsr r0 pnode-id:1, csr(UnconnectedSecondary), prole(Unknown), cflagf(0x0), scf(0x2a0x82a): conn_connect, conn( Unconnected -> Connecting )
00000761Committing cluster-wide state change 2387348015 (0ms) (0->1)
00000826 10/13/2020 16:1618:1526.72248480432317 [bsrprint_dostate_featureschange] [PROTOCOLSTATE:5519] bsr_info<6> bsr r0 pnode-id:1, cs(Connecting), prole(Unknown), cflag(0x00xe), scf(0x00xa0a): Handshake to peer 1 successful: Agreed network protocol version 114
00000762 connect_work, conn( Connecting -> Connected ) peer( Unknown -> Secondary )
00000827 10/13/2020 16:1618:1526.72249160434960 [bsrreceive_do_featuresSyncParam] [PROTOCOL:5629] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, cspdsk(ConnectingDUnknown), proleprpl(UnknownOff), cflagpdvflag(0x0): sync, resync_rate : 250k, scf(0x0): Feature flags enabled on protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
00000763 c_plan_ahead : 20k, c_delay_target : 10k, c_fill_target : 100s, c_max_rate : 102400k, c_min_rate : 250k, ov_req_num : 10b, ov_req_interval : 100ms
00000828 10/13/2020 16:1618:1526.72273320435080 [connreceive_connectsizes] [SEND BUFFERPROTOCOL:2732] bsr_warn<4>info<6> bsr r0 pnode-id:1/0 minor 2, csds(ConnectingUpToDate), proledvflag(Unknown), cflag(0x0), scf(0x0): send-buffering disabled nc->sndbuf_size:0
000007640x0): current_mydisk_size: 10860101632 bytes
00000829 10/13/2020 16:1618:1526.72274370435114 [bsrreceive_thread_startsizes] [THREADPROTOCOL:1133] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, cspdsk(ConnectingDUnknown), proleprpl(UnknownOff), cflagpdvflag(0x0), scf(0x0): Starting ack_recv thread (from receiver [2808])
00000765: peer_current_size: 10860101632 bytes peer_user_size: 0 bytes peer_disk_size: 10860101632 bytes peer_max_size: 10860101632 bytes
00000830 10/13/2020 16:1618:1526.77704040435168 [statereceive_change_locksizes] [STATEPROTOCOL:4034] bsr_info<6> [0xFFFFE000CDA1A040] worker should not initiate state changes with CS_SERIALIZE current:FFFFE000CDAA58C0 resource->worker.task:FFFFE000CDE0B820
00000766 bsr r0/0 minor 2 pnode-id:1, pdsk(DUnknown), prpl(Off), pdvflag(0x100000): md_effective_size: 21211136 my_user_size: 0 my_max_size: 21211136
00000831 10/13/2020 16:1618:1526.77706280435209 [changeget_clustermax_wideagreeable_statesize] [TWOPCGENL:3416] bsr_info<6> bsr r0/0 minor 2, rds(SecondaryUpToDate), fdvflag(0x0), scf(0x82a): Preparing cluster-wide state change 1853056548 (0->1 499/146)
00000767 local node_id: 0
00000832 10/13/2020 16:1618:1526.77706640435236 [changeget_clustermax_wideagreeable_statesize] [TWOPCGENL:3517] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, rpdsk(SecondaryDUnknown), fprpl(0x0Off), scfpdvflag(0x82a0x100000): [TWOPC:1853056548] target_node_node id(1) bitmap connindex(Connected0) repl(-) disk(-bitmap uuid(0x0) pdskflags(-0x10) role(Secondary) peer(-max size(21211136) flagsdisk state(2058DUnknown)

0000076800000833 10/13/2020 16:1618:1526.77760580435292 [change_cluster_wide_statereceive_sizes] [TWOPCPROTOCOL:3639] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, rpdsk(SecondaryDUnknown), fprpl(0x0Off), scfpdvflag(0x82a0x100000): [TWOPC:1853056548] target_node_id(1) get_cluster_wide_reply (3) 
00000769 Proceed with device size setting
00000834 10/13/2020 16:1618:1526.77761090436443 [changeget_clustermax_wideagreeable_statesize] [TWOPCGENL:3716] bsr_info<6> bsr r0/0 minor 2, rds(SecondaryUpToDate), fdvflag(0x0), scf(0x82a): State change 1853056548: primary_nodes=0, weak_nodes=0
00000770local node_id: 0
00000835 10/13/2020 16:1618:1526.77761450436474 [changeget_clustermax_wideagreeable_statesize] [TWOPCGENL:3917] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, rpdsk(SecondaryDUnknown), fprpl(0x0Off), scfpdvflag(0x82a0x100000): Committing cluster-wide state change 1853056548 (1ms) (0->1)
00000771node id(1) bitmap index(0) bitmap uuid(0x0) flags(0x10) max size(21211136) disk state(DUnknown)

resource disconnect

Code Block
00000791 10/13/2020 16:1618:1520.77784719761914 [print_state_changeNetlinkWorkThread] [STATENETLINK:1918] bsr_info<6> [0xFFFFE000CCAFB880] bsr r0 pnode-id:1, cs(Connecting), prole(Unknown), cflag(0xc), scf(0xa0a): connect_work, conn( Connecting -> Connected ) peer( Unknown -> Secondary )
00000772netlink cmd(BSR_ADM_DISCONNECT:11) begin ->
00000792 10/13/2020 16:1618:1520.77795279762023 [receivestate_change_SyncParamlock] [PROTOCOLSTATE:2940] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, pdsk(DUnknown), prpl(Off), pdvflag(0x0): sync, resync_rate : 250k, c_plan_ahead : 20k, c_delay_target : 10k, c_fill_target : 100s, c_max_rate : 102400k, c_min_rate : 250k, ov_req_num : 10b, ov_req_interval : 100ms
00000773[0xFFFFE000CCAFB880] worker should not initiate state changes with CS_SERIALIZE current:FFFFF801707C9BD0 resource->worker.task:FFFFE000CDE0B820
00000793 10/13/2020 16:18:20.9762218 [change_cluster_wide_state] [TWOPC:34] bsr_info<6> bsr r0, r(Secondary), f(0x0), scf(0x28): Preparing cluster-wide state change 2366568536 (0->1 496/16)
00000794 10/13/2020 16:18:20.9762252 [change_cluster_wide_state] [TWOPC:35] bsr_info<6> bsr r0, r(Secondary), f(0x0), scf(0x28): [TWOPC:2366568536] target_node_id(1) conn(Disconnecting) repl(-) disk(-) pdsk(-) role(-) peer(-) flags (8) 
00000795 10/13/2020 16:18:20.9766356 [change_cluster_wide_state] [TWOPC:36] bsr_info<6> bsr r0, r(Secondary), f(0x0), scf(0x28): [TWOPC:2366568536] target_node_id(1) get_cluster_wide_reply (3) 
00000796 10/13/2020 16:18:20.9766412 [change_cluster_wide_state] [TWOPC:37] bsr_info<6> bsr r0, r(Secondary), f(0x0), scf(0x28): State change 2366568536: primary_nodes=0, weak_nodes=0
00000797 10/13/2020 16:18:20.9766463 [change_cluster_wide_state] [TWOPC:38] bsr_info<6> bsr r0 pnode-id:1, cs(Connected), prole(Secondary), cflag(0x10e), scf(0x28): Cluster is now split
00000798 10/13/2020 16:1618:1520.77812609766497 [receive_sizeschange_cluster_wide_state] [PROTOCOLTWOPC:3239] bsr_info<6> bsr r0/0 minor 2, r(Secondary), dsf(UpToDate0x0), dvflagscf(0x00x28): current_mydisk_size: 10860101632 bytes
00000774  Committing cluster-wide state change 2366568536 (0ms) (0->1)
00000799 10/13/2020 16:1618:1520.77812929767770 [receiveprint_state_sizeschange] [PROTOCOLSTATE:3319] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, cs(Connected), pdskprole(DUnknownSecondary), prplcflag(Off0x10e), pdvflagscf(0x00x208): peerconn_currenttry_size: 10860101632 bytes peer_user_size: 0 bytes peer_disk_size: 10860101632 bytes peer_max_size: 10860101632 bytes
00000775 disconnect, conn( Connected -> Disconnecting ) peer( Secondary -> Unknown )
00000800 10/13/2020 16:1618:1520.77813349767831 [receiveprint_state_sizeschange] [PROTOCOLSTATE:3421] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, pdsk(DUnknownUpToDate), prpl(OffEstablished), pdvflag(0x1000000x100600): mdconn_effective_size: 21211136 my_user_size: 0 my_max_size: 21211136
00000776try_disconnect, pdsk( UpToDate -> DUnknown ) repl( Established -> Off )
00000801 10/13/2020 16:1618:1520.77813659768211 [get_max_agreeable_sizebsr_recv] [GENLSOCKET:1615] bsr_info<6> bsr r0/0 minor 2, ds(UpToDate pnode-id:1, cs(Connected), prole(Secondary), cflag(0x10e), dvflagscf(0x00x208): local node_id: 0
00000777socket data receive error(-15)
00000802 10/13/2020 16:1618:1520.77813879768974 [getbsr_maxack_agreeable_sizereceiver] [GENLCONNECTION:1716] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, pdsk(DUnknown), prpl(Off), pdvflag(0x100000): node id(1) bitmap index(0) bitmap uuid(0x0) flags(0x10) max size(21211136) disk state(DUnknown)
00000778info<6> bsr r0 pnode-id:1, cs(Disconnecting), prole(Unknown), cflag(0x10e), scf(0x0): ack_receiver terminated
00000803 10/13/2020 16:1618:1520.77814299769028 [receivebsr_thread_sizessetup] [PROTOCOLTHREAD:399] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, pdsk(DUnknowncs(Disconnecting), prole(Unknown), prplcflag(Off0x10e), pdvflagscf(0x1000000x0): ProceedTerminating withack_recv devicethread
size00000804 setting
00000779 10/13/2020 16:1618:1520.77820729771990 [getw_maxresync_agreeable_sizetimer] [GENLRESYNC/OV:16105] bsr_info<6> bsr r0/0 minor 2, ds(UpToDateminor 2 pnode-id:1, pdsk(DUnknown), prpl(Off), dvflagpdvflag(0x0): local node_id: 0
00000780 completed because it is not in the VerifyS or SyncTarget replication state.
00000805 10/13/2020 16:1618:1520.77821099774397 [get_max_agreeable_sizeconn_disconnect] [GENLCONNECTION:179] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, pdskcs(DUnknownDisconnecting), prplprole(OffUnknown), pdvflagcflag(0x1000000x10e):, node id(1) bitmap index(0) bitmap uuid(scf(0x0): flags(0x10) max size(21211136) disk state(DUnknown)

resource down

Code Block
00000617Connection closed
00000806 10/13/2020 16:1618:1120.2136805 [NetlinkWorkThread9774928 [print_state_change] [NETLINKSTATE:1819] bsr_info<6> [0xFFFFE000CCAC4880] bsr netlink cmd(BSR_ADM_DOWN:27) begin ->
00000618 bsr r0 pnode-id:1, cs(Disconnecting), prole(Unknown), cflag(0x10e), scf(0x23): conn_disconnect, conn( Disconnecting -> StandAlone )
00000807 10/13/2020 16:1618:1120.21373449775335 [FsctlLockVolumebsr_thread_setup] [VOLUMETHREAD:659] bsr_info<6> [0xFFFFE000CCAC4880] try lock volume(\Device\HarddiskVolume2)
00000680 bsr r0 pnode-id:1, cs(StandAlone), prole(Unknown), cflag(0x10e), scf(0x0): Terminating receiver thread
00000808 10/13/2020 16:1618:1120.25348839777552 [FsctlLockVolumeNetlinkWorkThread] [VOLUMENETLINK:2320] bsr_info<6> [0xFFFFE000CCAC48800xFFFFE000CCAFB880] bsr volume(\Device\HarddiskVolume2) locked. handle(0xFFFFFFFF80000DC8)
00000683netlink cmd(BSR_ADM_DISCONNECT:11) done (cmd_pending:0) <-

resource up

Code Block
00000722 10/13/2020 16:16:1112.25350246266106 [FsctlFlushDismountVolumeNetlinkWorkThread] [VOLUMENETLINK:6218] bsr_info<6> [0xFFFFE000CCAC48800xFFFFE000CCAAC040] trybsr flushnetlink volume(\Device\HarddiskVolume2)
00000684cmd(BSR_ADM_NEW_RESOURCE:7) begin ->
00000723 10/13/2020 16:16:1112.25357296266252 [FsctlFlushDismountVolumebsr_thread_start] [VOLUMETHREAD:6312] bsr_info<6> [0xFFFFE000CCAC4880] volume(\Device\HarddiskVolume2) flushed
00000685 10/13/2020 16:16:11.2535766 [FsctlFlushDismountVolume] [VOLUME:64] bsr_info<6> [0xFFFFE000CCAC4880] try dismount volume(\Device\HarddiskVolume2)
00000686 bsr r0, r(Secondary), f(0x0), scf(0x0): Starting worker thread (from not_bsr_thread [0])
00000724 10/13/2020 16:16:1112.25598226268449 [FsctlFlushDismountVolumeNetlinkWorkThread] [VOLUMENETLINK:1920] bsr_info<6> [0xFFFFE000CCAC4880] volume(\Device\HarddiskVolume2) dismounted
000006870xFFFFE000CCAAC040] bsr netlink cmd(BSR_ADM_NEW_RESOURCE:7) done (cmd_pending:0) <-
00000725 10/13/2020 16:16:1112.25601786346292 [print_state_changeNetlinkWorkThread] [STATENETLINK:18] bsr_info<6> [0xFFFFE000CCAAC040] bsr r0,netlink r(Primary), f(0x11), scf(0x83c): change_role, role( Primary -> Secondary )
00000688cmd(BSR_ADM_NEW_MINOR:5) begin ->
00000726 10/13/2020 16:16:1112.25682566346651 [bsr_create_receive_uuidsdevice] [UUIDVOLUME:1610] bsr_warn<4>info<6> bsr r0/0 minor 2 pnode-id:1, pdsk(UpToDate[0xFFFFE000CCAAC040] device(FFFFE000CE6C8890) max sectors(21211136), prplsize(Established), pdvflag(0x100600): receive new current but not update UUID: 83F530CA41FA9868
00000689 10860101632 bytes)
00000727 10/13/2020 16:16:1112.25683176348421 [bsr_uuid_compareNetlinkWorkThread] [RESYNC/OVNETLINK:19720] bsr_info<6> [0xFFFFE000CCAAC040] bsr r0/0 minor 2, ds(UpToDate), dvflag(0x2): Local and peer current UUIDs are the same. rule(40), res(0)
00000690netlink cmd(BSR_ADM_NEW_MINOR:5) done (cmd_pending:0) <-
00000728 10/13/2020 16:16:1112.25698576430701 [FsctlUnlockVolumeNetlinkWorkThread] [VOLUMENETLINK:6118] bsr_info<6> [0xFFFFE000CCAC48800xFFFFE000CCAAC040] bsr unlocknetlink volume(\Device\HarddiskVolume2)
00000691cmd(BSR_ADM_NEW_PEER:44) begin ->
00000729 10/13/2020 16:16:1112.25768996430889 [FsctlUnlockVolumebsr_create_peer_device_default_config] [VOLUMEGENL:2645] bsr_info<6> [0xFFFFE000CCAC4880] volume(\Device\HarddiskVolume2) unlocked
00000692 10/13/2020 16:16:11.2577179 [state_change_lock] [STATE:40] bsr_info<6> [0xFFFFE000CCAC4880] worker should not initiate state changes with CS_SERIALIZE current:FFFFF801707C9BD0 resource->worker.task:FFFFE000CDB38300
00000693 bsr r0/0 minor 2 pnode-id:1, pdsk(DUnknown), prpl(Off), pdvflag(0x0): default, resync_rate : 250k, c_plan_ahead : 20k, c_delay_target : 10k, c_fill_target : 100s, c_max_rate : 102400k, c_min_rate : 250k, ov_req_num : 10b, ov_req_interval : 100ms
00000730 10/13/2020 16:16:1112.25773286431084 [changebsr_clusterthread_wide_statestart] [TWOPCTHREAD:3411] bsr_info<6> bsr r0 pnode-id:1, r(Secondarycs(StandAlone), prole(Unknown), fcflag(0x110x0), scf(0x280x0): PreparingStarting cluster-widesender statethread change 1834520240 (0->1 496/16)
00000694(from not_bsr_thread [0])
00000731 10/13/2020 16:16:1112.25773556433056 [change_cluster_wide_stateNetlinkWorkThread] [TWOPCNETLINK:3520] bsr_info<6> [0xFFFFE000CCAAC040] bsr r0,netlink r(Secondary), f(0x11), scf(0x28): [TWOPC:1834520240] target_node_id(1) conn(Disconnecting) repl(-) disk(-) pdsk(-) role(-) peer(-) flags (8) 
00000695cmd(BSR_ADM_NEW_PEER:44) done (cmd_pending:0) <-
00000732 10/13/2020 16:16:12.6519482 [NetlinkWorkThread] [NETLINK:18] bsr_info<6> [0xFFFFE000CCAFB880] bsr netlink cmd(BSR_ADM_NEW_PATH:45) begin ->
00000733 10/13/2020 16:16:1112.25802126521598 [change_cluster_wide_stateNetlinkWorkThread] [TWOPCNETLINK:3620] bsr_info<6> [0xFFFFE000CCAFB880] bsr r0,netlink r(Secondary), f(0x11), scf(0x28): [TWOPC:1834520240] target_node_id(1) get_cluster_wide_reply (3) 
00000696cmd(BSR_ADM_NEW_PATH:45) done (cmd_pending:0) <-
00000734 10/13/2020 16:16:1112.25802517033475 [change_cluster_wide_stateNetlinkWorkThread] [TWOPCNETLINK:3718] bsr_info<6> bsr r0, r(Secondary), f(0x11), scf(0x28): State change 1834520240: primary_nodes=0, weak_nodes=0
00000697[0xFFFFE000CCAC4880] bsr netlink cmd(BSR_ADM_ATTACH:12) begin ->
00000735 10/13/2020 16:16:1112.25802757037719 [state_change_cluster_wide_statelock] [TWOPCSTATE:3840] bsr_info<6> bsr[0xFFFFE000CCAC4880] r0 pnode-id:1, cs(Connected), prole(Secondary), cflag(0x210e), scf(0x28): Cluster is now split
00000698worker should not initiate state changes with CS_SERIALIZE current:FFFFF801707C9BD0 resource->worker.task:FFFFE000CDE0B820
00000736 10/13/2020 16:16:1112.25803007037883 [changeprint_clusterstate_wide_statechange] [TWOPCSTATE:3920] bsr_info<6> bsr r0/0 minor 2, rds(SecondaryDiskless), f(0x11)dvflag(0x0): change_disk_state, scfdisk(0x28): CommittingDiskless cluster-wide> state change 1834520240 (0ms) (0->1)
00000699Attaching )
00000737 10/13/2020 16:16:1112.25843887038382 [ReceiveFsctlLockVolume] [SOCKETVOLUME:6620] bsr_info<6> [0xFFFFE000CDB668800xFFFFE000CCAC4880] receiver => Recv multiWait errorno lock. err(STATUS_CONNECTION_RESET) wsk(0xFFFFE000CE2A8198) size(16)
00000700volume(\Device\HarddiskVolume2) already dismounted
00000738 10/13/2020 16:16:1112.25845797038414 [bsr_recvFsctlFlushDismountVolume] [SOCKETVOLUME:1415] bsr_info<6> bsr[0xFFFFE000CCAC4880] r0 pnode-id:1, cs(Connected), prole(Secondary), cflag(0x210e), scf(0x28): socket reset due to peer.
00000701no dismount. volume(\Device\HarddiskVolume2) already dismounted
00000739 10/13/2020 16:16:1112.25847577038441 [print_state_changeFsctlUnlockVolume] [STATEVOLUME:1924] bsr_info<6> bsr r0 pnode-id:1, cs(Connected), prole(Secondary), cflag(0x210e), scf(0x21): bsr_recv, conn( Connected -> BrokenPipe ) peer( Secondary -> Unknown )
00000702 [0xFFFFE000CCAC4880] volume(\Device\HarddiskVolume2) not locked
00000740 10/13/2020 16:16:1112.25848057038460 [printbsr_stateadm_changeattach] [STATEGENL:2136] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, pdskds(UpToDateAttaching), prpl(Established), pdvflag(0x100600): bsr_recv, pdsk( UpToDate -> DUnknown ) repl( Established -> Off )
00000703dvflag(0x0): Maximum number of bitmap peer devices 1
00000741 10/13/2020 16:16:1112.25850717047859 [bsr_recvbump_allwrite_warnordering] [PROTOCOLVOLUME:6466] bsr_warn<4>info<6> bsr r0 pnode-id:1, csr(BrokenPipeSecondary), prole(Unknown), cflag(0x211ef(0x0), scf(0x00x1): Method shortto readensure (expectedwrite sizeordering: 16)drain
0000070400000742 10/13/2020 16:16:1112.25852477047891 [printget_max_stateagreeable_changesize] [STATEGENL:1916] bsr_info<6> bsr r0 pnode-id:1, cs(BrokenPipe), prole(Unknown/0 minor 2, ds(Attaching), cflagdvflag(0x211e0x0), scf(0x208): conn_try_disconnect, conn( BrokenPipe -> Disconnecting )
00000705 : local node_id: 0
00000743 10/13/2020 16:16:1112.25864957047913 [bsrget_max_ackagreeable_receiversize] [CONNECTIONGENL:1617] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, cspdsk(DisconnectingDUnknown), proleprpl(UnknownOff), cflag(0x211e), scf(0x0): ack_receiver terminated
00000706 pdvflag(0x0): node id(1) bitmap index(0) bitmap uuid(0x0) flags(0x10) max size(0) disk state(DUnknown)
00000744 10/13/2020 16:16:1112.25865327048103 [bsrget_max_threadagreeable_setupsize] [THREADGENL:916] bsr_info<6> bsr r0 pnode-id:1, cs(Disconnecting), prole(Unknown/0 minor 2, ds(Attaching), cflag(0x211e), scf(dvflag(0x0): Terminatinglocal acknode_recvid: thread0
0000070700000745 10/13/2020 16:16:1112.25876927048123 [wget_max_resyncagreeable_timersize] [RESYNC/OVGENL:10517] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, pdsk(DUnknown), prpl(Off), pdvflag(0x0): completed because it is not in the VerifyS or SyncTarget replication state.
00000708 10/13/2020 16:16:11.2591157 [conn_disconnect] [CONNECTION:9] bsr_info<6> bsr r0 pnode-id:1, cs(Disconnecting), prole(Unknown), cflag(0x211e), scf(0x0): Connection closed
00000709node id(1) bitmap index(0) bitmap uuid(0x0) flags(0x10) max size(0) disk state(DUnknown)
00000746 10/13/2020 16:16:1112.25916887048159 [printbsr_statebm_changeresize] [STATEBITMAP:1923] bsr_info<6> bsr r0 pnode-id:1, cs(Disconnecting), prole(Unknown/0 minor 2, ds(Attaching), cflagdvflag(0x211e), scf(0x23)0x0): conn_disconnect, conn( Disconnecting -> StandAlone )
00000710bitmap resize called with capacity(21211136)
00000747 10/13/2020 16:16:1112.25919817054015 [bsr_threadbm_setupresize] [THREADBITMAP:925] bsr_info<6> bsr r0 pnode-id:1/0 minor 2, csds(StandAloneAttaching), proledvflag(Unknown0x0): resize bitmap, cflagbits(0x211e2651392), scfwords(0x082856): Terminating receiver thread
00000711pages(81)
00000748 10/13/2020 16:16:1112.25924687054054 [bsr_determine_threaddev_setupsize] [THREADGENL:913] bsr_info<6> bsr r0 pnode-id:1, cs(StandAlone), prole(Unknown), cflag(0x211e/0 minor 2, ds(Attaching), scfdvflag(0x0): Terminating sender thread
00000712Update disk size 10 GB (10605568 KB)
00000749 10/13/2020 16:16:1112.25930367092993 [bsrbm_destroyrw_connectionrange] [CONNECTIONBITMAP:129] bsr_info<6> bsr r0 pnode-id:1, cs(StandAlone), prole(Unknown/0 minor 2, ds(Attaching), cflag(0x311e), scf(dvflag(0x0): bsr_destroy_connection
00000713 recounting of set bits took additional 1ms
00000750 10/13/2020 16:16:1112.25932417093079 [state_change_lock] [STATE:40] bsr_info<6> [0xFFFFE000CCAC4880] worker should not initiate state changes with CS_SERIALIZE current:FFFFF801707C9BD0 resource->worker.task:FFFFE000CDB38300FFFFE000CDE0B820
0000071400000751 10/13/2020 16:16:1112.25933397093240 [print_state_change] [STATE:20] bsr_info<6> bsr r0/0 minor 2, ds(UpToDateAttaching), dvflag(0x20x0): change_disk_state, disk( UpToDateAttaching -> DetachingUpToDate )
0000071500000752 10/13/2020 16:16:1112.25933787093288 [finish_state_change] [UUID:1914] bsr_info<6> bsr r0/0 minor 2, ds(UpToDateAttaching), dvflag(0x100020x0): detachingattached to current UUID: 83F530CA41FA9868
0000071600000753 10/13/2020 16:16:1112.25938637097657 [print_state_changeNetlinkWorkThread] [STATENETLINK:20] bsr_info<6> bsr r0/0 minor 2, ds(Detaching), dvflag(0x1002): change_disk_state, disk( Detaching -> Diskless )
00000717 [0xFFFFE000CCAC4880] bsr netlink cmd(BSR_ADM_ATTACH:12) done (cmd_pending:0) <-
00000754 10/13/2020 16:16:1112.25939637186777 [adm_detachNetlinkWorkThread] [GENLNETLINK:4218] bsr_info<6> [0xFFFFE000CCAC48800xFFFFE000CCAAC040] waitbsr event interruptible timeout. time out(3000) disk state(Diskless)
00000718netlink cmd(BSR_ADM_CONNECT:10) begin ->
00000755 10/13/2020 16:16:1112.25991587186894 [bsrstate_bmchange_resizelock] [BITMAPSTATE:2340] bsr_info<6> bsr r0/0 minor 2, ds(Diskless), dvflag(0x2): bitmap resize called with capacity(0)
00000719[0xFFFFE000CCAAC040] worker should not initiate state changes with CS_SERIALIZE current:FFFFF801707C9BD0 resource->worker.task:FFFFE000CDE0B820
00000756 10/13/2020 16:16:1112.26011417187102 [bsrprint_threadstate_setupchange] [THREADSTATE:1019] bsr_info<6> bsr r0 pnode-id:1, rcs(SecondaryStandAlone), fprole(0x11Unknown), scfcflag(0x0): Terminating worker thread
00000720 10/13/2020 16:16:11.2601562 [mvolWorkThread] [THREAD:20] bsr_info<6> [0xFFFFE000CDC92880] Terminating mvolWorkThread
00000721, scf(0x2a): bsr_adm_connect, conn( StandAlone -> Unconnected )
00000757 10/13/2020 16:16:1112.26038187189150 [NetlinkWorkThread] [NETLINK:20] bsr_info<6> [0xFFFFE000CCAC48800xFFFFE000CCAAC040] bsr netlink cmd(BSR_ADM_DOWNCONNECT:2710) done (cmd_pending:0) <-

resource connect

Code Block
00000791
00000758 10/13/2020 16:1816:2012.97619147190322 [NetlinkWorkThreadbsr_thread_start] [NETLINKTHREAD:1811] bsr_info<6> [0xFFFFE000CCAFB880] bsr netlink cmd(BSR_ADM_DISCONNECT:11) begin ->
00000792 bsr r0 pnode-id:1, cs(Unconnected), prole(Unknown), cflag(0x0), scf(0x0): Starting receiver thread (from worker [2108])
00000759 10/13/2020 16:1816:2012.97620237191149 [state_change_lock] [STATE:40] bsr_info<6> [0xFFFFE000CCAFB8800xFFFFE000CDDA5880] worker should not initiate state changes with CS_SERIALIZE current:FFFFF801707C9BD0FFFFE000CE0F9170 resource->worker.task:FFFFE000CDE0B820
0000079300000760 10/13/2020 16:1816:2012.97622187191349 [changeprint_clusterstate_wide_statechange] [TWOPCSTATE:3419] bsr_info<6> bsr r0 pnode-id:1, r(Secondarycs(Unconnected), prole(Unknown), fcflag(0x0), scf(0x280x2a): Preparing cluster-wide state change 2366568536 (0->1 496/16)
00000794conn_connect, conn( Unconnected -> Connecting )
00000761 10/13/2020 16:1816:2015.97622527224848 [changebsr_clusterdo_wide_statefeatures] [TWOPCPROTOCOL:3555] bsr_info<6> bsr r0 pnode-id:1, r(Secondarycs(Connecting), prole(Unknown), fcflag(0x0), scf(0x280x0): [TWOPC:2366568536] target_node_id(1) conn(Disconnecting) repl(-) disk(-) pdsk(-) role(-) peer(-) flags (8) 
00000795 Handshake to peer 1 successful: Agreed network protocol version 114
00000762 10/13/2020 16:1816:2015.97663567224916 [changebsr_clusterdo_wide_statefeatures] [TWOPCPROTOCOL:3656] bsr_info<6> bsr r0 r0 pnode-id:1, cs(Connecting), rprole(SecondaryUnknown), fcflag(0x0), scf(0x280x0): [TWOPC:2366568536] target_node_id(1) get_cluster_wide_reply (3) 
00000796  Feature flags enabled on protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
00000763 10/13/2020 16:1816:2015.97664127227332 [change_cluster_wide_stateconn_connect] [TWOPCSEND BUFFER:3727] bsr_info<6>warn<4> bsr r0 pnode-id:1, cs(Connecting), rprole(SecondaryUnknown), fcflag(0x0), scf(0x280x0): Statesend-buffering change 2366568536: primary_nodes=0, weak_nodes=0
00000797 disabled nc->sndbuf_size:0
00000764 10/13/2020 16:1816:2015.97664637227437 [changebsr_cluster_widethread_statestart] [TWOPCTHREAD:3811] bsr_info<6> bsr r0 pnode-id:1, cs(ConnectedConnecting), prole(SecondaryUnknown), cflag(0x10e0x0), scf(0x280x0): Cluster is now split
00000798 Starting ack_recv thread (from receiver [2808])
00000765 10/13/2020 16:1816:2015.97664977770404 [state_change_cluster_wide_statelock] [TWOPCSTATE:3940] bsr_info<6> bsr r0, r(Secondary), f(0x0), scf(0x28): Committing cluster-wide state change 2366568536 (0ms) (0->1)
00000799[0xFFFFE000CDA1A040] worker should not initiate state changes with CS_SERIALIZE current:FFFFE000CDAA58C0 resource->worker.task:FFFFE000CDE0B820
00000766 10/13/2020 16:1816:2015.97677707770628 [printchange_cluster_wide_state_change] [STATETWOPC:1934] bsr_info<6> bsr r0 pnode-id:1, cs(Connected), prolebsr r0, r(Secondary), cflagf(0x10e0x0), scf(0x2080x82a): conn_try_disconnect, conn( Connected -> Disconnecting ) peer( Secondary -> Unknown )
00000800Preparing cluster-wide state change 1853056548 (0->1 499/146)
00000767 10/13/2020 16:1816:2015.97678317770664 [printchange_cluster_wide_state_change] [STATETWOPC:2135] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, pdskr(UpToDateSecondary), prplf(Established0x0), pdvflagscf(0x1006000x82a): conn_try_disconnect, pdsk( UpToDate -> DUnknown ) repl( Established -> Off )
00000801[TWOPC:1853056548] target_node_id(1) conn(Connected) repl(-) disk(-) pdsk(-) role(Secondary) peer(-) flags (2058) 
00000768 10/13/2020 16:1816:2015.97682117776058 [bsr_recvchange_cluster_wide_state] [SOCKETTWOPC:1536] bsr_info<6> bsr r0 pnode-id:1, cs(Connected), proler(Secondary), cflagf(0x10e0x0), scf(0x2080x82a): socket data receive error(-15)
00000802[TWOPC:1853056548] target_node_id(1) get_cluster_wide_reply (3) 
00000769 10/13/2020 16:1816:2015.97689747776109 [bsrchange_cluster_ackwide_receiverstate] [CONNECTIONTWOPC:1637] bsr_info<6> bsr r0 pnode-id:1, csr(DisconnectingSecondary), prolef(Unknown0x0), cflagscf(0x10e), scf(0x0): ack_receiver terminated
000008030x82a): State change 1853056548: primary_nodes=0, weak_nodes=0
00000770 10/13/2020 16:1816:2015.97690287776145 [bsrchange_cluster_threadwide_setupstate] [THREADTWOPC:939] bsr_info<6> bsr r0 pnode-id:1, csr(DisconnectingSecondary), prole(Unknown), cflag(0x10ef(0x0), scf(0x00x82a): Terminating ack_recv thread
00000804 Committing cluster-wide state change 1853056548 (1ms) (0->1)
00000771 10/13/2020 16:1816:2015.97719907778471 [wprint_resyncstate_timerchange] [RESYNC/OVSTATE:10519] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, pdsk(DUnknowncs(Connecting), prole(Unknown), prplcflag(Off0xc), pdvflagscf(0x00xa0a): completed because it is not in the VerifyS or SyncTarget replication state.
00000805connect_work, conn( Connecting -> Connected ) peer( Unknown -> Secondary )
00000772 10/13/2020 16:1816:2015.97743977779527 [connreceive_disconnectSyncParam] [CONNECTIONPROTOCOL:929] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, cspdsk(DisconnectingDUnknown), proleprpl(UnknownOff), cflag(0x10e), scf(pdvflag(0x0): Connection closed
00000806 10/13/2020 16:18:20.9774928 [print_state_change] [STATE:19] bsr_info<6> bsr r0 pnode-id:1, cs(Disconnecting), prole(Unknown), cflag(0x10e), scf(0x23): conn_disconnect, conn( Disconnecting -> StandAlone )
00000807sync, resync_rate : 250k, c_plan_ahead : 20k, c_delay_target : 10k, c_fill_target : 100s, c_max_rate : 102400k, c_min_rate : 250k, ov_req_num : 10b, ov_req_interval : 100ms
00000773 10/13/2020 16:1816:2015.97753357781260 [bsrreceive_thread_setupsizes] [THREADPROTOCOL:932] bsr_info<6> bsr r0 pnode-id:1, cs(StandAlone), prole(Unknown), cflag(0x10e), scf/0 minor 2, ds(UpToDate), dvflag(0x0): Terminating receiver thread
00000808 10/13/2020 16:18:20.9777552 [NetlinkWorkThread] [NETLINK:20] bsr_info<6> [0xFFFFE000CCAFB880] bsr netlink cmd(BSR_ADM_DISCONNECT:11) done (cmd_pending:0) <-
00000809current_mydisk_size: 10860101632 bytes
00000774 10/13/2020 16:1816:2215.94782537781292 [NetlinkWorkThreadreceive_sizes] [NETLINKPROTOCOL:1833] bsr_info<6> [0xFFFFE000CCAAC040] bsr netlink cmd(BSR_ADM_CONNECT:10) begin ->
00000810bsr r0/0 minor 2 pnode-id:1, pdsk(DUnknown), prpl(Off), pdvflag(0x0): peer_current_size: 10860101632 bytes peer_user_size: 0 bytes peer_disk_size: 10860101632 bytes peer_max_size: 10860101632 bytes
00000775 10/13/2020 16:1816:2215.94783557781334 [statereceive_change_locksizes] [STATEPROTOCOL:4034] bsr_info<6> [0xFFFFE000CCAAC040] worker should not initiate state changes with CS_SERIALIZE current:FFFFF801707C9BD0 resource->worker.task:FFFFE000CDE0B820
00000811info<6> bsr r0/0 minor 2 pnode-id:1, pdsk(DUnknown), prpl(Off), pdvflag(0x100000): md_effective_size: 21211136 my_user_size: 0 my_max_size: 21211136
00000776 10/13/2020 16:1816:2215.94785197781365 [printget_max_stateagreeable_changesize] [STATEGENL:1916] bsr_info<6> bsr r0 pnode-id:1, cs(StandAlone), prole(Unknown/0 minor 2, ds(UpToDate), cflagdvflag(0x10e0x0), scf(0x2a): bsr_adm_connect, conn( StandAlone -> Unconnected )
00000812 : local node_id: 0
00000777 10/13/2020 16:1816:2215.94789047781387 [bsrget_max_threadagreeable_startsize] [THREADGENL:1117] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, cspdsk(UnconnectedDUnknown), proleprpl(UnknownOff), cflag(0x10e), scf pdvflag(0x100000): node id(1) bitmap index(0) bitmap uuid(0x0): Starting receiver thread (from worker [2108])
00000813flags(0x10) max size(21211136) disk state(DUnknown)
00000778 10/13/2020 16:1816:2215.94801507781429 [NetlinkWorkThreadreceive_sizes] [NETLINKPROTOCOL:2039] bsr_info<6> [0xFFFFE000CCAAC040] bsr netlink cmd(BSR_ADM_CONNECT:10) done (cmd_pending:0) <-
00000814bsr r0/0 minor 2 pnode-id:1, pdsk(DUnknown), prpl(Off), pdvflag(0x100000): Proceed with device size setting
00000779 10/13/2020 16:1816:2215.94802657782072 [stateget_max_changeagreeable_locksize] [STATEGENL:4016] bsr_info<6> [0xFFFFE000CE728040] worker should not initiate state changes with CS_SERIALIZE current:FFFFE000CE0F9170 resource->worker.task:FFFFE000CDE0B820
00000815bsr r0/0 minor 2, ds(UpToDate), dvflag(0x0): local node_id: 0
00000780 10/13/2020 16:1816:2215.94804167782109 [printget_max_stateagreeable_changesize] [STATEGENL:1917] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, cspdsk(UnconnectedDUnknown), proleprpl(UnknownOff), cflag(0xe), scf(0x2a): conn_connect, conn( Unconnected -> Connecting )
00000816 pdvflag(0x100000): node id(1) bitmap index(0) bitmap uuid(0x0) flags(0x10) max size(21211136) disk state(DUnknown)

resource down

Code Block
00000617 10/13/2020 16:1816:2511.95669412136805 [bsr_do_featuresNetlinkWorkThread] [PROTOCOLNETLINK:5518] bsr_info<6> [0xFFFFE000CCAC4880] bsr r0 pnode-id:1, cs(Connecting), prole(Unknown), cflag(0xe), scf(0x0): Handshake to peer 1 successful: Agreed network protocol version 114
00000817netlink cmd(BSR_ADM_DOWN:27) begin ->
00000618 10/13/2020 16:16:11.2137344 [FsctlLockVolume] [VOLUME:65] bsr_info<6> [0xFFFFE000CCAC4880] try lock volume(\Device\HarddiskVolume2)
00000680 10/13/2020 16:1816:2511.95670172534883 [bsr_do_featuresFsctlLockVolume] [PROTOCOLVOLUME:5623] bsr_info<6> bsr r0 pnode-id:1, cs(Connecting), prole(Unknown), cflag(0xe), scf(0x0): Feature flags enabled on protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
00000818 [0xFFFFE000CCAC4880] volume(\Device\HarddiskVolume2) locked. handle(0xFFFFFFFF80000DC8)
00000683 10/13/2020 16:1816:2511.95681412535024 [conn_connectFsctlFlushDismountVolume] [SEND BUFFERVOLUME:2762] bsr_warn<4> bsr r0 pnode-id:1, cs(Connecting), prole(Unknown), cflag(0xe), scf(0x0): send-buffering disabled nc->sndbuf_size:0
00000819info<6> [0xFFFFE000CCAC4880] try flush volume(\Device\HarddiskVolume2)
00000684 10/13/2020 16:1816:2511.95681802535729 [bsr_thread_startFsctlFlushDismountVolume] [THREADVOLUME:1163] bsr_info<6> bsr r0 pnode-id:1, cs(Connecting), prole(Unknown), cflag(0xe), scf(0x0): Starting ack_recv thread (from receiver [1676])
00000820[0xFFFFE000CCAC4880] volume(\Device\HarddiskVolume2) flushed
00000685 10/13/2020 16:16:11.2535766 [FsctlFlushDismountVolume] [VOLUME:64] bsr_info<6> [0xFFFFE000CCAC4880] try dismount volume(\Device\HarddiskVolume2)
00000686 10/13/2020 16:1816:2611.04243672559822 [state_change_lockFsctlFlushDismountVolume] [STATEVOLUME:4019] bsr_info<6> [0xFFFFE000CDA1A0400xFFFFE000CCAC4880] worker should not initiate state changes with CS_SERIALIZE current:FFFFE000CDAA58C0 resource->worker.task:FFFFE000CDE0B820
00000821 volume(\Device\HarddiskVolume2) dismounted
00000687 10/13/2020 16:1816:2611.04245862560178 [changeprint_clusterstate_wide_statechange] [TWOPCSTATE:3418] bsr_info<6> bsr r0, r(SecondaryPrimary), f(0x00x11), scf(0x82a0x83c): Preparing cluster-wide state change 2387348015 (0->1 499/146)
00000822change_role, role( Primary -> Secondary )
00000688 10/13/2020 16:1816:2611.04247332568256 [change_cluster_widereceive_stateuuids] [TWOPCUUID:3516] bsr_info<6>warn<4> bsr r0, r(Secondary), f(0x0), scf(0x82a): [TWOPC:2387348015] target_node_id(1) conn(Connected) repl(-) disk(-) pdsk(-) role(Secondary) peer(-) flags (2058) 
00000823/0 minor 2 pnode-id:1, pdsk(UpToDate), prpl(Established), pdvflag(0x100600): receive new current but not update UUID: 83F530CA41FA9868
00000689 10/13/2020 16:1816:2611.04304892568317 [changebsr_clusteruuid_wide_statecompare] [TWOPCRESYNC/OV:36197] bsr_info<6> bsr r0, r(Secondary)/0 minor 2, fds(0x0UpToDate), scfdvflag(0x82a0x2): [TWOPC:2387348015] target_node_id(1) get_cluster_wide_reply (3) 
00000824 Local and peer current UUIDs are the same. rule(40), res(0)
00000690 10/13/2020 16:1816:2611.04305602569857 [change_cluster_wide_stateFsctlUnlockVolume] [TWOPCVOLUME:3761] bsr_info<6> bsr r0, r(Secondary), f(0x0), scf(0x82a): State change 2387348015: primary_nodes=0, weak_nodes=0
00000825[0xFFFFE000CCAC4880] unlock volume(\Device\HarddiskVolume2)
00000691 10/13/2020 16:16:11.2576899 [FsctlUnlockVolume] [VOLUME:26] bsr_info<6> [0xFFFFE000CCAC4880] volume(\Device\HarddiskVolume2) unlocked
00000692 10/13/2020 16:1816:2611.04306112577179 [state_change_cluster_wide_statelock] [TWOPCSTATE:3940] bsr_info<6> bsr r0, r(Secondary), f(0x0), scf(0x82a): Committing cluster-wide state change 2387348015 (0ms) (0->1)
00000826[0xFFFFE000CCAC4880] worker should not initiate state changes with CS_SERIALIZE current:FFFFF801707C9BD0 resource->worker.task:FFFFE000CDB38300
00000693 10/13/2020 16:1816:2611.04323172577328 [printchange_cluster_wide_state_change] [STATETWOPC:1934] bsr_info<6> bsr r0 pnode-id:1, csr(ConnectingSecondary), prole(Unknown), cflag(0xef(0x11), scf(0xa0a0x28): connect_work, conn( Connecting -> Connected ) peer( Unknown -> Secondary )
00000827Preparing cluster-wide state change 1834520240 (0->1 496/16)
00000694 10/13/2020 16:1816:2611.04349602577355 [receive_SyncParamchange_cluster_wide_state] [PROTOCOLTWOPC:2935] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, pdskr(DUnknownSecondary), prplf(Off0x11), pdvflagscf(0x00x28): sync, resync_rate : 250k, c_plan_ahead : 20k, c_delay_target : 10k, c_fill_target : 100s, c_max_rate : 102400k, c_min_rate : 250k, ov_req_num : 10b, ov_req_interval : 100ms
00000828 [TWOPC:1834520240] target_node_id(1) conn(Disconnecting) repl(-) disk(-) pdsk(-) role(-) peer(-) flags (8) 
00000695 10/13/2020 16:1816:2611.04350802580212 [receive_sizeschange_cluster_wide_state] [PROTOCOLTWOPC:3236] bsr_info<6> bsr r0/0 minor 2, r(Secondary), dsf(UpToDate0x11), dvflagscf(0x00x28): current_mydisk_size: 10860101632 bytes
00000829 [TWOPC:1834520240] target_node_id(1) get_cluster_wide_reply (3) 
00000696 10/13/2020 16:1816:2611.04351142580251 [receive_sizeschange_cluster_wide_state] [PROTOCOLTWOPC:3337] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, pdskr(DUnknownSecondary), prplf(Off0x11), pdvflagscf(0x00x28): peer_current_size: 10860101632 bytes peer_user_size: 0 bytes peer_disk_size: 10860101632 bytes peer_max_size: 10860101632 bytes
00000830State change 1834520240: primary_nodes=0, weak_nodes=0
00000697 10/13/2020 16:1816:2611.04351682580275 [receive_sizeschange_cluster_wide_state] [PROTOCOLTWOPC:3438] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, pdskcs(DUnknownConnected), prplprole(OffSecondary), pdvflagcflag(0x1000000x210e): md_effective_size, scf(0x28): 21211136 my_user_size: 0 my_max_size: 21211136
00000831Cluster is now split
00000698 10/13/2020 16:1816:2611.04352092580300 [getchange_maxcluster_agreeablewide_sizestate] [GENLTWOPC:1639] bsr_info<6> bsr r0/0 minor 2, r(Secondary), dsf(UpToDate0x11), dvflagscf(0x00x28): local node_id: 0
00000832 Committing cluster-wide state change 1834520240 (0ms) (0->1)
00000699 10/13/2020 16:1816:2611.04352362584388 [get_max_agreeable_sizeReceive] [GENLSOCKET:1766] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, pdsk(DUnknown), prpl(Off), pdvflag(0x100000): node id(1) bitmap index(0) bitmap uuid(0x0) flags(0x10) max size(21211136) disk state(DUnknown)
00000833 [0xFFFFE000CDB66880] receiver => Recv multiWait error. err(STATUS_CONNECTION_RESET) wsk(0xFFFFE000CE2A8198) size(16)
00000700 10/13/2020 16:1816:2611.04352922584579 [receivebsr_sizesrecv] [PROTOCOLSOCKET:3914] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, pdsk(DUnknowncs(Connected), prole(Secondary), prplcflag(Off0x210e), pdvflagscf(0x1000000x28): Proceedsocket withreset devicedue sizeto settingpeer.
0000083400000701 10/13/2020 16:1816:2611.04364432584757 [getprint_maxstate_agreeable_sizechange] [GENLSTATE:1619] bsr_info<6> bsr r0/0 minor 2, ds(UpToDate pnode-id:1, cs(Connected), prole(Secondary), cflag(0x210e), dvflagscf(0x00x21): local node_id: 0
00000835 bsr_recv, conn( Connected -> BrokenPipe ) peer( Secondary -> Unknown )
00000702 10/13/2020 16:1816:2611.04364742584805 [getprint_maxstate_agreeable_sizechange] [GENLSTATE:1721] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, pdsk(DUnknownUpToDate), prpl(OffEstablished), pdvflag(0x1000000x100600): node id(1) bitmap index(0) bitmap uuid(0x0) flags(0x10) max size(21211136) disk state(DUnknown)

resource disconnect

Code Block
00000791bsr_recv, pdsk( UpToDate -> DUnknown ) repl( Established -> Off )
00000703 10/13/2020 16:1816:2011.97619142585071 [NetlinkWorkThreadbsr_recv_all_warn] [NETLINKPROTOCOL:1864] bsr_info<6> [0xFFFFE000CCAFB880] bsr netlink cmd(BSR_ADM_DISCONNECT:11) begin ->
00000792warn<4> bsr r0 pnode-id:1, cs(BrokenPipe), prole(Unknown), cflag(0x211e), scf(0x0): short read (expected size 16)
00000704 10/13/2020 16:1816:2011.97620232585247 [print_state_change_lock] [STATE:4019] bsr_info<6> [0xFFFFE000CCAFB880] worker should not initiate state changes with CS_SERIALIZE current:FFFFF801707C9BD0 resource->worker.task:FFFFE000CDE0B820
00000793 bsr r0 pnode-id:1, cs(BrokenPipe), prole(Unknown), cflag(0x211e), scf(0x208): conn_try_disconnect, conn( BrokenPipe -> Disconnecting )
00000705 10/13/2020 16:1816:2011.97622182586495 [changebsr_clusterack_wide_statereceiver] [TWOPCCONNECTION:3416] bsr_info<6> bsr r0 pnode-id:1, cs(Disconnecting), rprole(SecondaryUnknown), fcflag(0x00x211e), scf(0x280x0): Preparing cluster-wide state change 2366568536 (0->1 496/16)
00000794 ack_receiver terminated
00000706 10/13/2020 16:1816:2011.97622522586532 [changebsr_clusterthread_wide_statesetup] [TWOPCTHREAD:359] bsr_info<6> bsr r0, r(Secondary), f(0x0), scf(0x28): [TWOPC:2366568536] target_node_id(1) conn pnode-id:1, cs(Disconnecting), replprole(-Unknown), diskcflag(-0x211e), pdskscf(-0x0): role(-) peer(-) flags (8) 
00000795 Terminating ack_recv thread
00000707 10/13/2020 16:1816:2011.97663562587692 [changew_clusterresync_wide_statetimer] [TWOPCRESYNC/OV:36105] bsr_info<6> bsr r0, r(Secondary/0 minor 2 pnode-id:1, pdsk(DUnknown), prpl(Off), fpdvflag(0x0), scf(0x28): [TWOPC:2366568536] target_node_id(1) get_cluster_wide_reply (3) 
00000796: completed because it is not in the VerifyS or SyncTarget replication state.
00000708 10/13/2020 16:1816:2011.97664122591157 [change_cluster_wide_stateconn_disconnect] [TWOPCCONNECTION:379] bsr_info<6> bsr r0 pnode-id:1, cs(Disconnecting), rprole(SecondaryUnknown), fcflag(0x00x211e), scf(0x280x0): StateConnection changeclosed
2366568536: primary_nodes=0, weak_nodes=0
00000797 00000709 10/13/2020 16:1816:2011.97664632591688 [changeprint_clusterstate_wide_statechange] [TWOPCSTATE:3819] bsr_info<6> bsr r0 pnode-id:1, cs(ConnectedDisconnecting), prole(SecondaryUnknown), cflag(0x10e)0x211e), scf(0x23): conn_disconnect, scfconn(0x28): ClusterDisconnecting is-> nowStandAlone split)
0000079800000710 10/13/2020 16:1816:2011.97664972591981 [changebsr_clusterthread_wide_statesetup] [TWOPCTHREAD:399] bsr_info<6> bsr r0 pnode-id:1, r(Secondarycs(StandAlone), prole(Unknown), fcflag(0x00x211e), scf(0x280x0): CommittingTerminating cluster-widereceiver state change 2366568536 (0ms) (0->1)
00000799 thread
00000711 10/13/2020 16:1816:2011.97677702592468 [printbsr_statethread_changesetup] [STATETHREAD:199] bsr_info<6> bsr r0 pnode-id:1, cs(ConnectedStandAlone), prole(SecondaryUnknown), cflag(0x10e0x211e), scf(0x2080x0): conn_try_disconnect, conn( Connected -> Disconnecting ) peer( Secondary -> Unknown )
00000800Terminating sender thread
00000712 10/13/2020 16:1816:2011.97678312593036 [printbsr_statedestroy_changeconnection] [STATECONNECTION:211] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, pdskcs(UpToDateStandAlone), prplprole(EstablishedUnknown), pdvflagcflag(0x100600): conn_try_disconnect0x311e), pdsk( UpToDate -> DUnknown ) repl( Established -> Off )
00000801 scf(0x0): bsr_destroy_connection
00000713 10/13/2020 16:1816:2011.97682112593241 [bsrstate_change_recvlock] [SOCKETSTATE:1540] bsr_info<6> bsr[0xFFFFE000CCAC4880] r0 pnode-id:1, cs(Connected), prole(Secondary), cflag(0x10e), scf(0x208): socket data receive error(-15)
00000802worker should not initiate state changes with CS_SERIALIZE current:FFFFF801707C9BD0 resource->worker.task:FFFFE000CDB38300
00000714 10/13/2020 16:1816:2011.97689742593339 [bsrprint_ackstate_receiverchange] [CONNECTIONSTATE:1620] bsr_info<6> bsr r0 pnode-id:1/0 minor 2, csds(DisconnectingUpToDate), proledvflag(Unknown)0x2): change_disk_state, cflag(0x10e), scf(0x0): ack_receiver terminated
00000803disk( UpToDate -> Detaching )
00000715 10/13/2020 16:1816:2011.97690282593378 [bsrfinish_threadstate_setupchange] [THREADUUID:919] bsr_info<6> bsr r0 pnode-id:1/0 minor 2, csds(DisconnectingUpToDate), proledvflag(Unknown0x10002), cflag(0x10e), scf(0x0): Terminating ack_recv thread
00000804: detaching to current UUID: 83F530CA41FA9868
00000716 10/13/2020 16:1816:2011.97719902593863 [wprint_resyncstate_timerchange] [RESYNC/OVSTATE:10520] bsr_info<6> bsr r0/0 minor 2 pnode-id:1, pdskds(DUnknownDetaching), prpldvflag(Off)0x1002): change_disk_state, pdvflagdisk(0x0): completedDetaching because-> itDiskless is not in the VerifyS or SyncTarget replication state.
00000805)
00000717 10/13/2020 16:1816:2011.97743972593963 [connadm_disconnectdetach] [CONNECTIONGENL:942] bsr_info<6> bsr r0 pnode-id:1, cs(Disconnecting), prole(Unknown), cflag(0x10e), scf(0x0): Connection closed
00000806  [0xFFFFE000CCAC4880] wait event interruptible timeout. time out(3000) disk state(Diskless)
00000718 10/13/2020 16:1816:2011.97749282599158 [printbsr_statebm_changeresize] [STATEBITMAP:1923] bsr_info<6> bsr r0 pnode-id:1, cs(Disconnecting), prole(Unknown/0 minor 2, ds(Diskless), cflag(0x10e), scf(0x23dvflag(0x2): conn_disconnect, conn( Disconnecting -> StandAlone )
00000807bitmap resize called with capacity(0)
00000719 10/13/2020 16:1816:2011.97753352601141 [bsr_thread_setup] [THREAD:910] bsr_info<6> bsr r0 pnode-id:1, csr(StandAloneSecondary), prole(Unknown), cflag(0x10ef(0x11), scf(0x0): Terminating receiverworker thread
0000080800000720 10/13/2020 16:18:20.977755216:11.2601562 [mvolWorkThread] [THREAD:20] bsr_info<6> [0xFFFFE000CDC92880] Terminating mvolWorkThread
00000721 10/13/2020 16:16:11.2603818 [NetlinkWorkThread] [NETLINK:20] bsr_info<6> [0xFFFFE000CCAFB8800xFFFFE000CCAC4880] bsr netlink cmd(BSR_ADM_DISCONNECTDOWN:1127) done (cmd_pending:0) <-

...