INFO logs

Log path is: /data/yuga/data/yb-data/master/logs/yb-master.INFO
Showing last 1048576 bytes of log

request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:21:22.680506 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76068.784s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:22.680526 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:21:23.269501 620836 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:23.449012 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:21:24.094463 727730 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:21:24.094555 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76070.198s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:24.094575 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:21:24.453104 620923 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:24.641955 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:21:25.443089 727732 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:21:25.443161 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76071.546s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:25.443194 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:21:25.644472 620932 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:25.847635 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:21:26.851316 622141 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:26.879772 727733 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:21:26.879843 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76072.983s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:26.879858 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:27.063220 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:21:27.969969 620845 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715773.959s
W1019 08:21:28.065583 620935 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:28.286815 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:21:28.428023 727734 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:21:28.428104 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76074.531s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:28.428113 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:21:29.290709 620823 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:29.365960 620817 tcp_stream.cc:329] { local: 192.241.138.78:34689 remote: 159.89.48.63:9100 }:  Recv failed: Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
I1019 08:21:29.520344 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:21:29.564111 727736 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:21:29.564186 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76075.667s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:29.564196 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:21:30.522976 620911 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:30.758977 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:21:30.808333 727737 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:21:30.808437 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76076.911s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:30.808451 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:21:31.759672 685426 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:32.003948 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:21:32.580945 727740 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:21:32.581020 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76078.684s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:32.581032 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:21:33.006572 620828 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:33.263669 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:21:33.445706 620840 cluster_balance_util.cc:209] Master leader not received heartbeat from ts b27bb468e6ee4cca83d06dfe5ae2b891. Only performing leader balancing for tables with replicas in this TS.
I1019 08:21:33.446435 620840 cluster_balance.cc:575] Skipping removing replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:21:33.446444 620840 cluster_balance.cc:598] Skipping adding replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:21:33.829023 727741 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:21:33.829105 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76079.932s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:33.829129 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:21:34.266990 620927 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:34.530019 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:21:34.603406 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cbcfb0158) server 159.89.49.34:33241 => 192.241.138.78:7100 - it has been idle for 65.0007s
W1019 08:21:35.533001 620935 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:35.678098 727742 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:21:35.678181 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76081.781s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:35.678192 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:35.803948 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:21:36.805116 685424 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:37.089699 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:21:37.284643 727745 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:21:37.284722 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76083.388s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:37.284732 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:21:38.091084 620907 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:38.382663 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:21:38.984365 727747 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:21:38.984437 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76085.088s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:38.984448 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:21:39.385023 620950 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:39.686462 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:21:40.636447 727748 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:21:40.636528 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76086.740s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:40.636538 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:21:40.689118 620835 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:41.004334 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:21:42.006419 620909 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:42.024092 620845 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715759.905s
I1019 08:21:42.142566 727749 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:21:42.142658 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76088.246s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:42.142668 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:42.325119 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:21:43.325690 620823 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:43.656896 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:21:43.793388 727750 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:21:43.793488 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76089.897s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:43.793511 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:21:44.659672 620931 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:44.998642 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:21:45.300531 727751 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:21:45.300617 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76091.404s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:45.300628 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:21:46.001544 620837 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:46.347959 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:21:46.885622 727752 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:21:46.885725 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76092.989s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:46.885741 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:21:47.352077 622141 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:47.705235 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:21:48.542266 727754 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:21:48.542388 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76094.645s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:48.542410 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:21:48.708953 620935 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:49.072724 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:21:49.847522 727755 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:21:49.847622 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76095.951s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:49.847635 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:21:50.074846 620823 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:50.202706 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cbcfb08d8) server 159.89.49.34:39431 => 192.241.138.78:7100 - it has been idle for 65.0987s
I1019 08:21:50.450698 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:21:51.310495 727757 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:21:51.310586 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76097.414s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:51.310597 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:21:51.451257 620911 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:51.835058 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:21:52.794533 727758 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:21:52.794613 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76098.898s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:52.794623 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:21:52.838675 685426 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:53.227411 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:21:53.958688 727759 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:21:53.958776 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76100.062s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:53.958787 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:21:54.229095 620828 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:54.504680 620845 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715747.424s
I1019 08:21:54.626780 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:21:55.629174 620832 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:55.745460 727762 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:21:55.745533 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76101.849s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:55.745544 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:56.036041 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:21:57.039599 620823 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:57.224967 727764 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:21:57.225036 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76103.328s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:57.225045 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:57.459757 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:21:58.462023 620907 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:21:58.884141 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:21:58.947295 727767 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:21:58.947365 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76105.050s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:21:58.947407 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:21:59.887207 620921 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:00.320793 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:00.732443 727768 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:00.732543 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76106.836s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:00.732561 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:01.322798 620927 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:01.766330 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:02.464108 727770 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:02.464182 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76108.567s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:02.464195 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:02.766994 620817 client_master_rpc.cc:79] 0x0000246cbf3c6a98 -> LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2): Failed: Timed out (yb/rpc/rpc.cc:223): LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2) passed its deadline 2656297.378s (passed: 1.001s)
W1019 08:22:02.767089 620817 meta_cache.cc:967] 0x0000246cbf3c6a98 -> LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2): Timed out (yb/client/client_master_rpc.cc:123): LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2) timed out after deadline expired, passed 1.001s of 0.686s
I1019 08:22:02.767135 620853 client-internal.cc:2831] Reinitialize master addresses from file: /data/yuga/conf/master.conf
I1019 08:22:02.767208 620853 client-internal.cc:2860] New master addresses: [159.89.49.34:7100,192.241.138.78:7100,159.89.48.63:7100, 159.89.49.34:7100, 192.241.138.78:7100, 159.89.48.63:7100]
W1019 08:22:02.918224 620817 tablet_rpc.cc:497] Timed out (yb/rpc/rpc.cc:223): Failed Read(tablet: 38eb3a3d9aea473396f6999193c978c5, num_ops: 1, num_attempts: 148, txn: 00000000-0000-0000-0000-000000000000, subtxn: [none]) to tablet 38eb3a3d9aea473396f6999193c978c5 (no tablet server available) after 148 attempt(s): Read(tablet: 38eb3a3d9aea473396f6999193c978c5, num_ops: 1, num_attempts: 148, txn: 00000000-0000-0000-0000-000000000000, subtxn: [none]) passed its deadline 2656297.378s (passed: 60.465s): Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
W1019 08:22:02.918380 620857 xcluster_safe_time_service.cc:154] Failure in XClusterSafeTime task: IO error (yb/client/batcher.cc:105): Scan of table xcluster_safe_time failed: IO error (yb/client/batcher.cc:105): Errors occurred while reaching out to the tablet servers. Could not compute xcluster safe time.: Errors occurred while reaching out to the tablet servers
I1019 08:22:03.202500 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cbb825cd8) server 159.89.49.34:37545 => 192.241.138.78:7100 - it has been idle for 65.0987s
I1019 08:22:03.576469 620840 cluster_balance_util.cc:209] Master leader not received heartbeat from ts b27bb468e6ee4cca83d06dfe5ae2b891. Only performing leader balancing for tables with replicas in this TS.
I1019 08:22:03.577232 620840 cluster_balance.cc:575] Skipping removing replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:22:03.577243 620840 cluster_balance.cc:598] Skipping adding replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:22:03.630772 727771 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:03.630842 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76109.734s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:03.630852 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:03.919559 620817 tcp_stream.cc:329] { local: 192.241.138.78:42649 remote: 159.89.48.63:9100 }:  Recv failed: Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
I1019 08:22:03.926445 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:04.822613 727772 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:04.822680 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76110.926s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:04.822691 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:04.929106 650391 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:04.953251 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:22:05.953673 620932 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:05.987797 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:06.626794 727773 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:06.626971 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76112.730s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:06.626988 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:06.992762 622143 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:07.032233 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:22:08.035713 620832 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:08.041709 727775 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:08.041795 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76114.145s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:08.041826 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:08.088838 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:08.192803 620859 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715733.736s
W1019 08:22:09.092474 620922 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:09.146929 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:09.292763 727777 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:09.292850 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76115.396s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:09.292862 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:10.149377 620831 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:10.212009 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:10.614171 727779 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:10.614239 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76116.717s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:10.614248 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:11.213322 620907 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:11.287315 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:22:12.292583 620921 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:12.303803 727780 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:12.303870 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76118.407s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:12.303880 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:12.373219 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:22:13.374399 620828 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:13.463025 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:13.477488 727781 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:13.477571 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76119.581s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:13.477581 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:14.463725 620927 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:14.564247 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:14.882534 727782 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:14.882611 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76120.986s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:14.882620 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:15.565582 620823 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:15.674532 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:16.137624 727783 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:16.137713 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76122.241s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:16.137723 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:16.677753 620911 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:16.793253 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:22:17.795780 685426 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:17.915766 727784 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:17.915865 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76124.019s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:17.915891 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:17.924559 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:18.046958 620845 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715723.882s
W1019 08:22:18.927134 620932 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:19.066882 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:19.614566 727787 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:19.614660 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76125.718s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:19.614679 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:20.070515 620927 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:20.214040 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:20.989174 727788 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:20.989246 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76127.092s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:20.989256 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:21.215715 620833 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:21.370416 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:22.292829 727789 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:22.292901 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76128.396s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:22.292912 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:22.372203 620905 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:22.402722 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cba708f18) server 159.89.49.34:33251 => 192.241.138.78:7100 - it has been idle for 65.0007s
I1019 08:22:22.533234 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:22:23.537328 685424 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:23.589658 727793 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:23.589745 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76129.693s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:23.589759 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:23.710156 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:22:24.714560 620907 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:24.897989 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:25.344393 727797 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:25.344449 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76131.448s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:25.344457 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:25.902180 620921 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:26.092339 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:22:27.093287 620828 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:27.210047 727799 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:27.210129 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76133.313s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:27.210150 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:27.294134 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:22:28.298825 620927 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:28.512409 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:28.901738 727800 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:28.901849 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76135.005s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:28.901870 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:29.516469 620833 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:29.735020 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:30.637190 727802 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:30.637315 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76136.740s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:30.637332 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:30.736884 620905 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:30.963924 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:22:31.964957 685424 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:31.994367 727803 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:31.994468 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76138.098s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:31.994483 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:32.041497 620817 tcp_stream.cc:329] { local: 192.241.138.78:45541 remote: 159.89.48.63:9100 }:  Recv failed: Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
I1019 08:22:32.200003 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:33.003250 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cba7088d8) server 159.89.49.34:37243 => 192.241.138.78:7100 - it has been idle for 65.1007s
W1019 08:22:33.202389 620907 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:33.449815 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:33.517053 727804 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:33.517128 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76139.620s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:33.517138 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:33.715070 620840 cluster_balance_util.cc:209] Master leader not received heartbeat from ts b27bb468e6ee4cca83d06dfe5ae2b891. Only performing leader balancing for tables with replicas in this TS.
I1019 08:22:33.715950 620840 cluster_balance.cc:575] Skipping removing replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:22:33.715961 620840 cluster_balance.cc:598] Skipping adding replicas. Only leader balancing table 000033c100003000800000000000567c
W1019 08:22:34.454964 620921 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:34.705893 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:35.215745 727806 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:35.215821 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76141.319s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:35.215838 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:35.710079 620828 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:35.974501 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:36.499225 620859 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715705.430s
W1019 08:22:36.976768 620832 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:36.999524 727807 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:36.999606 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76143.103s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:36.999629 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:37.252642 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:38.153169 727808 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:38.153239 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76144.256s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:38.153250 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:38.254667 620922 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:38.538301 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:22:39.542835 620831 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:39.549373 727810 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:39.549471 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76145.653s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:39.549489 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:39.831104 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:22:40.833983 620931 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:41.128468 727811 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:41.128568 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76147.232s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:41.128588 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:41.134130 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:22:42.137897 620950 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:42.444548 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:42.848052 727814 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:42.848121 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76148.951s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:42.848131 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:43.449560 620832 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:43.769708 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:44.644769 727816 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:44.644855 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76150.748s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:44.644866 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:44.770299 620823 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:45.095577 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:46.022399 727817 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:46.022475 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76152.126s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:46.022483 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:46.098966 620911 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:46.431725 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:47.003190 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cba708b58) server 159.89.49.34:33363 => 192.241.138.78:7100 - it has been idle for 65.0007s
I1019 08:22:47.292027 727818 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:47.292096 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76153.395s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:47.292106 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:47.434998 685426 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:47.774816 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:48.507099 727819 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:48.507177 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76154.610s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:48.507200 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:48.779901 620837 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:49.137547 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:50.051211 727820 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:50.051330 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76156.154s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:50.051353 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:50.141942 622143 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:50.503862 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:51.321004 727821 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:51.321094 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76157.424s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:51.321115 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:51.506721 620832 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:51.565749 620859 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715690.363s
I1019 08:22:51.879726 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:22:52.884663 620922 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:53.080138 727823 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:53.080241 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76159.183s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:53.080258 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:53.265004 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:22:54.269829 620831 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:54.660562 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:54.946223 727824 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:54.946326 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76161.049s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:54.946338 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:55.663614 620923 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:56.066569 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:56.347324 727826 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:56.347441 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76162.450s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:56.347451 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:57.066901 620950 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:57.474462 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:58.178073 727828 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:58.178170 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76164.281s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:58.178181 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:58.476922 620927 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:22:58.894342 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:22:59.503041 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cba708658) server 159.89.49.34:33995 => 192.241.138.78:7100 - it has been idle for 65.0007s
I1019 08:22:59.740684 727829 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:22:59.740756 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76165.844s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:22:59.740765 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:22:59.895700 620905 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:00.324990 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:23:01.325932 620931 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:01.595244 727831 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:01.595328 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76167.698s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:01.595340 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:01.762071 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:23:02.763967 650391 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:03.203878 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:03.438923 727832 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:03.439003 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76169.542s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:03.439014 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:03.854048 620840 cluster_balance_util.cc:209] Master leader not received heartbeat from ts b27bb468e6ee4cca83d06dfe5ae2b891. Only performing leader balancing for tables with replicas in this TS.
I1019 08:23:03.854816 620840 cluster_balance.cc:575] Skipping removing replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:23:03.854828 620840 cluster_balance.cc:598] Skipping adding replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:23:04.208217 620817 client_master_rpc.cc:79] 0x0000246cbb6fe718 -> LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2): Failed: Timed out (yb/rpc/rpc.cc:223): LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2) passed its deadline 2656358.844s (passed: 1.005s)
W1019 08:23:04.208302 620817 meta_cache.cc:967] 0x0000246cbb6fe718 -> LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2): Timed out (yb/client/client_master_rpc.cc:123): LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2) timed out after deadline expired, passed 1.005s of 0.715s
I1019 08:23:04.208340 620853 client-internal.cc:2831] Reinitialize master addresses from file: /data/yuga/conf/master.conf
I1019 08:23:04.208405 620853 client-internal.cc:2860] New master addresses: [159.89.49.34:7100,192.241.138.78:7100,159.89.48.63:7100, 159.89.49.34:7100, 192.241.138.78:7100, 159.89.48.63:7100]
W1019 08:23:04.360224 620817 tablet_rpc.cc:497] Timed out (yb/rpc/rpc.cc:223): Failed Read(tablet: 38eb3a3d9aea473396f6999193c978c5, num_ops: 1, num_attempts: 148, txn: 00000000-0000-0000-0000-000000000000, subtxn: [none]) to tablet 38eb3a3d9aea473396f6999193c978c5 (no tablet server available) after 148 attempt(s): Read(tablet: 38eb3a3d9aea473396f6999193c978c5, num_ops: 1, num_attempts: 148, txn: 00000000-0000-0000-0000-000000000000, subtxn: [none]) passed its deadline 2656358.844s (passed: 60.441s): Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
W1019 08:23:04.360345 620857 xcluster_safe_time_service.cc:154] Failure in XClusterSafeTime task: IO error (yb/client/batcher.cc:105): Scan of table xcluster_safe_time failed: IO error (yb/client/batcher.cc:105): Errors occurred while reaching out to the tablet servers. Could not compute xcluster safe time.: Errors occurred while reaching out to the tablet servers
I1019 08:23:04.822965 620845 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715677.106s
I1019 08:23:05.155026 727836 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:05.155130 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76171.258s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:05.155153 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:05.365360 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:23:06.367549 620831 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:06.371548 620817 tcp_stream.cc:329] { local: 192.241.138.78:40323 remote: 159.89.48.63:9100 }:  Recv failed: Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
I1019 08:23:06.383817 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:06.716605 727838 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:06.716674 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76172.820s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:06.716691 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:07.385095 620923 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:07.415083 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:08.314218 727839 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:08.314306 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76174.417s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:08.314317 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:08.420055 620950 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:08.462313 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:23:09.463099 620835 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:09.509140 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:10.089854 727841 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:10.089926 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76176.193s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:10.089936 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:10.511957 620909 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:10.569036 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:23:11.569366 620903 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:11.636332 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:11.907482 727842 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:11.907554 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76178.011s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:11.907565 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:12.638468 620936 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:12.709712 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:13.203178 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cb8e58dd8) server 159.89.49.34:46015 => 192.241.138.78:7100 - it has been idle for 65.0997s
I1019 08:23:13.584614 727844 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:13.584714 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76179.688s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:13.584724 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:13.711048 620907 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:13.793978 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:23:14.797431 620921 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:14.892297 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:15.116300 727846 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:15.116379 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76181.219s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:15.116400 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:15.446372 620845 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715666.483s
W1019 08:23:15.895977 620828 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:16.000973 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:16.863533 727847 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:16.863646 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76182.967s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:16.863659 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:17.004268 620935 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:17.117916 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:23:18.120807 620823 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:18.240528 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:18.466145 727849 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:18.466225 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76184.569s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:18.466238 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:19.241343 620911 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:19.365351 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:19.681903 727851 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:19.681980 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76185.785s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:19.681996 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:20.368011 620837 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:20.505923 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:20.808979 727852 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:20.809060 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76186.912s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:20.809070 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:21.507220 622141 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:21.654333 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:21.975728 727853 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:21.975814 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76188.079s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:21.975831 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:22.657691 620936 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:22.813799 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:23.003449 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cb8e58798) server 159.89.49.34:43489 => 192.241.138.78:7100 - it has been idle for 65.0007s
I1019 08:23:23.126358 727854 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:23.126461 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76189.230s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:23.126477 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:23.814664 620836 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:23.982290 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:24.884061 727857 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:24.884140 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76190.987s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:24.884150 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:24.983166 620923 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:25.157636 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:25.766816 620845 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715656.162s
I1019 08:23:26.016139 727858 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:26.016216 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76192.119s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:26.016227 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:26.159912 620950 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:26.340196 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:23:27.341714 620835 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:27.533113 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:27.669230 727859 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:27.669319 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76193.772s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:27.669329 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:28.537320 620909 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:28.734647 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:28.804811 727860 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:28.804877 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76194.908s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:28.804894 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:29.736220 620903 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:29.945667 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:30.670965 727863 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:30.671052 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76196.774s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:30.671063 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:30.949028 620936 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:31.169562 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:23:32.171813 620836 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:32.400919 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:32.489660 727865 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:32.489742 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76198.593s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:32.489756 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:33.405156 650391 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:33.644035 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:33.980420 620840 cluster_balance_util.cc:209] Master leader not received heartbeat from ts b27bb468e6ee4cca83d06dfe5ae2b891. Only performing leader balancing for tables with replicas in this TS.
I1019 08:23:33.981145 620840 cluster_balance.cc:575] Skipping removing replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:23:33.981153 620840 cluster_balance.cc:598] Skipping adding replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:23:34.029313 727866 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:34.029388 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76200.132s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:34.029399 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:34.645385 620932 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:34.728835 620817 tcp_stream.cc:329] { local: 192.241.138.78:40079 remote: 159.89.48.63:9100 }:  Recv failed: Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
I1019 08:23:34.896420 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:35.166857 727867 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:35.166932 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76201.270s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:35.166942 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:35.901068 622143 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:36.156868 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:36.789455 727869 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:36.789522 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76202.893s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:36.789532 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:37.158875 620832 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:37.424345 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:23:38.427004 620922 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:38.474177 727873 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:38.474251 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76204.577s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:38.474261 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:38.702534 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:23:39.705523 620911 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:39.779264 727876 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:39.779426 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76205.882s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:39.779458 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:39.988657 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:23:40.992519 685426 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:41.283203 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:41.477950 727878 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:41.478027 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76207.581s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:41.478039 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:41.503402 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cba7108d8) server 159.89.49.34:43919 => 192.241.138.78:7100 - it has been idle for 65.1007s
W1019 08:23:42.284745 620837 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:42.581971 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:43.077185 727879 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:43.077302 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76209.180s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:43.077319 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:43.586076 622141 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:43.891667 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:44.430920 620859 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715637.498s
W1019 08:23:44.896508 620935 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:44.928229 727880 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:44.928320 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76211.031s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:44.928332 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:45.212702 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:23:46.213362 620823 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:46.540621 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:46.780864 727882 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:46.780939 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76212.884s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:46.780958 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:47.544198 620911 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:47.880877 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:48.299952 727883 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:48.300030 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76214.403s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:48.300041 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:48.881302 685426 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:49.226706 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:49.968530 727885 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:49.968598 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76216.072s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:49.968609 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:50.229270 620950 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:50.581120 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:23:51.586426 620927 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:51.830054 727888 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:51.830125 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76217.933s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:51.830135 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:51.949575 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:23:52.950925 620922 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:53.319514 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:53.481705 727889 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:53.481775 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76219.585s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:53.481786 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:54.321318 685424 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:54.704411 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:55.040861 727891 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:55.040946 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76221.144s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:55.040957 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:55.705848 620907 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:56.098840 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:56.603475 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cba710658) server 159.89.49.34:34385 => 192.241.138.78:7100 - it has been idle for 65.0997s
I1019 08:23:56.828909 727892 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:56.828992 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76222.932s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:56.829013 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:57.100172 620928 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:57.499061 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:23:58.344017 727893 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:58.344105 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76224.447s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:58.344117 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:23:58.501006 622141 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:58.909209 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:23:59.910883 620823 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:23:59.944190 727894 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:23:59.944307 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76226.047s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:23:59.944327 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:00.329885 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:01.148092 727895 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:01.148193 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76227.251s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:01.148212 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:01.330967 620911 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:01.759034 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:02.561997 727897 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:02.562130 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76228.665s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:02.562150 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:02.762720 620932 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:03.197995 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:03.841512 620859 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715618.088s
I1019 08:24:03.943918 727899 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:03.944002 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76230.047s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:03.944020 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:04.112884 620840 cluster_balance_util.cc:209] Master leader not received heartbeat from ts b27bb468e6ee4cca83d06dfe5ae2b891. Only performing leader balancing for tables with replicas in this TS.
I1019 08:24:04.114107 620840 cluster_balance.cc:575] Skipping removing replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:24:04.114151 620840 cluster_balance.cc:598] Skipping adding replicas. Only leader balancing table 000033c100003000800000000000567c
W1019 08:24:04.198971 622143 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:04.638837 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:05.640444 620817 client_master_rpc.cc:79] 0x0000246cbf3c6a98 -> LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2): Failed: Timed out (yb/rpc/rpc.cc:223): LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2) passed its deadline 2656420.286s (passed: 1.001s)
W1019 08:24:05.640519 620817 meta_cache.cc:967] 0x0000246cbf3c6a98 -> LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2): Timed out (yb/client/client_master_rpc.cc:123): LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2) timed out after deadline expired, passed 1.001s of 0.721s
I1019 08:24:05.640563 620853 client-internal.cc:2831] Reinitialize master addresses from file: /data/yuga/conf/master.conf
I1019 08:24:05.640636 620853 client-internal.cc:2860] New master addresses: [159.89.49.34:7100,192.241.138.78:7100,159.89.48.63:7100, 159.89.49.34:7100, 192.241.138.78:7100, 159.89.48.63:7100]
I1019 08:24:05.667586 727901 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:05.667666 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76231.771s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:05.667678 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:05.790740 620817 tablet_rpc.cc:497] Timed out (yb/rpc/rpc.cc:223): Failed Read(tablet: 38eb3a3d9aea473396f6999193c978c5, num_ops: 1, num_attempts: 148, txn: 00000000-0000-0000-0000-000000000000, subtxn: [none]) to tablet 38eb3a3d9aea473396f6999193c978c5 (no tablet server available) after 148 attempt(s): Read(tablet: 38eb3a3d9aea473396f6999193c978c5, num_ops: 1, num_attempts: 148, txn: 00000000-0000-0000-0000-000000000000, subtxn: [none]) passed its deadline 2656420.286s (passed: 60.430s): Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
W1019 08:24:05.790894 620857 xcluster_safe_time_service.cc:154] Failure in XClusterSafeTime task: IO error (yb/client/batcher.cc:105): Scan of table xcluster_safe_time failed: IO error (yb/client/batcher.cc:105): Errors occurred while reaching out to the tablet servers. Could not compute xcluster safe time.: Errors occurred while reaching out to the tablet servers
I1019 08:24:06.800346 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:07.021139 727905 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:07.021207 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76233.124s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:07.021219 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:07.803689 650391 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:07.829939 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:08.776849 727907 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:08.776927 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76234.880s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:08.776938 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:08.830844 620932 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:08.841985 620817 tcp_stream.cc:329] { local: 192.241.138.78:43333 remote: 159.89.48.63:9100 }:  Recv failed: Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
I1019 08:24:08.863006 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:24:09.863857 622143 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:09.901597 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:09.902855 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cba711a58) server 159.89.49.34:38435 => 192.241.138.78:7100 - it has been idle for 65.0997s
I1019 08:24:09.914958 727909 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:09.915066 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76236.018s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:09.915081 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:10.903815 620832 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:10.951833 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:11.758530 727911 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:11.758612 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76237.862s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:11.758631 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:11.952733 620922 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:12.009126 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:24:13.012800 620831 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:13.015120 727914 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:13.015166 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76239.118s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:13.015175 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:13.076977 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:24:14.079979 620923 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:14.152437 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:14.297143 620859 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715607.632s
I1019 08:24:14.595844 727916 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:14.595927 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76240.699s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:14.595937 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:15.156440 622143 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:15.237231 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:24:16.238296 620823 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:16.241390 727918 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:16.241423 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76242.345s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:16.241431 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:16.333525 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:24:17.336933 620911 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:17.440233 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:18.115155 727920 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:18.115238 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76244.218s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:18.115249 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:18.444594 685426 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:18.554126 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:19.255223 727921 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:19.255319 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76245.358s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:19.255329 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:19.554519 620837 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:19.670166 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:20.403517 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cbc56a8d8) server 159.89.49.34:42065 => 192.241.138.78:7100 - it has been idle for 65.0007s
I1019 08:24:20.535914 727922 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:20.535984 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76246.639s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:20.535995 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:20.673729 620928 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:20.807461 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:21.669505 727923 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:21.669579 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76247.773s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:21.669597 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:21.808046 622141 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:21.944568 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:24:22.948791 620935 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:23.098335 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:23.101090 727925 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:23.101150 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76249.204s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:23.101162 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:24.100821 620823 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:24.259169 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:24.786037 727928 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:24.786154 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76250.889s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:24.786172 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:25.261494 620911 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:25.427609 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:24:26.431679 620923 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:26.582199 727929 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:26.582324 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76252.685s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:26.582340 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:26.608541 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:24:27.612212 620927 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:27.793840 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:28.369303 727930 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:28.369427 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76254.472s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:28.369444 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:28.795024 620833 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:28.986435 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:29.591179 727931 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:29.591295 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76255.694s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:29.591320 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:29.991673 620905 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:30.192301 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:30.803498 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cbb5b6c98) server 159.89.49.34:35101 => 192.241.138.78:7100 - it has been idle for 65.0997s
I1019 08:24:31.014743 727932 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:31.014817 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76257.118s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:31.014827 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:31.105214 620845 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715590.824s
W1019 08:24:31.194743 685424 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:31.406706 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:24:32.407440 620907 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:32.528311 727933 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:32.528383 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76258.631s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:32.528393 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:32.625927 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:24:33.626559 620921 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:33.854233 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:34.249768 620840 cluster_balance_util.cc:209] Master leader not received heartbeat from ts b27bb468e6ee4cca83d06dfe5ae2b891. Only performing leader balancing for tables with replicas in this TS.
I1019 08:24:34.250481 620840 cluster_balance.cc:575] Skipping removing replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:24:34.250490 620840 cluster_balance.cc:598] Skipping adding replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:24:34.267319 727935 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:34.267392 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76260.371s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:34.267401 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:34.857834 620828 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:35.092306 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:35.948477 727936 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:35.948562 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76262.052s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:35.948575 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:36.096697 622141 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:36.345600 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:24:37.349746 620903 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:37.435184 620817 tcp_stream.cc:329] { local: 192.241.138.78:36677 remote: 159.89.48.63:9100 }:  Recv failed: Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
I1019 08:24:37.503559 727937 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:37.503648 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76263.607s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:37.503660 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:37.603821 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:24:38.606977 620936 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:38.715632 727938 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:38.715714 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76264.819s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:38.715725 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:38.871024 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:24:39.874778 620836 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:40.144934 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:40.402704 727940 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:40.402802 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76266.506s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:40.402813 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:41.148077 620923 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:41.432499 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:42.171486 727942 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:42.171569 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76268.275s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:42.171581 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:42.437443 620950 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:42.729754 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:43.526155 727944 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:43.526226 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76269.629s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:43.526237 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:43.731031 620835 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:44.035187 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:44.352641 620845 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715577.576s
W1019 08:24:45.036760 620909 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:45.170470 727946 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:45.170550 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76271.274s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:45.170562 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:45.341385 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:24:46.342943 620922 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:46.660235 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:46.984031 727949 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:46.984104 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76273.087s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:46.984115 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:47.662024 620907 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:47.993338 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:48.144173 727950 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:48.144256 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76274.247s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:48.144266 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:48.994457 620921 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:49.330016 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:49.440768 727951 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:49.440843 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76275.544s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:49.440860 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:49.502632 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cbc56add8) server 159.89.49.34:44999 => 192.241.138.78:7100 - it has been idle for 65.0987s
W1019 08:24:50.332933 620828 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:50.678859 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:50.824424 727952 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:50.824502 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76276.928s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:50.824522 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:51.682579 620927 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:52.041090 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:52.061137 727953 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:52.061214 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76278.164s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:52.061224 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:53.042829 620833 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:53.406376 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:53.483922 727955 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:53.483999 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76279.587s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:53.484011 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:54.408195 620905 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:54.711669 727957 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:54.711742 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76280.815s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:54.711755 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:54.782308 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:24:55.784464 685424 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:56.165077 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:56.437244 727961 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:56.437335 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76282.540s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:56.437345 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:57.166891 620907 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:57.555451 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:57.885811 727962 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:57.885881 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76283.989s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:57.885891 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:58.145048 620859 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715563.784s
W1019 08:24:58.558876 620921 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:24:58.956580 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:24:59.412917 727963 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:24:59.412997 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76285.516s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:24:59.413008 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:24:59.957267 620828 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:00.366513 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:01.007202 727965 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:01.007310 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76287.110s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:01.007321 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:01.368708 622141 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:01.785087 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:02.758122 727967 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:02.758208 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76288.861s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:02.758217 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:02.788126 620922 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:03.214661 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:03.976626 727968 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:03.976693 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76290.080s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:03.976704 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:04.216046 620831 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:04.377926 620840 cluster_balance_util.cc:209] Master leader not received heartbeat from ts b27bb468e6ee4cca83d06dfe5ae2b891. Only performing leader balancing for tables with replicas in this TS.
I1019 08:25:04.378664 620840 cluster_balance.cc:575] Skipping removing replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:25:04.378675 620840 cluster_balance.cc:598] Skipping adding replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:25:04.652333 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:05.417371 727970 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:05.417440 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76291.521s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:05.417457 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:05.653139 685426 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:06.098026 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:07.100905 620817 client_master_rpc.cc:79] 0x0000246cbb6fee18 -> LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2): Failed: Timed out (yb/rpc/rpc.cc:223): LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2) passed its deadline 2656481.716s (passed: 1.003s)
W1019 08:25:07.100986 620817 meta_cache.cc:967] 0x0000246cbb6fee18 -> LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2): Timed out (yb/client/client_master_rpc.cc:123): LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2) timed out after deadline expired, passed 1.003s of 0.692s
I1019 08:25:07.101027 620853 client-internal.cc:2831] Reinitialize master addresses from file: /data/yuga/conf/master.conf
I1019 08:25:07.101090 620853 client-internal.cc:2860] New master addresses: [159.89.49.34:7100,192.241.138.78:7100,159.89.48.63:7100, 159.89.49.34:7100, 192.241.138.78:7100, 159.89.48.63:7100]
I1019 08:25:07.104935 727972 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:07.104979 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76293.208s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:07.104986 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:07.250129 620817 tablet_rpc.cc:497] Timed out (yb/rpc/rpc.cc:223): Failed Read(tablet: 38eb3a3d9aea473396f6999193c978c5, num_ops: 1, num_attempts: 148, txn: 00000000-0000-0000-0000-000000000000, subtxn: [none]) to tablet 38eb3a3d9aea473396f6999193c978c5 (no tablet server available) after 148 attempt(s): Read(tablet: 38eb3a3d9aea473396f6999193c978c5, num_ops: 1, num_attempts: 148, txn: 00000000-0000-0000-0000-000000000000, subtxn: [none]) passed its deadline 2656481.716s (passed: 60.459s): Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
W1019 08:25:07.250240 620857 xcluster_safe_time_service.cc:154] Failure in XClusterSafeTime task: IO error (yb/client/batcher.cc:105): Scan of table xcluster_safe_time failed: IO error (yb/client/batcher.cc:105): Errors occurred while reaching out to the tablet servers. Could not compute xcluster safe time.: Errors occurred while reaching out to the tablet servers
I1019 08:25:08.258096 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:08.849128 727973 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:08.849227 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76294.952s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:08.849242 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:08.903090 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cbc56a158) server 159.89.49.34:40685 => 192.241.138.78:7100 - it has been idle for 65.1007s
W1019 08:25:09.260002 620823 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:09.281786 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:25:10.282102 620911 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:10.311322 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:10.394168 727975 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:10.394253 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76296.497s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:10.394263 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:11.313799 620950 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:11.326886 620817 tcp_stream.cc:329] { local: 192.241.138.78:32985 remote: 159.89.48.63:9100 }:  Recv failed: Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
I1019 08:25:11.351102 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:11.905241 727976 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:11.905346 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76298.008s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:11.905357 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:12.352159 622143 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:12.399444 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:25:13.401465 620832 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:13.443351 727977 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:13.443497 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76299.547s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:13.443522 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:13.458843 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:13.594863 620845 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715548.334s
W1019 08:25:14.462957 620823 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:14.529330 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:15.300995 727979 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:15.301074 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76301.404s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:15.301084 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:15.531756 620911 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:15.605023 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:16.593693 727981 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:16.593766 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76302.697s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:16.593777 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:16.606398 685426 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:16.690559 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:25:17.691617 620837 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:17.742811 727982 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:17.743024 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76303.846s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:17.743036 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:17.785320 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:25:18.790241 620928 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:18.889494 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:19.202920 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cba70eb58) server 159.89.49.34:44097 => 192.241.138.78:7100 - it has been idle for 65.0007s
I1019 08:25:19.292500 727984 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:19.292577 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76305.396s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:19.292587 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:19.894780 622141 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:20.000943 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:20.598654 727985 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:20.598755 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76306.702s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:20.598770 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:21.004799 620935 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:21.123675 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:21.784932 727987 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:21.785014 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76307.888s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:21.785024 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:22.128719 620911 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:22.254048 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:22.934068 727988 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:22.934152 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76309.037s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:22.934163 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:23.254827 685426 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:23.389253 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:25:24.391887 620837 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:24.538339 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:24.703946 727990 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:24.704030 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76310.807s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:24.704048 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:25.541563 620928 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:25.698947 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:26.179016 727992 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:26.179085 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76312.282s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:26.179092 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:26.704224 620833 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:26.869851 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:27.026086 620845 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715534.903s
I1019 08:25:27.330663 727993 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:27.330734 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76313.434s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:27.330752 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:27.873461 620831 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:28.041146 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:28.779313 727994 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:28.779418 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76314.882s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:28.779436 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:29.045310 620907 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:29.224877 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:30.007953 727995 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:30.008028 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76316.111s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:30.008038 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:30.229650 620921 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:30.426466 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:25:31.427189 620828 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:31.628427 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:31.684602 727996 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:31.684679 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76317.788s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:31.684689 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:32.631071 620927 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:32.839861 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:33.467713 727998 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:33.467801 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76319.571s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:33.467813 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:33.842346 620833 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:34.059778 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:34.508086 620840 cluster_balance_util.cc:209] Master leader not received heartbeat from ts b27bb468e6ee4cca83d06dfe5ae2b891. Only performing leader balancing for tables with replicas in this TS.
I1019 08:25:34.508884 620840 cluster_balance.cc:575] Skipping removing replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:25:34.508894 620840 cluster_balance.cc:598] Skipping adding replicas. Only leader balancing table 000033c100003000800000000000567c
W1019 08:25:35.064203 685424 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:35.064703 727999 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:35.064728 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76321.168s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:35.064735 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:35.289697 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:36.202538 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cbb5b6c98) server 159.89.49.34:38671 => 192.241.138.78:7100 - it has been idle for 65.0997s
W1019 08:25:36.291023 620907 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:36.527263 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:36.591832 728000 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:36.591917 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76322.695s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:36.591928 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:37.529698 620921 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:37.776794 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:37.997591 728001 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:37.997694 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76324.101s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:37.997712 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:38.703125 620859 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715523.226s
W1019 08:25:38.777355 620828 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:39.033079 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:39.266304 728003 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:39.266377 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76325.369s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:39.266388 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:40.035993 620927 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:40.122161 620817 tcp_stream.cc:329] { local: 192.241.138.78:40337 remote: 159.89.48.63:9100 }:  Recv failed: Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
I1019 08:25:40.294624 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:40.921118 728005 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:40.921211 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76327.024s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:40.921245 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:41.298063 620903 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:41.570833 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:42.047032 728006 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:42.047132 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76328.150s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:42.047145 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:42.575477 620936 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:42.858237 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:43.541641 728008 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:43.541711 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76329.645s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:43.541720 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:43.860320 620836 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:44.155069 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:45.099747 728009 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:45.099838 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76331.203s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:45.099849 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:45.158288 620923 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:45.459174 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:25:46.463228 620950 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:46.639330 728010 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:46.639446 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76332.743s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:46.639457 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:46.773927 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:25:47.778302 620835 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:48.079957 728011 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:48.080029 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76334.183s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:48.080039 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:48.100301 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:25:49.104542 620909 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:49.303546 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cbba0e658) server 159.89.49.34:40707 => 192.241.138.78:7100 - it has been idle for 65.0007s
I1019 08:25:49.427063 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:49.785104 728012 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:49.785193 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76335.888s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:49.785205 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:50.432408 620905 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:50.769824 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:51.597169 728013 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:51.597261 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76337.700s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:51.597293 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:51.774926 620836 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:52.116860 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:53.064018 728014 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:53.064242 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76339.167s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:53.064262 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:53.121412 620923 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:53.478490 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:54.281466 620845 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715507.648s
W1019 08:25:54.481405 620932 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:54.783090 728016 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:54.783169 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76340.886s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:54.783177 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:54.850585 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:25:55.851238 620927 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:56.100623 728018 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:56.100699 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76342.204s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:56.100709 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:56.222215 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:25:57.223583 620922 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:57.603413 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:57.851745 728019 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:57.851851 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76343.955s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:57.851883 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:58.604429 620836 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:25:58.992041 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:25:59.706367 728021 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:25:59.706442 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76345.810s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:25:59.706454 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:25:59.996349 620923 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:00.393826 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:26:01.395123 620950 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:01.503940 728023 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:01.504010 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76347.607s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:01.504021 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:01.806792 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:02.697044 728024 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:02.697134 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76348.800s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:02.697144 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:02.811952 620835 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:03.203393 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cbba0eb58) server 159.89.49.34:43385 => 192.241.138.78:7100 - it has been idle for 65.0997s
I1019 08:26:03.232781 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:26:04.237542 620909 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:04.306569 728028 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:04.306645 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76350.410s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:04.306656 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:04.638017 620840 cluster_balance_util.cc:209] Master leader not received heartbeat from ts b27bb468e6ee4cca83d06dfe5ae2b891. Only performing leader balancing for tables with replicas in this TS.
I1019 08:26:04.638763 620840 cluster_balance.cc:575] Skipping removing replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:26:04.638783 620840 cluster_balance.cc:598] Skipping adding replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:26:04.669345 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:05.629688 728030 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:05.629786 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76351.733s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:05.629802 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:05.670647 620905 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:06.104522 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:07.017608 728032 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:07.017692 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76353.121s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:07.017704 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:07.106855 620931 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:07.550122 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:08.551962 620817 client_master_rpc.cc:79] 0x0000246cbe1e6fd8 -> LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2): Failed: Timed out (yb/rpc/rpc.cc:223): LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2) passed its deadline 2656543.176s (passed: 1.002s)
W1019 08:26:08.552053 620817 meta_cache.cc:967] 0x0000246cbe1e6fd8 -> LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2): Timed out (yb/client/client_master_rpc.cc:123): LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2) timed out after deadline expired, passed 1.002s of 0.700s
I1019 08:26:08.552101 620853 client-internal.cc:2831] Reinitialize master addresses from file: /data/yuga/conf/master.conf
I1019 08:26:08.552181 620853 client-internal.cc:2860] New master addresses: [159.89.49.34:7100,192.241.138.78:7100,159.89.48.63:7100, 159.89.49.34:7100, 192.241.138.78:7100, 159.89.48.63:7100]
I1019 08:26:08.652335 728034 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:08.652417 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76354.756s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:08.652428 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:08.701423 620817 tablet_rpc.cc:497] Timed out (yb/rpc/rpc.cc:223): Failed Read(tablet: 38eb3a3d9aea473396f6999193c978c5, num_ops: 1, num_attempts: 148, txn: 00000000-0000-0000-0000-000000000000, subtxn: [none]) to tablet 38eb3a3d9aea473396f6999193c978c5 (no tablet server available) after 148 attempt(s): Read(tablet: 38eb3a3d9aea473396f6999193c978c5, num_ops: 1, num_attempts: 148, txn: 00000000-0000-0000-0000-000000000000, subtxn: [none]) passed its deadline 2656543.176s (passed: 60.451s): Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
W1019 08:26:08.701586 620857 xcluster_safe_time_service.cc:154] Failure in XClusterSafeTime task: IO error (yb/client/batcher.cc:105): Scan of table xcluster_safe_time failed: IO error (yb/client/batcher.cc:105): Errors occurred while reaching out to the tablet servers. Could not compute xcluster safe time.: Errors occurred while reaching out to the tablet servers
I1019 08:26:09.714380 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:09.797398 728036 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:09.797482 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76355.901s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:09.797492 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:10.719655 620922 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:10.736735 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:11.398947 728038 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:11.399019 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76357.502s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:11.399030 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:11.737859 620836 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:11.763859 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:12.238449 620859 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715489.691s
W1019 08:26:12.767190 620923 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:12.808540 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:13.125605 728040 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:13.125676 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76359.229s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:13.125687 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:13.811681 620950 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:13.825865 620817 tcp_stream.cc:329] { local: 192.241.138.78:36437 remote: 159.89.48.63:9100 }:  Recv failed: Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
I1019 08:26:13.859987 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:14.492461 728042 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:14.492552 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76360.596s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:14.492568 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:14.860574 620835 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:14.919860 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:26:15.922420 620909 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:15.988077 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:16.352098 728044 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:16.352173 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76362.455s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:16.352185 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:16.988862 620823 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:17.062096 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:18.004648 728047 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:18.004726 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76364.108s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:18.004736 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:18.063701 620911 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:18.148890 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:18.602509 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cb8e58658) server 159.89.49.34:40297 => 192.241.138.78:7100 - it has been idle for 65.0987s
W1019 08:26:19.153445 620950 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:19.246898 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:19.362396 728049 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:19.362479 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76365.466s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:19.362493 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:20.247923 622141 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:20.347491 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:20.583519 728050 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:20.583603 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76366.687s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:20.583616 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:21.348778 620935 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:21.459777 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:22.271651 728051 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:22.271731 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76368.375s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:22.271741 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:22.464068 620823 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:22.583779 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:23.309993 620859 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715478.619s
I1019 08:26:23.581254 728052 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:23.581346 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76369.684s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:23.581364 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:23.588783 620911 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:23.718550 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:26:24.719404 685426 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:24.804845 728054 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:24.804915 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76370.908s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:24.804925 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:24.855871 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:26:25.858749 620835 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:26.000782 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:26.615451 728056 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:26.615522 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76372.719s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:26.615535 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:27.002748 620833 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:27.156196 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:26:28.159624 620905 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:28.325371 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:28.488579 728057 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:28.488669 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76374.592s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:28.488684 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:29.328595 685424 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:29.506611 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:30.052295 728059 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:30.052390 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76376.155s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:30.052402 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:30.510885 620923 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:30.695803 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:26:31.699828 620932 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:31.813000 728061 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:31.813083 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76377.916s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:31.813097 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:31.892285 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:32.102824 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cb8e58b58) server 159.89.49.34:45323 => 192.241.138.78:7100 - it has been idle for 65.0997s
W1019 08:26:32.893170 622143 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:33.094663 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:33.296115 728062 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:33.296198 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76379.399s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:33.296208 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:34.095665 620832 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:34.302703 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:34.787606 620840 cluster_balance_util.cc:209] Master leader not received heartbeat from ts b27bb468e6ee4cca83d06dfe5ae2b891. Only performing leader balancing for tables with replicas in this TS.
I1019 08:26:34.788731 620840 cluster_balance.cc:575] Skipping removing replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:26:34.788755 620840 cluster_balance.cc:598] Skipping adding replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:26:34.824178 728064 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:34.824255 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76380.927s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:34.824266 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:35.306305 620922 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:35.527912 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:36.056813 728065 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:36.056895 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76382.160s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:36.056915 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:36.530896 620831 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:36.756347 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:37.669397 728066 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:37.669469 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76383.773s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:37.669481 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:37.759258 620923 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:37.997128 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:38.852695 620845 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715463.076s
W1019 08:26:39.001528 622143 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:39.247990 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:39.494513 728068 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:39.494632 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76385.598s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:39.494647 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:40.250250 620832 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:40.504251 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:41.082592 728069 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:41.082688 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76387.186s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:41.082703 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:41.506873 620922 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:41.769793 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:42.746647 728070 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:42.746726 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76388.850s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:42.746737 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:42.772403 620911 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:42.863077 620817 tcp_stream.cc:329] { local: 192.241.138.78:33757 remote: 159.89.48.63:9100 }:  Recv failed: Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
I1019 08:26:43.048280 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:43.703049 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cb8e58518) server 159.89.49.34:43255 => 192.241.138.78:7100 - it has been idle for 65.0007s
W1019 08:26:44.049888 685426 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:44.134315 728072 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:44.134387 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76390.237s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:44.134397 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:44.333705 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:26:45.335171 620828 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:45.625573 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:45.798447 728073 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:45.798529 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76391.902s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:45.798538 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:46.627429 620903 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:46.926661 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:47.113598 728076 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:47.113696 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76393.217s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:47.113708 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:47.931526 620831 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:48.243821 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:48.492741 728077 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:48.492823 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76394.596s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:48.492833 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:49.247889 620921 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:49.566859 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:49.786329 728078 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:49.786401 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76395.890s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:49.786412 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:50.150754 620845 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715451.778s
W1019 08:26:50.568763 622143 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:50.897663 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:51.222921 728079 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:51.222997 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76397.326s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:51.223016 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:51.899616 620832 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:52.237728 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:52.397085 728080 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:52.397171 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76398.500s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:52.397183 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:53.242868 620922 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:53.590432 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:53.715164 728081 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:53.715246 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76399.818s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:53.715256 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:54.594728 620831 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:54.947207 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:55.341252 728084 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:55.341346 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76401.444s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:55.341356 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:55.948220 620931 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:56.310599 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:56.618891 728085 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:56.618973 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76402.722s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:56.618984 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:57.314484 650391 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:57.685954 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:58.150996 728088 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:58.151099 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76404.254s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:58.151110 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:26:58.691515 620828 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:26:59.075510 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:26:59.203269 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cba719418) server 159.89.49.34:45163 => 192.241.138.78:7100 - it has been idle for 65.0007s
I1019 08:26:59.382699 728089 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:26:59.382772 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76405.486s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:26:59.382786 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:00.080895 620832 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:00.468034 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:00.949270 728090 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:00.949352 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76407.052s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:00.949362 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:01.469718 685424 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:01.868897 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:02.494899 728091 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:02.494977 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76408.598s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:02.495005 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:02.871969 620907 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:03.282884 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:03.656491 728092 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:03.656563 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76409.760s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:03.656574 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:04.288179 620921 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:04.703830 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:04.924851 620840 cluster_balance_util.cc:209] Master leader not received heartbeat from ts b27bb468e6ee4cca83d06dfe5ae2b891. Only performing leader balancing for tables with replicas in this TS.
I1019 08:27:04.925529 620840 cluster_balance.cc:575] Skipping removing replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:27:04.925539 620840 cluster_balance.cc:598] Skipping adding replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:27:05.048094 728094 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:05.048161 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76411.151s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:05.048171 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:05.708966 620828 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:06.135730 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:06.364545 728096 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:06.364609 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76412.468s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:06.364625 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:07.080636 620859 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715434.848s
W1019 08:27:07.136344 620927 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:07.575703 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:08.103437 728098 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:08.103523 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76414.207s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:08.103538 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:08.577095 620922 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:09.020653 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:09.541020 728100 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:09.541096 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76415.644s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:09.541108 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:10.024317 620817 client_master_rpc.cc:79] 0x0000246cbb6ff358 -> LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2): Failed: Timed out (yb/rpc/rpc.cc:223): LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2) passed its deadline 2656604.627s (passed: 1.003s)
W1019 08:27:10.024400 620817 meta_cache.cc:967] 0x0000246cbb6ff358 -> LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2): Timed out (yb/client/client_master_rpc.cc:123): LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2) timed out after deadline expired, passed 1.003s of 0.680s
I1019 08:27:10.024453 620853 client-internal.cc:2831] Reinitialize master addresses from file: /data/yuga/conf/master.conf
I1019 08:27:10.024534 620853 client-internal.cc:2860] New master addresses: [159.89.49.34:7100,192.241.138.78:7100,159.89.48.63:7100, 159.89.49.34:7100, 192.241.138.78:7100, 159.89.48.63:7100]
W1019 08:27:10.172348 620817 tablet_rpc.cc:497] Timed out (yb/rpc/rpc.cc:223): Failed Read(tablet: 38eb3a3d9aea473396f6999193c978c5, num_ops: 1, num_attempts: 148, txn: 00000000-0000-0000-0000-000000000000, subtxn: [none]) to tablet 38eb3a3d9aea473396f6999193c978c5 (no tablet server available) after 148 attempt(s): Read(tablet: 38eb3a3d9aea473396f6999193c978c5, num_ops: 1, num_attempts: 148, txn: 00000000-0000-0000-0000-000000000000, subtxn: [none]) passed its deadline 2656604.627s (passed: 60.470s): Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
W1019 08:27:10.172488 620857 xcluster_safe_time_service.cc:154] Failure in XClusterSafeTime task: IO error (yb/client/batcher.cc:105): Scan of table xcluster_safe_time failed: IO error (yb/client/batcher.cc:105): Errors occurred while reaching out to the tablet servers. Could not compute xcluster safe time.: Errors occurred while reaching out to the tablet servers
I1019 08:27:11.181383 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:11.351836 728102 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:11.351933 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76417.455s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:11.351951 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:12.184152 620928 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:12.200304 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:12.479533 728103 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:12.479609 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76418.583s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:12.479630 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:13.204696 622141 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:13.239619 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:13.890143 728104 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:13.890218 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76419.993s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:13.890229 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:14.240983 620935 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:14.276799 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:27:15.282184 620823 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:15.332906 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:15.647186 728105 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:15.647271 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76421.750s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:15.647306 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:16.334532 620911 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:16.353792 620817 tcp_stream.cc:329] { local: 192.241.138.78:46871 remote: 159.89.48.63:9100 }:  Recv failed: Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
I1019 08:27:16.392095 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:17.303207 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cbeac97d8) server 159.89.49.34:38611 => 192.241.138.78:7100 - it has been idle for 65.1007s
W1019 08:27:17.396440 650391 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:17.460971 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:17.479419 728107 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:17.479557 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76423.583s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:17.479571 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:18.463267 620927 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:18.541347 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:19.321012 728109 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:19.321105 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76425.424s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:19.321127 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:19.543792 620922 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:19.628160 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:27:20.632864 620831 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:20.724416 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:21.073186 728110 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:21.073323 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76427.176s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:21.073343 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:21.623600 620859 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715420.305s
W1019 08:27:21.728608 620931 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:21.830165 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:27:22.830883 650391 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:22.831218 728111 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:22.831249 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76428.934s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:22.831259 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:22.940205 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:27:23.943545 620932 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:24.064039 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:24.527850 728113 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:24.527923 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76430.631s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:24.527933 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:25.065121 620927 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:25.197381 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:25.694926 728117 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:25.695008 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76431.798s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:25.695029 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:26.202687 620922 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:26.338313 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:26.929590 728118 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:26.929665 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76433.033s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:26.929675 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:27.342937 620831 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:27.491055 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:28.402719 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cba70a018) server 159.89.49.34:44381 => 192.241.138.78:7100 - it has been idle for 65.0987s
W1019 08:27:28.494393 620931 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:28.582684 728119 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:28.582773 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76434.686s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:28.582785 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:28.649251 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:27:29.652738 650391 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:29.815383 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:29.900300 728120 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:29.900372 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76436.003s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:29.900383 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:30.819312 620932 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:30.994432 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:31.530408 728122 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:31.530494 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76437.634s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:31.530505 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:31.995760 622143 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:32.175484 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:27:33.177757 620832 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:33.192515 728123 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:33.192595 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76439.296s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:33.192605 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:33.364434 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:27:34.369031 620905 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:34.570971 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:34.801636 728124 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:34.801715 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76440.905s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:34.801725 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:35.059326 620840 cluster_balance_util.cc:209] Master leader not received heartbeat from ts b27bb468e6ee4cca83d06dfe5ae2b891. Only performing leader balancing for tables with replicas in this TS.
I1019 08:27:35.060076 620840 cluster_balance.cc:575] Skipping removing replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:27:35.060087 620840 cluster_balance.cc:598] Skipping adding replicas. Only leader balancing table 000033c100003000800000000000567c
W1019 08:27:35.573742 685424 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:35.784893 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:36.651177 728126 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:36.651252 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76442.754s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:36.651264 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:36.788914 620923 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:37.006016 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:37.777863 728128 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:37.777936 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76443.881s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:37.777946 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:38.007881 620950 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:38.231882 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:38.491448 620859 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715403.438s
W1019 08:27:39.236526 620835 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:39.470642 728131 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:39.470753 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76445.574s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:39.470765 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:39.471230 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:27:40.473038 620832 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:40.716224 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:41.254444 728134 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:41.254530 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76447.358s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:41.254545 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:41.721217 620905 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:41.978888 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:42.471661 728135 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:42.471746 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76448.575s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:42.471784 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:42.982896 620931 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:43.245697 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:43.903086 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cba70a158) server 159.89.49.34:43329 => 192.241.138.78:7100 - it has been idle for 65.0997s
I1019 08:27:44.013767 728138 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:44.013855 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76450.117s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:44.013865 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:44.249768 650391 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:44.523288 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:45.309399 728139 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:45.309474 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76451.413s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:45.309484 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:45.527613 620835 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:45.621937 620817 tcp_stream.cc:329] { local: 192.241.138.78:38231 remote: 159.89.48.63:9100 }:  Recv failed: Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
I1019 08:27:45.809502 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:46.798020 728140 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:46.798094 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76452.901s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:46.798105 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:46.811324 620909 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:47.100322 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:27:48.105000 620903 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:48.203099 728141 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:48.203179 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76454.306s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:48.203190 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:48.400728 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:27:49.401618 620936 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:49.708706 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:49.736665 728143 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:49.736739 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76455.840s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:49.736748 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:50.713402 620836 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:51.036629 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:51.454308 728145 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:51.454391 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76457.557s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:51.454401 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:52.041159 620923 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:52.364204 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:52.824834 728147 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:52.824899 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76458.928s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:52.824908 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:53.367421 620835 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:53.702978 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:54.564455 728149 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:54.564531 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76460.668s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:54.564543 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:54.705747 620903 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:55.050637 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:55.202806 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cba70a798) server 159.89.49.34:45313 => 192.241.138.78:7100 - it has been idle for 65.0997s
I1019 08:27:55.560412 620845 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715386.369s
W1019 08:27:56.054912 620936 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:56.075955 728152 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:56.076001 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76462.179s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:56.076011 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:56.409094 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:27:57.410606 728155 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:57.410686 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76463.514s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:57.410696 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:27:57.411898 620836 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:57.776530 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:27:58.779062 620923 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:27:58.985159 728157 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:27:58.985251 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76465.088s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:58.985261 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:27:59.152017 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:28:00.156695 620950 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:00.541074 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:00.576798 728158 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:00.576862 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76466.680s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:00.576874 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:01.543648 620927 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:01.936652 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:02.385603 728162 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:02.385679 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76468.489s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:02.385690 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:02.941537 620905 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:03.337764 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:04.056380 728164 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:04.056471 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76470.160s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:04.056485 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:04.340106 685424 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:04.743602 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:05.194622 620840 cluster_balance_util.cc:209] Master leader not received heartbeat from ts b27bb468e6ee4cca83d06dfe5ae2b891. Only performing leader balancing for tables with replicas in this TS.
I1019 08:28:05.195773 620840 cluster_balance.cc:575] Skipping removing replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:28:05.195796 620840 cluster_balance.cc:598] Skipping adding replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:28:05.542019 728166 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:05.542089 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76471.645s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:05.542099 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:05.745425 620837 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:06.166313 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:28:07.169013 620928 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:07.390156 728167 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:07.390252 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76473.493s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:07.390290 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:07.597970 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:28:08.602416 620832 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:08.659843 728168 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:08.659914 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76474.763s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:08.659924 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:09.040244 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:09.833690 728170 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:09.833770 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76475.937s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:09.833788 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:10.042593 620936 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:10.483049 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:11.178299 620859 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715370.751s
I1019 08:28:11.388877 728171 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:11.388947 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76477.492s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:11.388958 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:11.484803 620817 client_master_rpc.cc:79] 0x0000246cbb727518 -> LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2): Failed: Timed out (yb/rpc/rpc.cc:223): LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2) passed its deadline 2656666.097s (passed: 1.002s)
W1019 08:28:11.484863 620817 meta_cache.cc:967] 0x0000246cbb727518 -> LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2): Timed out (yb/client/client_master_rpc.cc:123): LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2) timed out after deadline expired, passed 1.002s of 0.689s
I1019 08:28:11.484921 620853 client-internal.cc:2831] Reinitialize master addresses from file: /data/yuga/conf/master.conf
I1019 08:28:11.484966 620853 client-internal.cc:2860] New master addresses: [159.89.49.34:7100,192.241.138.78:7100,159.89.48.63:7100, 159.89.49.34:7100, 192.241.138.78:7100, 159.89.48.63:7100]
W1019 08:28:11.635872 620817 tablet_rpc.cc:497] Timed out (yb/rpc/rpc.cc:223): Failed Read(tablet: 38eb3a3d9aea473396f6999193c978c5, num_ops: 1, num_attempts: 148, txn: 00000000-0000-0000-0000-000000000000, subtxn: [none]) to tablet 38eb3a3d9aea473396f6999193c978c5 (no tablet server available) after 148 attempt(s): Read(tablet: 38eb3a3d9aea473396f6999193c978c5, num_ops: 1, num_attempts: 148, txn: 00000000-0000-0000-0000-000000000000, subtxn: [none]) passed its deadline 2656666.097s (passed: 60.463s): Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
W1019 08:28:11.635991 620857 xcluster_safe_time_service.cc:154] Failure in XClusterSafeTime task: IO error (yb/client/batcher.cc:105): Scan of table xcluster_safe_time failed: IO error (yb/client/batcher.cc:105): Errors occurred while reaching out to the tablet servers. Could not compute xcluster safe time.: Errors occurred while reaching out to the tablet servers
I1019 08:28:12.003470 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cba70a8d8) server 159.89.49.34:38693 => 192.241.138.78:7100 - it has been idle for 65.0017s
I1019 08:28:12.644914 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:12.894528 728172 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:12.894618 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76478.998s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:12.894629 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:13.647678 620927 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:13.671479 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:14.193233 728173 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:14.193329 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76480.296s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:14.193341 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:14.673903 620833 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:14.698727 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:15.418820 728174 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:15.418896 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76481.522s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:15.418907 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:15.702179 620905 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:15.740190 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:16.711915 728176 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:16.711998 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76482.815s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:16.712008 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:16.742916 620931 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:16.789227 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:28:17.792299 620950 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:17.850360 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:18.083989 728177 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:18.084070 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76484.187s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:18.084080 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:18.851668 620835 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:18.872598 620817 tcp_stream.cc:329] { local: 192.241.138.78:40531 remote: 159.89.48.63:9100 }:  Recv failed: Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
I1019 08:28:18.917621 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:19.658582 728179 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:19.658653 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76485.762s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:19.658672 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:19.919417 620909 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:19.994378 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:20.932168 728181 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:20.932247 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76487.035s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:20.932262 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:20.995153 620903 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:21.076390 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:28:22.080662 620936 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:22.156867 728182 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:22.156951 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76488.260s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:22.156961 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:22.178345 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:22.470434 620845 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715359.459s
W1019 08:28:23.183658 620836 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:23.281109 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:23.566004 728184 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:23.566090 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76489.669s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:23.566102 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:24.283483 620923 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:24.397300 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:24.751030 728186 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:24.751119 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76490.854s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:24.751134 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:25.400525 620828 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:25.522478 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:26.161788 728188 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:26.161868 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76492.265s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:26.161880 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:26.526289 620927 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:26.653683 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:26.703068 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cbd8ea518) server 159.89.49.34:37415 => 192.241.138.78:7100 - it has been idle for 65.0997s
W1019 08:28:27.656931 620833 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:27.796645 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:27.847303 728189 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:27.847451 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76493.950s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:27.847471 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:28.800940 620831 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:28.952623 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:29.691412 728193 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:29.691515 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76495.795s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:29.691527 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:29.955214 620923 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:30.110697 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:30.958969 728194 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:30.959038 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76497.062s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:30.959048 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:31.113727 620950 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:31.278172 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:28:32.282325 620835 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:32.442070 728195 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:32.442150 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76498.545s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:32.442162 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:32.455377 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:28:33.458999 620909 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:33.643913 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:34.055238 728196 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:34.055389 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76500.158s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:34.055411 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:34.644510 620903 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:34.838201 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:35.332710 620840 cluster_balance_util.cc:209] Master leader not received heartbeat from ts b27bb468e6ee4cca83d06dfe5ae2b891. Only performing leader balancing for tables with replicas in this TS.
I1019 08:28:35.333575 620840 cluster_balance.cc:575] Skipping removing replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:28:35.333593 620840 cluster_balance.cc:598] Skipping adding replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:28:35.752269 728197 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:35.752357 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76501.855s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:35.752368 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:35.838830 620936 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:36.036059 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:37.019856 728199 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:37.019924 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76503.123s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:37.019934 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:37.039831 620836 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:37.248759 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:28:38.253816 620932 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:38.439486 728200 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:38.439555 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76504.543s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:38.439565 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:38.471257 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:28:39.474565 620927 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:39.700199 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:40.314186 728205 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:40.314291 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76506.417s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:40.314303 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:40.700752 620833 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:40.935504 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:40.945308 620859 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715340.984s
I1019 08:28:41.900820 728207 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:41.900890 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76508.004s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:41.900902 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:41.936236 620905 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:42.184180 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:28:43.188606 620836 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:43.403312 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cbd8eab58) server 159.89.49.34:36879 => 192.241.138.78:7100 - it has been idle for 65.0007s
I1019 08:28:43.446873 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:43.742605 728210 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:43.742681 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76509.846s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:43.742691 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:44.448863 620932 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:44.714018 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:44.881228 728211 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:44.881321 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76510.984s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:44.881332 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:45.714812 622143 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:45.987941 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:46.670811 728213 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:46.670879 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76512.774s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:46.670897 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:46.992974 620832 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:47.273748 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:47.960525 728214 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:47.960593 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76514.064s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:47.960603 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:48.276216 620831 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:48.374917 620817 tcp_stream.cc:329] { local: 192.241.138.78:44955 remote: 159.89.48.63:9100 }:  Recv failed: Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
I1019 08:28:48.571097 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:28:49.573328 620907 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:49.687202 728215 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:49.687305 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76515.790s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:49.687319 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:49.871712 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:28:50.875546 620921 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:50.899926 728216 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:50.899998 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76517.003s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:50.900009 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:51.185313 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:52.124032 728217 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:52.124111 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76518.227s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:52.124121 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:52.188388 620828 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:52.506518 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:28:53.509773 620927 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:53.596140 728218 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:53.596248 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76519.699s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:53.596263 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:53.839135 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:28:54.841869 620833 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:54.916234 728220 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:54.916332 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76521.019s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:54.916353 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:55.180900 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:56.160858 728221 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:56.160929 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76522.264s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:56.160939 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:28:56.184942 620823 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:56.531708 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:28:57.536653 620931 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:57.895438 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:57.967620 728222 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:57.967690 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76524.071s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:57.967700 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:58.329542 620845 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715323.600s
W1019 08:28:58.897507 650391 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:28:59.259428 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:28:59.463164 728223 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:28:59.463223 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76525.566s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:28:59.463243 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:00.263578 620828 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:00.503526 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cba70a798) server 159.89.49.34:43497 => 192.241.138.78:7100 - it has been idle for 65.0007s
I1019 08:29:00.631337 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:01.051318 728226 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:01.051441 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76527.154s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:01.051453 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:01.635581 620927 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:02.015447 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:02.821169 728228 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:02.821260 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76528.924s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:02.821296 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:03.017149 620903 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:03.403916 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:04.129909 728229 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:04.129994 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76530.233s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:04.130009 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:04.406900 620936 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:04.803367 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:05.463241 620840 cluster_balance_util.cc:209] Master leader not received heartbeat from ts b27bb468e6ee4cca83d06dfe5ae2b891. Only performing leader balancing for tables with replicas in this TS.
I1019 08:29:05.464033 620840 cluster_balance.cc:575] Skipping removing replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:29:05.464041 620840 cluster_balance.cc:598] Skipping adding replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:29:05.770578 728231 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:05.770651 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76531.874s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:05.770663 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:05.807797 620836 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:06.214789 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:29:07.218159 620923 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:07.261255 728232 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:07.261348 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76533.364s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:07.261359 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:07.633087 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:29:08.634104 620950 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:08.647374 728233 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:08.647454 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76534.751s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:08.647464 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:09.062865 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:09.860952 728235 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:09.861023 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76535.964s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:09.861034 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:10.063860 620927 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:10.499722 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:11.077564 728236 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:11.077638 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76537.181s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:11.077648 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:11.501917 620935 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:11.845546 620845 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715310.084s
I1019 08:29:11.947687 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:12.612253 728238 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:12.612357 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76538.715s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:12.612370 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:12.949584 620817 client_master_rpc.cc:79] 0x0000246cbf830398 -> LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2): Failed: Timed out (yb/rpc/rpc.cc:223): LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2) passed its deadline 2656727.562s (passed: 1.001s)
W1019 08:29:12.949684 620817 meta_cache.cc:967] 0x0000246cbf830398 -> LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2): Timed out (yb/client/client_master_rpc.cc:123): LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2) timed out after deadline expired, passed 1.001s of 0.688s
I1019 08:29:12.949729 620853 client-internal.cc:2831] Reinitialize master addresses from file: /data/yuga/conf/master.conf
I1019 08:29:12.949803 620853 client-internal.cc:2860] New master addresses: [159.89.49.34:7100,192.241.138.78:7100,159.89.48.63:7100, 159.89.49.34:7100, 192.241.138.78:7100, 159.89.48.63:7100]
W1019 08:29:13.100090 620817 tablet_rpc.cc:497] Timed out (yb/rpc/rpc.cc:223): Failed Read(tablet: 38eb3a3d9aea473396f6999193c978c5, num_ops: 1, num_attempts: 148, txn: 00000000-0000-0000-0000-000000000000, subtxn: [none]) to tablet 38eb3a3d9aea473396f6999193c978c5 (no tablet server available) after 148 attempt(s): Read(tablet: 38eb3a3d9aea473396f6999193c978c5, num_ops: 1, num_attempts: 148, txn: 00000000-0000-0000-0000-000000000000, subtxn: [none]) passed its deadline 2656727.562s (passed: 60.463s): Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
W1019 08:29:13.100252 620857 xcluster_safe_time_service.cc:154] Failure in XClusterSafeTime task: IO error (yb/client/batcher.cc:105): Scan of table xcluster_safe_time failed: IO error (yb/client/batcher.cc:105): Errors occurred while reaching out to the tablet servers. Could not compute xcluster safe time.: Errors occurred while reaching out to the tablet servers
I1019 08:29:13.890959 728240 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:13.891057 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76539.994s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:13.891072 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:14.113516 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:29:15.118817 620828 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:15.136858 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:15.733081 728243 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:15.733170 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76541.836s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:15.733187 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:16.142196 620909 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:16.173732 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:16.203217 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cbd8ea798) server 159.89.49.34:35565 => 192.241.138.78:7100 - it has been idle for 65.0997s
W1019 08:29:17.176699 620922 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:17.213127 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:17.376853 728247 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:17.376940 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76543.480s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:17.376951 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:18.214881 620831 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:18.268424 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:19.061507 728248 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:19.061580 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76545.165s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:19.061591 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:19.272469 685426 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:19.329953 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:20.218518 728249 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:20.218592 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76546.322s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:20.218603 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:20.331080 620837 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:20.397174 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:29:21.402264 620928 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:21.428854 620817 tcp_stream.cc:329] { local: 192.241.138.78:40447 remote: 159.89.48.63:9100 }:  Recv failed: Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
I1019 08:29:21.479200 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:21.541919 728250 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:21.541996 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76547.645s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:21.542006 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:22.483876 622141 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:22.574101 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:23.404410 728254 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:23.404484 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76549.508s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:23.404503 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:23.583621 620935 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:23.676101 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:24.597999 728257 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:24.598068 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76550.701s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:24.598078 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:24.677497 620823 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:24.777071 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:29:25.781158 620911 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:25.887744 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:26.162678 728260 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:26.162755 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76552.266s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:26.162766 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:26.888780 620923 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:27.005079 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:27.403201 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cba718dd8) server 159.89.49.34:36559 => 192.241.138.78:7100 - it has been idle for 65.0007s
I1019 08:29:27.472553 728262 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:27.472633 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76553.576s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:27.472648 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:28.009446 622143 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:28.137130 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:29.014480 728264 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:29.014698 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76555.118s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:29.014714 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:29.141225 620832 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:29.281324 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:30.267592 728265 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:30.267678 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76556.371s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:30.267689 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:30.282606 620922 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:30.430156 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:30.461030 620845 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715291.468s
W1019 08:29:31.430629 620831 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:31.587128 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:32.012495 728268 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:32.012583 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76558.116s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:32.012600 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:32.592779 620931 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:32.759068 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:33.320109 728270 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:33.320178 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76559.423s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:33.320194 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:33.763904 650391 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:33.943661 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:34.539268 728271 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:34.539404 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76560.642s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:34.539417 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:34.948393 620932 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:35.131613 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:35.603420 620840 cluster_balance_util.cc:209] Master leader not received heartbeat from ts b27bb468e6ee4cca83d06dfe5ae2b891. Only performing leader balancing for tables with replicas in this TS.
I1019 08:29:35.604175 620840 cluster_balance.cc:575] Skipping removing replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:29:35.604184 620840 cluster_balance.cc:598] Skipping adding replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:29:35.797086 728272 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:35.797163 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76561.900s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:35.797173 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:36.134954 622143 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:36.330209 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:29:37.330849 620832 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:37.533082 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:37.591219 728274 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:37.591369 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76563.694s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:37.591385 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:38.537021 620823 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:38.745198 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:38.832312 728275 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:38.832407 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76564.935s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:38.832419 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:39.745993 620931 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:39.967242 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:40.186414 728277 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:40.186507 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76566.290s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:40.186518 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:40.969101 650391 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:41.197777 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:41.889164 728279 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:41.889253 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76567.992s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:41.889269 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:42.201411 620835 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:42.437291 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:43.383023 728281 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:43.383114 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76569.486s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:43.383131 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:43.441220 620909 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:43.689200 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:29:44.691327 620903 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:44.944492 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:45.075738 728283 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:45.075810 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76571.179s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:45.075821 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:45.945525 620936 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:46.003194 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cba718b58) server 159.89.49.34:36959 => 192.241.138.78:7100 - it has been idle for 65.0997s
I1019 08:29:46.208894 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:46.642668 728285 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:46.642760 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76572.746s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:46.642774 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:47.210840 620836 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:47.482659 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:47.918010 620859 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715274.011s
I1019 08:29:48.337762 728287 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:48.337858 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76574.441s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:48.337869 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:48.485113 650391 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:48.766011 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:49.632882 728288 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:49.632968 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76575.736s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:49.632978 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:49.771512 620932 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:50.062018 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:50.835587 728289 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:50.835654 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76576.939s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:50.835664 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:51.067261 622143 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:51.166290 620817 tcp_stream.cc:329] { local: 192.241.138.78:36461 remote: 159.89.48.63:9100 }:  Recv failed: Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
I1019 08:29:51.369971 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:29:52.371454 620903 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:52.469453 728291 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:52.469542 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76578.573s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:52.469560 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:52.685117 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:29:53.691534 620911 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:54.013222 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:54.094197 728292 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:54.094298 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76580.197s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:54.094311 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:55.018064 620837 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:55.343587 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:55.357882 728295 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:55.357954 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76581.461s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:55.357965 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:56.345187 620928 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:56.682346 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:56.991585 728297 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:56.991683 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76583.095s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:56.991698 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:57.685940 622141 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:58.028246 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:58.477706 728298 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:58.477823 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76584.581s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:58.477834 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:29:59.029096 620935 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:29:59.384491 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:29:59.917770 728299 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:29:59.917847 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76586.021s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:29:59.917858 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:30:00.387660 620823 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:30:00.750604 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:30:01.392438 728301 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:30:01.392514 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76587.496s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:30:01.392534 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:30:01.752341 620911 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:30:02.129880 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:30:02.707530 728302 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:30:02.707624 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76588.811s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:30:02.707635 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:30:03.133435 620921 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:30:03.402994 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cba718f18) server 159.89.49.34:33239 => 192.241.138.78:7100 - it has been idle for 65.0997s
I1019 08:30:03.513742 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:30:03.840584 728303 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:30:03.840664 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76589.944s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:30:03.840675 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:30:04.516498 620835 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:30:04.910617 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:30:05.215652 728304 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:30:05.215737 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76591.319s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:30:05.215749 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:30:05.743574 620840 cluster_balance_util.cc:209] Master leader not received heartbeat from ts b27bb468e6ee4cca83d06dfe5ae2b891. Only performing leader balancing for tables with replicas in this TS.
I1019 08:30:05.744359 620840 cluster_balance.cc:575] Skipping removing replicas. Only leader balancing table 000033c100003000800000000000567c
I1019 08:30:05.744369 620840 cluster_balance.cc:598] Skipping adding replicas. Only leader balancing table 000033c100003000800000000000567c
W1019 08:30:05.914788 620833 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:30:06.312743 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:30:06.409247 728307 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:30:06.409329 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76592.512s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:30:06.409340 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:30:07.315709 620905 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:30:07.438392 620859 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715254.491s
I1019 08:30:07.722329 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:30:07.917323 728310 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:30:07.917397 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76594.021s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:30:07.917407 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:30:08.723933 620836 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:30:09.141989 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:30:09.666455 728312 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:30:09.666555 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76595.770s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:30:09.666574 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:30:10.146898 650391 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:30:10.573719 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:30:11.249177 728313 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:30:11.249253 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76597.352s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:30:11.249262 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:30:11.574841 620828 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:30:12.011745 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:30:12.375792 728314 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:30:12.375866 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76598.479s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:30:12.375877 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:30:13.014842 620927 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:30:13.456912 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:30:14.067821 728315 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:30:14.067929 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76600.171s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:30:14.067946 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:30:14.459753 620817 client_master_rpc.cc:79] 0x0000246cbb6fe718 -> LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2): Failed: Timed out (yb/rpc/rpc.cc:223): LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2) passed its deadline 2656789.025s (passed: 1.003s)
W1019 08:30:14.459848 620817 meta_cache.cc:967] 0x0000246cbb6fe718 -> LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2): Timed out (yb/client/client_master_rpc.cc:123): LookupByIdRpc(tablet: 38eb3a3d9aea473396f6999193c978c5, num_attempts: 2) timed out after deadline expired, passed 1.003s of 0.643s
I1019 08:30:14.459893 620853 client-internal.cc:2831] Reinitialize master addresses from file: /data/yuga/conf/master.conf
I1019 08:30:14.460004 620853 client-internal.cc:2860] New master addresses: [159.89.49.34:7100,192.241.138.78:7100,159.89.48.63:7100, 159.89.49.34:7100, 192.241.138.78:7100, 159.89.48.63:7100]
W1019 08:30:14.611985 620817 tablet_rpc.cc:497] Timed out (yb/rpc/rpc.cc:223): Failed Read(tablet: 38eb3a3d9aea473396f6999193c978c5, num_ops: 1, num_attempts: 148, txn: 00000000-0000-0000-0000-000000000000, subtxn: [none]) to tablet 38eb3a3d9aea473396f6999193c978c5 (no tablet server available) after 148 attempt(s): Read(tablet: 38eb3a3d9aea473396f6999193c978c5, num_ops: 1, num_attempts: 148, txn: 00000000-0000-0000-0000-000000000000, subtxn: [none]) passed its deadline 2656789.025s (passed: 60.511s): Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
W1019 08:30:14.612134 620857 xcluster_safe_time_service.cc:154] Failure in XClusterSafeTime task: IO error (yb/client/batcher.cc:105): Scan of table xcluster_safe_time failed: IO error (yb/client/batcher.cc:105): Errors occurred while reaching out to the tablet servers. Could not compute xcluster safe time.: Errors occurred while reaching out to the tablet servers
I1019 08:30:15.621979 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:30:15.773934 728316 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:30:15.774017 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76601.877s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:30:15.774029 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:30:16.626346 620950 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:30:16.643090 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:30:16.903189 620817 reactor.cc:634] Master_R000: DEBUG: Closing idle connection: Connection (0x0000246cbcfd8a18) server 159.89.49.34:42695 => 192.241.138.78:7100 - it has been idle for 65.0997s
I1019 08:30:17.445004 728317 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:30:17.445096 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76603.548s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:30:17.445106 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:30:17.646245 620835 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:30:17.674181 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:30:17.802254 620859 raft_consensus.cc:3086] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]:  Leader pre-election vote request: Denying vote to candidate eb9cb7dc08be4ac38d7fb759797dc5b7 for term 23 because replica believes a valid leader to be alive (leader uuid: 622aae548057426d82907736822fd420). Time left: 9220715244.127s
W1019 08:30:18.677047 620833 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:30:18.712322 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:30:18.937124 728318 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:30:18.937206 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76605.040s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:30:18.937217 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:30:19.717037 620905 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:30:19.765584 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:30:20.559173 728319 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:30:20.559247 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76606.662s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:30:20.559257 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:30:20.770570 685426 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:30:20.826790 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:30:21.831403 620932 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:30:21.894702 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:30:22.432369 728321 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:30:22.432475 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76608.536s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:30:22.432492 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:30:22.896950 622143 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:30:22.972553 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:30:23.974876 620922 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:30:24.003993 620817 tcp_stream.cc:329] { local: 192.241.138.78:44907 remote: 159.89.48.63:9100 }:  Recv failed: Network error (yb/util/net/socket.cc:540): recvmsg error: Connection refused (system error 111)
I1019 08:30:24.063130 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:30:24.257453 728322 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:30:24.257560 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76610.361s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:30:24.257572 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:30:25.066537 620831 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:30:25.160955 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:30:25.490586 728324 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:30:25.490691 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76611.594s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:30:25.490706 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:30:26.165724 620931 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:30:26.267187 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:30:26.989727 728325 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:30:26.989823 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76613.093s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:30:26.989845 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:30:27.272533 650391 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:30:27.381747 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
W1019 08:30:28.383253 620932 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:30:28.497570 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:30:28.742380 728328 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:30:28.742453 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76614.846s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:30:28.742465 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:30:29.499163 620909 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:30:29.627635 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []
I1019 08:30:30.585956 728330 consensus_peers.cc:286] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 -> Peer eb9cb7dc08be4ac38d7fb759797dc5b7 ([host: "159.89.49.34" port: 7100], []): Could not obtain request from queue for peer: Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158
I1019 08:30:30.586025 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (Leader has been unable to successfully communicate with Peer eb9cb7dc08be4ac38d7fb759797dc5b7 for more than 7200 seconds (76616.689s)): Eviction of failed followers is disabled. Doing nothing.
I1019 08:30:30.586036 620856 raft_consensus.cc:1476] T 00000000000000000000000000000000 P 622aae548057426d82907736822fd420 [term 22 LEADER]: Processing failure of peer eb9cb7dc08be4ac38d7fb759797dc5b7 in term 22 (The logs necessary to catch up peer eb9cb7dc08be4ac38d7fb759797dc5b7 have been garbage collected. The follower will never be able to catch up (Not found (yb/consensus/log_index.cc:389): op index 15384 has been already GCed from log index cache, max_gced_op_index: 58158)): Eviction of failed followers is disabled. Doing nothing.
W1019 08:30:30.631258 620903 catalog_manager.cc:11447] Expected replicas 3 but found 2 for tablet 38eb3a3d9aea473396f6999193c978c5: tablet_id: "38eb3a3d9aea473396f6999193c978c5" replicas { ts_info { permanent_uuid: "b27bb468e6ee4cca83d06dfe5ae2b891" private_rpc_addresses { host: "159.89.48.63" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: LEADER member_type: VOTER state: RUNNING } replicas { ts_info { permanent_uuid: "fc4eaa7664964728b949a42152eeab2f" private_rpc_addresses { host: "159.89.49.34" port: 9100 } cloud_info { placement_cloud: "cloud1" placement_region: "datacenter1" placement_zone: "rack1" } placement_uuid: "" } role: FOLLOWER member_type: VOTER state: RUNNING } stale: false partition { partition_key_start: "" partition_key_end: "" } table_id: "69104518f34544b7aab4085786edb56b" table_ids: "69104518f34544b7aab4085786edb56b" split_depth: 0 expected_live_replicas: 3 expected_read_replicas: 0 split_parent_tablet_id: "" raft_config_opid_index: 226067
I1019 08:30:30.766698 620817 tablet_rpc.cc:170] Unable to pick leader for 38eb3a3d9aea473396f6999193c978c5, replicas: [], followers: []