Start time 20250113-08:13:55-GMT+0900
Build Version el7.3-release-fraser-6.5.5.1-stable-4291da86a7d23431e4192501cde1e531f37a20ed
Build Last Commit Date 2024-01-12 22:43:21 +0000
Component ID 1146
Incarnation ID 3077846385
Can become master true
Master since 20250113-09:06:53-GMT+0900
PC Cluster UUID 0fca3d36-c12c-4448-9573-2c1ed9329d59
Local hypervisor key 118.219.252.141
Local hypervisor type kKvm
Local stargate incarnation ID 3077846268
Highest allocated opid 11174534
Highest contiguous completed opid 11174534
Demeter Subpage Demeter

Master

Recovery Info

Start time End time Recovery time (msecs) Checkpoint records Delta records
20250113-09:06:52-GMT+0900 20250113-09:06:53-GMT+0900 512 104 40

Recovery Counters(12)

Tag Message Count
9 addMetaOpState 2
10 metaOpCompleted 2
15 dumpProtectionDomainBasicStateVec 1
16 dumpSnapshotControlBlock 81
17 dumpConsistencyGroupStates 96
19 snapshotGarbageCollectorMetaOpDeltaState 2
21 receiveSnapshotMetaOpDeltaState 6
27 topLevelMetaOpCompletionStat 4
43 snapshotStats 28
65 mesosWALRecord 1
71 dumpCerebroMasterBasicState 1
101 upgradeSnapshot 2

Checkpoint Info(10)

Creation time Checkpoint id Time taken (msecs) Protection domains Consistency groups Snapshots WAL records Delta records
during checkpoint		 Delta records
before checkpoint
20251219-03:04:18-GMT+0900 43862310 11 18 61 81 104 0 1040
20251219-04:30:14-GMT+0900 43863506 11 18 61 81 103 0 1006
20251219-05:01:21-GMT+0900 43864637 10 18 61 81 104 0 1014
20251219-05:03:00-GMT+0900 43865772 9 18 61 81 104 0 1027
20251219-05:04:52-GMT+0900 43866923 13 18 61 81 104 0 1043
20251219-05:07:21-GMT+0900 43868035 12 18 61 81 104 0 1004
20251219-05:11:06-GMT+0900 43869164 9 18 61 81 104 0 1021
20251219-05:15:01-GMT+0900 43870287 12 18 61 81 104 0 1014
20251219-13:32:15-GMT+0900 43871404 16 18 61 81 103 0 1006
20251220-00:14:43-GMT+0900 43872523 29 18 61 81 103 0 1006

Checkpoint Creation Stats(24)

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251213-14:49:40-GMT+0900 0 0 1 0 0 0 0 17 17 17

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251214-02:29:42-GMT+0900 0 5 10 0 0 0 0 8 21 11.6

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251214-05:00:20-GMT+0900 0 3 4 0 0 0 0 7 15 10

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251214-12:37:47-GMT+0900 0 0 1 0 0 0 0 15 15 15

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251214-23:14:13-GMT+0900 0 0 1 0 0 0 0 14 14 14

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251215-03:00:51-GMT+0900 0 3 11 0 2 0 0 8 381 45.25

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251215-05:00:56-GMT+0900 0 0 7 0 0 0 0 11 40 19.857

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251215-13:37:56-GMT+0900 0 0 1 0 0 0 0 48 48 48

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251216-00:29:56-GMT+0900 0 0 1 0 0 0 0 17 17 17

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251216-03:00:57-GMT+0900 0 5 10 0 0 0 0 8 23 11.867

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251216-05:01:00-GMT+0900 0 0 10 0 0 0 0 10 22 14.3

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251216-15:00:08-GMT+0900 0 0 1 0 0 0 0 23 23 23

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251217-03:00:03-GMT+0900 0 4 11 0 0 0 0 8 26 11.733

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251217-05:00:27-GMT+0900 0 3 10 0 0 0 0 8 28 15.615

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251217-09:00:03-GMT+0900 0 0 1 0 0 0 0 24 24 24

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251217-19:38:09-GMT+0900 0 0 1 0 0 0 0 14 14 14

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251218-03:00:47-GMT+0900 0 6 10 0 1 0 0 8 117 18.647

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251218-05:01:17-GMT+0900 0 1 6 0 0 0 0 9 21 12.714

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251218-14:50:10-GMT+0900 0 0 1 0 0 0 0 16 16 16

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-01:46:54-GMT+0900 0 0 1 0 0 0 0 14 14 14

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-03:01:02-GMT+0900 0 3 11 0 0 0 0 8 36 14.214

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-04:30:14-GMT+0900 0 2 5 0 0 0 0 9 13 10.857

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-13:32:15-GMT+0900 0 0 1 0 0 0 0 16 16 16

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251220-00:14:43-GMT+0900 0 0 1 0 0 0 0 29 29 29

Checkpoint Commit Stats(24)

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251213-14:49:40-GMT+0900 0 0 1 0 0 0 0 11 11 11

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251214-02:29:42-GMT+0900 0 3 12 0 0 0 0 9 21 11.867

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251214-05:00:20-GMT+0900 0 0 7 0 0 0 0 11 14 12.429

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251214-12:37:47-GMT+0900 0 0 1 0 0 0 0 13 13 13

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251214-23:14:13-GMT+0900 0 0 1 0 0 0 0 14 14 14

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251215-03:00:51-GMT+0900 0 4 12 0 0 0 0 5 43 13.563

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251215-05:00:56-GMT+0900 0 1 6 0 0 0 0 6 18 13.714

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251215-13:37:56-GMT+0900 0 0 1 0 0 0 0 15 15 15

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251216-00:29:56-GMT+0900 0 0 1 0 0 0 0 10 10 10

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251216-03:00:57-GMT+0900 0 1 14 0 0 0 0 8 28 12.067

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251216-05:01:00-GMT+0900 0 4 6 0 0 0 0 8 15 11.1

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251216-15:00:08-GMT+0900 0 0 0 1 0 0 0 55 55 55

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251217-03:00:03-GMT+0900 0 3 12 0 0 0 0 5 18 12.467

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251217-05:00:27-GMT+0900 0 3 10 0 0 0 0 6 25 13.615

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251217-09:00:03-GMT+0900 0 0 1 0 0 0 0 26 26 26

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251217-19:38:09-GMT+0900 0 0 1 0 0 0 0 15 15 15

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251218-03:00:47-GMT+0900 0 1 16 0 0 0 0 9 26 13.941

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251218-05:01:17-GMT+0900 0 4 3 0 0 0 0 6 15 9.429

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251218-14:50:10-GMT+0900 0 0 1 0 0 0 0 12 12 12

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-01:46:55-GMT+0900 0 0 1 0 0 0 0 14 14 14

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-03:01:02-GMT+0900 0 2 12 0 0 0 0 6 45 14.214

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-04:30:14-GMT+0900 0 1 6 0 0 0 0 9 18 13.286

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-13:32:15-GMT+0900 0 0 1 0 0 0 0 12 12 12

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251220-00:14:43-GMT+0900 0 0 0 1 0 0 0 69 69 69

Delta Record Commit Stats(24)

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-01:37:45-GMT+0900 63 11 4 3 0 0 0 1 62 6.79

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-02:37:45-GMT+0900 14676 190 159 2 2 0 0 1 153 2.051

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-03:37:46-GMT+0900 546 68 17 1 0 0 0 1 67 3.078

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-04:37:46-GMT+0900 6309 97 55 5 1 1 0 1 565 2.219

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-05:37:46-GMT+0900 75 5 0 0 0 0 0 1 7 2.763

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-06:37:46-GMT+0900 74 6 0 0 0 0 0 1 6 2.788

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-07:37:47-GMT+0900 76 4 0 0 0 0 0 2 6 2.95

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-08:37:47-GMT+0900 82 6 7 0 0 0 0 1 35 4.253

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-09:37:47-GMT+0900 75 5 0 0 0 0 0 2 6 2.738

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-10:37:48-GMT+0900 67 2 8 0 3 0 0 2 246 15.05

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-11:37:48-GMT+0900 74 6 0 0 0 0 0 2 9 2.838

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-12:37:48-GMT+0900 58 10 9 0 3 0 0 1 136 10.7

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-13:37:48-GMT+0900 78 2 0 0 0 0 0 1 6 2.563

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-14:37:48-GMT+0900 208 8 1 0 0 0 0 1 13 2.295

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-15:37:49-GMT+0900 79 2 0 0 0 0 0 2 5 2.642

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-16:37:49-GMT+0900 79 2 0 0 0 0 0 2 5 2.765

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-17:37:49-GMT+0900 74 5 2 0 0 0 0 2 11 3.173

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-18:37:49-GMT+0900 78 2 1 0 0 0 0 1 27 2.963

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-19:37:49-GMT+0900 76 5 0 0 0 0 0 1 5 2.765

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-20:37:49-GMT+0900 81 0 0 0 0 0 0 1 4 2.802

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-21:37:50-GMT+0900 76 5 0 0 0 0 0 2 5 2.827

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-22:37:50-GMT+0900 79 2 0 0 0 0 0 2 5 2.815

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251219-23:37:50-GMT+0900 70 9 2 0 0 0 0 2 20 3.63

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251220-00:37:50-GMT+0900 48 0 0 0 0 0 0 2 4 2.5

Log Counters(15)

Tag Message Count
7 applySchedule 94
8 adjustPendingActions 5126
9 addMetaOpState 18459
10 metaOpCompleted 18459
11 toplevelMetaOpRequestPauseOrAbort 1
13 unreferenceRemote 11
18 snapshotProtectionDomainMetaOpDeltaState 10238
19 snapshotGarbageCollectorMetaOpDeltaState 11594
20 replicateMetaOpDeltaState 7786658
21 receiveSnapshotMetaOpDeltaState 4305
22 entityRecovererMetaOpDeltaState 72
24 entityRestorerMetaOpDeltaState 18
27 topLevelMetaOpCompletionStat 18450
43 snapshotStats 666350
101 upgradeSnapshot 11594