Inconsistent log-probability upon resuming
I am using log-prior=0 for all parameters and I am using PTSampler of 10 chains.
When I resume a chain of 40000 steps, I noticed,
>>> C0[39998:40003]
array([(0.50621303, 0.00075817, 0.5182459 , 0.89435491, 0.56248075, 0.01668318, 0.51145281, 0.97553503, 0.69609853, 0.35350003, 0.95796527, -22044.34088187, -22044.34088187),
(0.50621303, 0.00075817, 0.5182459 , 0.89435491, 0.56248075, 0.01668318, 0.51145281, 0.97553503, 0.69609853, 0.35350003, 0.95796527, -22044.34088187, 0. ),
(0.50621303, 0.00075817, 0.5182459 , 0.89435491, 0.56248075, 0.01668318, 0.51145281, 0.97553503, 0.69609853, 0.35350003, 0.95796527, -22044.34088187, 0. ),
(0.50621303, 0.00075817, 0.5182459 , 0.89435491, 0.56248075, 0.01668318, 0.51145281, 0.97553503, 0.69609853, 0.35350003, 0.95796527, -22044.34088187, 0. ),
(0.50621344, 0.00075816, 0.51822106, 0.89438071, 0.56248092, 0.01668335, 0.51145306, 0.97553457, 0.69609562, 0.3534961 , 0.95796736, -22045.53681285, -22045.53681285)],
dtype=[('p0', '<f8'), ('p1', '<f8'), ('p2', '<f8'), ('p3', '<f8'), ('p4', '<f8'), ('p5', '<f8'), ('p6', '<f8'), ('p7', '<f8'), ('p8', '<f8'), ('p9', '<f8'), ('p10', '<f8'), ('logL', '<f8'), ('logP', '<f8')])
The first three logP are zeros just after the resuming. Why the logP are zeros?
For some other chains, I have,
>>> C1[39998:40003]
array([(0.18785334, 0.08054713, 0.52597502, 0.99987904, 0.53019295, 0.00670884, 0.52753193, 9.43194382e-05, 0.65499142, 0.74622021, 1.08047435e-05, -470217.26571789, -470217.26571789),
(0.18804314, 0.08053414, 0.52601104, 0.99989583, 0.5301762 , 0.00670835, 0.52752751, 9.58824291e-05, 0.65499381, 0.74631775, 8.13843242e-07, -470229.61662345, -470229.61662345),
(0.18804314, 0.08053414, 0.52601104, 0.99989583, 0.5301762 , 0.00670835, 0.52752751, 9.58824291e-05, 0.65499381, 0.74631775, 8.13843242e-07, -470229.61662345, -470229.61662345),
(0.18804314, 0.08053414, 0.52601104, 0.99989583, 0.5301762 , 0.00670835, 0.52752751, 9.58824291e-05, 0.65499381, 0.74631775, 8.13843242e-07, -470229.61662345, -470229.61662345),
(0.18804314, 0.08053414, 0.52601104, 0.99989583, 0.5301762 , 0.00670835, 0.52752751, 9.58824291e-05, 0.65499381, 0.74631775, 8.13843242e-07, -470229.61662345, -470229.61662345)],
dtype=[('p0', '<f8'), ('p1', '<f8'), ('p2', '<f8'), ('p3', '<f8'), ('p4', '<f8'), ('p5', '<f8'), ('p6', '<f8'), ('p7', '<f8'), ('p8', '<f8'), ('p9', '<f8'), ('p10', '<f8'), ('logL', '<f8'), ('logP', '<f8')])
>>> C2[39998:40003]
array([(0.39063341, 0.35573035, 0.76611688, 0.99365144, 0.40259419, 0.00254268, 0.50262126, 0.00043977, 0.98521517, 0.18117508, 0.98900845, -2252235.70940168, -2252235.70940168),
(0.39059586, 0.35579737, 0.76616695, 0.99326578, 0.40257043, 0.0025389 , 0.50263288, 0.00044209, 0.98527781, 0.18123199, 0.98895704, -2252259.62729896, 0. ),
(0.39059586, 0.35579737, 0.76616695, 0.99326578, 0.40257043, 0.0025389 , 0.50263288, 0.00044209, 0.98527781, 0.18123199, 0.98895704, -2252259.62729896, 0. ),
(0.39059586, 0.35579737, 0.76616695, 0.99326578, 0.40257043, 0.0025389 , 0.50263288, 0.00044209, 0.98527781, 0.18123199, 0.98895704, -2252259.62729896, 0. ),
(0.39059586, 0.35579737, 0.76616695, 0.99326578, 0.40257043, 0.0025389 , 0.50263288, 0.00044209, 0.98527781, 0.18123199, 0.98895704, -2252259.62729896, 0. )],
dtype=[('p0', '<f8'), ('p1', '<f8'), ('p2', '<f8'), ('p3', '<f8'), ('p4', '<f8'), ('p5', '<f8'), ('p6', '<f8'), ('p7', '<f8'), ('p8', '<f8'), ('p9', '<f8'), ('p10', '<f8'), ('logL', '<f8'), ('logP', '<f8')])
>>> C3[39998:40003]
array([(0.99896402, 0.99950034, 0.90366528, 0.99955761, 0.19975727, 0.01577324, 0.49074497, 1.40698048e-05, 0.14345419, 0.57594166, 0.9937325 , -3416738.9297985 , -3416738.9297985 ),
(0.99896402, 0.99950034, 0.90366528, 0.99955761, 0.19975727, 0.01577324, 0.49074497, 1.40698048e-05, 0.14345419, 0.57594166, 0.9937325 , -3416738.9297985 , 0. ),
(0.99978469, 0.99951354, 0.90385286, 0.99956746, 0.19992434, 0.0157689 , 0.49094757, 2.18592328e-05, 0.14496107, 0.57829916, 0.9949142 , -3416710.46928071, -3416710.46928071),
(0.99978748, 0.99955316, 0.90382947, 0.99956918, 0.1998877 , 0.01577465, 0.49094839, 2.19550233e-05, 0.14495903, 0.57830221, 0.9949163 , -3416719.07412925, -3416719.07412925),
(0.99978702, 0.99955306, 0.90382903, 0.99961134, 0.19989076, 0.01577597, 0.49095022, 2.15775215e-05, 0.14495335, 0.57830196, 0.99492339, -3416715.46526181, -3416715.46526181)],
dtype=[('p0', '<f8'), ('p1', '<f8'), ('p2', '<f8'), ('p3', '<f8'), ('p4', '<f8'), ('p5', '<f8'), ('p6', '<f8'), ('p7', '<f8'), ('p8', '<f8'), ('p9', '<f8'), ('p10', '<f8'), ('logL', '<f8'), ('logP', '<f8')])