loading state_dict for ControlLDMReferenceOnly_Temporal_Pose_Local

[mmlingyu]

Total base parameters 3033.84M
Loading model state dict from checkpoint/model_state-415001.th ...
╭─────────────────────────────── Traceback (most recent call last) ────────────────────────────────╮
│ /root/autodl-tmp/work/X-Portrait/test_xportrait.py:505 in │
│ │
│ 502 │ │ │ │ │ │ help='num frames') │
│ 503 │ args = parser.parse_args() │
│ 504 │ │
│ ❱ 505 │ main(args) │
│ 506 │
│ 507 │
│ │
│ /root/autodl-tmp/work/X-Portrait/test_xportrait.py:415 in main │
│ │
│ 412 │ # ****************************** │
│ 413 │ if args.resume_dir is not None: │
│ 414 │ │ if args.local_rank == 0: │
│ ❱ 415 │ │ │ load_state_dict(model, args.resume_dir, strict=False) │
│ 416 │ else: │
│ 417 │ │ print('please privide the correct resume_dir!') │
│ 418 │ │ exit() │
│ │
│ /root/autodl-tmp/work/X-Portrait/test_xportrait.py:231 in load_state_dict │
│ │
│ 228 │ │ for k in list(state_dict.keys()): │
│ 229 │ │ │ if k.startswith("control_model.input_hint_block"): │
│ 230 │ │ │ │ state_dict.pop(k) │
│ ❱ 231 │ model.load_state_dict(state_dict, strict=strict) │
│ 232 │ del state_dict │
│ 233 │
│ 234 def get_cond_control(args, batch_data, control_type, device, start, end, model=None, bat │
│ │
│ /root/miniconda3/envs/kolors/lib/python3.8/site-packages/torch/nn/modules/module.py:2041 in │
│ load_state_dict │
│ │
│ 2038 │ │ │ │ │ │ ', '.join('"{}"'.format(k) for k in missing_keys))) │
│ 2039 │ │ │
│ 2040 │ │ if len(error_msgs) > 0: │
│ ❱ 2041 │ │ │ raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format( │
│ 2042 │ │ │ │ │ │ │ self.class.name, "\n\t".join(error_msgs))) │
│ 2043 │ │ return _IncompatibleKeys(missing_keys, unexpected_keys) │
│ 2044 │
╰──────────────────────────────────────────────────────────────────────────────────────────────────╯
RuntimeError: Error(s) in loading state_dict for ControlLDMReferenceOnly_Temporal_Pose_Local:
size mismatch for model.diffusion_model.input_blocks.1.1.transformer_blocks.0.attn2.to_k.weight: copying a param with shape torch.Size([320, 768])