ConditionalResidualBlock not working

[shuohantao]

score_sde_pytorch/models/layers.py

Lines 406 to 416 in cb1f359

	if resample == 'down':
	if dilation > 1:
	self.conv1 = ncsn_conv3x3(input_dim, input_dim, dilation=dilation)
	self.normalize2 = normalization(input_dim, num_classes)
	self.conv2 = ncsn_conv3x3(input_dim, output_dim, dilation=dilation)
	conv_shortcut = partial(ncsn_conv3x3, dilation=dilation)
	else:
	self.conv1 = ncsn_conv3x3(input_dim, input_dim)
	self.normalize2 = normalization(input_dim, num_classes)
	self.conv2 = ConvMeanPool(input_dim, output_dim, 3, adjust_padding=adjust_padding)
	conv_shortcut = partial(ConvMeanPool, kernel_size=1, adjust_padding=adjust_padding)

The above code would create mismatched shortcut and output shape when dilation is larger than 1.