Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ISICO-14427: Enable locking using Dynomite #150

Open
wants to merge 47 commits into
base: master
Choose a base branch
from

Conversation

charybr
Copy link

@charybr charybr commented Jan 23, 2023

Problem:
Netflix#3450

Solution:
Since Dynomite is the default persistence and queuing mechanism in Conductor, there should be an option to use Dynomite for locking as well.

Approach:
Created dyno-lock sub-project.
Default VotingHostsSelector implementation (VotingHostsFromTokenRange) considers all hosts. This will not work when hosts are used for replication as writing the lock in one node gets replicated in other nodes as well. So we need to to override this.

@charybr charybr requested a review from manjurad January 25, 2023 17:00
@charybr charybr requested a review from sarmuru2 January 30, 2023 19:57
ConnectionPoolMonitor cpMonitor = new DynoCPMonitor(appName);

DynoJedisUtils.updateConnectionPoolConfig(
cpConfig, hostSupplier, tokenMapSupplier, eurekaClient, clusterName);

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

from where the hostSupplier is configured?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hostSupplier is initialized in line 81, i.e
HostSupplier hostSupplier = () -> Collections.singletonList(host);

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what will happen to hostsupplier when we have more than one host configured in the RedisProperties file?

Copy link

@sarmuru2 sarmuru2 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

there is a possibility of locking the workflowId which is already locked on restart.if the conductor is shutdown with the removing the lock on workflowId, then on restart there is a chance to lock the locked workflowId on retrying the workflow. please handle this scenario

Raghavendra Chary B added 21 commits March 5, 2023 17:56
LoopOverTasks was empty setting 'iteration' to 1 is not correct.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants