Can I have some details on use_adaptive_sync? #87
Replies: 1 comment
-
No product issue here, moving this to discussion forum. 'use_adaptive_sync' specifies whether the adaptive sync interval feature should be used for automatically generating the the sync interval. This feature is turned off by default. when 'use_adaptive_sync' is not set, swarm learning uses fixed sync interval through out learning. When use_adaptive_sync is enabled, swarm generates next sync interval based on loss computation. Sync interval mentioned in callback used only for first time merge process, subsequent sync intervals are dynamically computed by swarm based on trend of loss. This feature judges the training progress by monitoring the mean loss. A reduction in the mean loss infers that the training is progressing well. As a response, it increases the sync interval and enables more batches to run before sharing the |
Beta Was this translation helpful? Give feedback.
-
swarm_callback = SwarmCallback(
sync_interval = ,
min_peers = ,
use_adaptive_sync = False ,
val_data = <either a (x_val, y_val) tuple or a generator>,
val_batch_size = ,
checkin_model_on_train_end = 'snapshot' ,
node_weightage = 1 <node weightage as an interger between 0 to 100>,
ml_platform= <ML platform -'TF'/'KERAS'/'PYTORCH' as a string>,
model_name='swarm_model'
)
I'd like to know more details about the use_adaptive_sync = False , how it get the sync interval automatically? based on what parameters or some other factors? What would happen If I have set a specific sync interval number and also set the adaptive_sync to True?
Beta Was this translation helpful? Give feedback.
All reactions