You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Jan 20, 2022. It is now read-only.
The scalding platform uses a custom planning monad stack which has reader-like behavior to read the configuration and mode and state-like behavior to update the view of daterange we can compute.
This code is fairly hard for a new person to start hacking on since it is in parallel computing two things: how to compute data and what time range we can compute.
The scalding.Execution monad came along after this code and is tested outside of summingbird. It does not have the state-like features, but it can handle the reader-like aspect of configuration and mode, and it does give access to changing configuration for parts of the job.
The scalding platform uses a custom planning monad stack which has reader-like behavior to read the configuration and mode and state-like behavior to update the view of daterange we can compute.
This code is fairly hard for a new person to start hacking on since it is in parallel computing two things: how to compute data and what time range we can compute.
The scalding.Execution monad came along after this code and is tested outside of summingbird. It does not have the state-like features, but it can handle the reader-like aspect of configuration and mode, and it does give access to changing configuration for parts of the job.
Related to #136
The text was updated successfully, but these errors were encountered: