Home

Suro is a distributed data pipeline which enables services for moving, aggregating, routing, storing data. Its design is focused on easy configuration and operation for multiple data sources. It supports the following features:

• The client can send any type of Java object to remote servers using customizable SerDe using either asynchronous or synchronous way.
• According to the routing key contained in the message, message routing and sinking behaviors can be dynamically configurable without server restart
• Currently, the following sinks are provided ** Local file sink: Stores the data at the local file system. It supports text file and Hadoop sequence file. ** S3 file sink: Uploads files generated by local file sink to AWS S3. ** Kafka 0.7 sink: Send the data through Kafka 0.7 producer