S3FileSink

Behavior

S3FileSink uploads messages to designated an S3 bucket. It uses local file sink because it writes messages to disk first, and then uploads a file to S3 when the file is rotated. When the local file sink rotates a file, its Notice would have the list of files to upload. S3FileSink can get the list of files by Notice.recv().

Properties

If the default value is not specified, it's required.

Property	Description	Type	Default value
localFileSink	local file sink configuration	String
bucket	S3 bucket name	String
s3Endpoint	S3 bucket end point	s3.amazonaws.com
maxPartSize	S3 multiple upload max partition size	long	20971520
concurrentUpload	number of uploading threads	int	5
notice	It describes Notice interface for how to notify its progress.	Notice	QueueNotice
prefixFormatter	It describes RemotePrefixFormatter for how to create a file name.	RemotePrefixFormatter	SimpleDateFormatter