forked from nytlabs/streamtools
-
Notifications
You must be signed in to change notification settings - Fork 0
blocks
Mike Dewar edited this page Mar 14, 2014
·
20 revisions
Each block is briefly detailed below, along with the rules that define each block.
These blocks emit messages on their own.
- ticker. This block emits the time regularly. The time between emissions is specified by the
Interval
.- Rules:
-
Interval
: duration string (1s
)
-
- Rules:
These blocks are useful for shaping the stream in one way or another
- join
- map
- Rules:
-
Map
: -
Additive
: (True
)
-
- Rules:
- mask
- Rules:
-
Mask
:
-
- Rules:
- filter
- Rules:
-
Filter
: (. != null
)
-
- Rules:
- pack
- Rules:
-
EmitAfter
: -
Path
:
-
- Rules:
- unpack
- Rules:
-
Path
:
-
- Rules:
- sync
- Rules:
-
Path
: -
Lag
:
-
- Rules:
- gethttp
- Rules:
-
Path
:
-
- Rules:
These blocks hook into another system and collect messages to be emitted into streamtools.
- fromhttpstream
- Rules:
-
Endpoint
: -
Auth
:
-
- Rules:
- fromnsq
- Rules:
-
ReadTopic
: -
LookupdAddr
: -
ReadChannel
: -
MaxInFlight
: (0
)
-
- Rules:
- frompost
- fromsqs
- Rules:
-
SignatureVersion
: (4
) -
AccessKey
: -
MaxNumberOfMessages
: (10
) -
APIVersion
: (2012-11-05
) -
SQSEndpoint
: -
WaitTimeSeconds
: (0
) -
AccessSecret
:
-
- Rules:
- fromudp
- Rules:
-
ConnectionString
:
-
- Rules:
- fromwebsocket
- Rules:
-
url
:
-
- Rules:
These blocks send data to external systems.
- toelasticsearch
- Rules:
-
Index
: -
Host
: -
IndexType
: -
Port
:
-
- Rules:
- tofile
- Rules:
-
Filename
:
-
- Rules:
- tolog
- tonsq
- Rules:
-
Topic
: -
NsqdTCPAddrs
:
-
- Rules:
- tonsqmulti
- Rules:
-
Topic
: -
Interval
: (1s
) -
NsqdTCPAddrs
: -
MaxBatch
: (100
)
-
- Rules:
- towebsocket
- Rules:
-
port
:
-
- Rules:
These blocks maintain a state, storing something about the stream of data
- histogram
- Rules:
-
Path
: -
Window
: (0
)
-
- Rules:
- count
- Rules:
-
Window
: (0
)
-
- Rules:
- timeseries
- Rules:
-
Path
: -
NumSamples
: (0
)
-
- Rules:
- set
- Rules:
-
Path
:
-
- Rules:
- movingaverage
- Rules:
-
Path
: -
Window
:
-
- Rules:
These blocks emit random numbers when polled.
- zipf
- Rules:
-
s
: (2
) -
v
: (5
) -
N
: (99
)
-
- Rules:
- gaussian
- Rules:
-
StdDev
: (1
) -
Mean
: (0
)
-
- Rules:
- poisson
- Rules:
-
Rate
: (1
)
-
- Rules: