-
Notifications
You must be signed in to change notification settings - Fork 1.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
transform: luaxform transform script. #11733
Conversation
Given the rule:
I wonder if we should reconsider the new keyword here... Would it make more sense to have:
in case we add another method for transforms? In theory we could also have plugins that register transforms, but I guess those would look more like the current transforms as they'd add a new keyword completely. Just thinking out loud here. |
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## master #11733 +/- ##
=========================================
Coverage ? 82.58%
=========================================
Files ? 922
Lines ? 249246
Branches ? 0
=========================================
Hits ? 205838
Misses ? 43408
Partials ? 0
Flags with carried forward coverage won't be shown. Click here to find out more. |
ERROR: ERROR: QA failed on build_asan. Pipeline 22483 |
I would consider this to be out of scope for this work. Transforms are currently implemented as regular keywords. We can change that of course, but it's not related to the PR. |
What would you see happen in the script's |
I was wondering about the same thing earlier... And was wondering if perhaps a data-file might be loaded, that would fail now due to the sandbox. But imagine a Lua transform that loaded something a TLD database to provide a domain name transformation or something. Or some other heavy initialization of pre-computing some table of sorts? I don't think it should be required if not needed though, but might be nice to allow it for some one-time initialization. |
This did make me think of one possible case: if the transform would like to query a dataset, it would need some init/thread_init to get a handle. |
Let's keep the |
Optional? If it exists use it, if not assume an empty return value? |
Works for me. But need to think about init vs thread_init (that I added in my dataset binding work). In |
ERROR: ERROR: QA failed on build_asan. Pipeline 22622 |
ERROR: ERROR: QA failed on SURI_TLPR1_alerts_cmp. Pipeline 22627 |
Information: QA ran without warnings. Pipeline 22743 |
This commit makes the detection engine thread context available for transforms to use. The Lua transform requires this value. Issue: 2290
Issue: 2290 This commit extends the hash table logic with an alternate free function that provides the detection engine context. Users that wish to use the next functionality must use the HashListTableInitWithCtx function when initializing the hash table. Using this interface will result in the hash table "free with context" function (new) being used instead.
Issue: 2290 This commit causes the keyword_hash pointer to be cleared after it's been freed.
Issue: 2290 This commit adds the source files for the new transform -- luaxform.
Issue: 2290
Information: QA ran without warnings. Pipeline 22751 |
Issue: 2290 Fixup the macro usage to eliminate compiler warnings.
WARNING:
Pipeline 22762 |
Continued in #11817 |
Add the
luaxform
transform that uses a Lua script to receive and transform a sticky buffer.Lua transforms receive arguments
Arguments are passed to the lua script as they appear in the rule:
When the transform is invoked, 3 additional arguments are passed (arg count will be 3)
bytes 4
offset 13
hash sha256
The Lua script is responsible for parsing and using the arguments and returning a tuple:
output-buffer, output-buffer-byte-count
I used this lua script:
Example rule using the lua script:
Link to ticket: https://redmine.openinfosecfoundation.org/issues/2290
Describe changes:
Provide values to any of the below to override the defaults.
link to the pull request in the respective
_BRANCH
variable.SV_REPO=
SV_BRANCH=OISF/suricata-verify#2044
SU_REPO=
SU_BRANCH=
LIBHTP_REPO=
LIBHTP_BRANCH=