Commit Graph

141 Commits (4be80d39a80d4375dc80a45e43d8e67db0125793)

Author SHA1 Message Date
Jakub Onderka c2811888e4 chg: [internal] Faster freetext parsing 2024-01-31 09:47:54 +01:00
Jakub Onderka 1c8056a66a chg: [attribute] Better ssdeep validation 2022-10-19 13:14:08 +02:00
Jakub Onderka 38e260fc04 chg: [freetext] Optimise parsing 2022-10-18 23:10:40 +02:00
Jakub Onderka 260de5a868 new: [freetext] Try to parse input as JSON 2022-10-18 15:14:57 +02:00
Jakub Onderka 3cc2b7b826 new: [freetext] Fetch security vendor domains from warninglist 2022-10-18 12:28:17 +02:00
Jakub Onderka 4f19c0f47b new: [freetext] Remove to_ids from ComplexTypeTool 2022-10-18 12:27:48 +02:00
Jakub Onderka 975f694cd9 new: [freetext] Add support for ja3-fingerprint-md5 import 2022-04-28 18:08:31 +02:00
Jakub Onderka 104ea79afc chg: [internal] Simplify and speedup code for freetext importing 2022-04-15 14:31:17 +02:00
Jakub Onderka 19624a02f7 chg: [internal] Convert array to const in ACLComponent 2021-11-03 10:27:42 +01:00
Jakub Onderka 98d75580a5 chg: [internal] Fix typo 2021-11-03 10:27:42 +01:00
Jakub Onderka 871ca92c48 new: Support for BECH32 (P2WPKH) BTC address 2021-09-28 01:25:58 +02:00
iglocska 98e1f3f2f9
fix: [compatibility] several scoped constants reverted 2021-07-27 16:16:52 +02:00
Jakub Onderka 6440133989 chg: [internal] Convert variable to const 2021-07-21 09:32:51 +02:00
Jakub Onderka 0b0b71e8f5
Merge pull request #7181 from JakubOnderka/freetext-speedup
new: [freetext] Faster freetext parsing with more tests
2021-03-18 20:44:51 +01:00
iglocska 5a917f008f
Merge branch '2.4' into develop 2021-03-16 23:15:30 +01:00
iglocska b773361561
fix: [refanging] Removed obnoxious regexes, fixes #7214
- refanging \\. and .. to . is a stupid idea
2021-03-16 23:14:48 +01:00
Jakub Onderka b17ddeaf70 chg: [feed] Check if value is clean IP without doing expensive operations 2021-03-15 10:51:48 +01:00
Jakub Onderka fc3924c8e8 new: [freetext] Faster freetext parsing with more tests 2021-03-09 16:58:12 +01:00
iglocska fe1034b461
fix: [Freetext import] handle end of sentence periods and brackets better, fixes #7163 2021-03-05 11:57:00 +01:00
Jakub Onderka 1a184ebbb5 new: [internal] Allow to output directly TmpFileTool 2020-12-21 21:02:37 +01:00
Jakub Onderka e2263d6c56 fix: [eventReport] Replace defanged values 2020-12-19 16:52:57 +01:00
Jakub Onderka 2f4d38b2f1 chg: [internal] Cleanup and simplify ShadowAttribute model code 2020-10-11 15:20:20 +02:00
Jakub Onderka 66b0d34337 fix: [freetext] Convert CVE string to uppercase to follow attribute validation 2020-10-06 19:16:52 +02:00
Jakub Onderka 7f7b89edaf chg: [complextype] Support for uppercase hashes 2020-10-02 14:34:04 +02:00
Jakub Onderka fd822ef0c5 chg: [complextype] Speedup hash parsing from CSVs and freetexts 2020-10-02 13:41:43 +02:00
iglocska 802f813b27
chg: [complex parser] added email as an option for parsed email addresses 2020-09-03 12:05:37 +02:00
Jakub Onderka c7d17cad9d chg: [feed] Use less memory when parsing CSV feeds 2020-07-26 21:26:08 +02:00
Jakub Onderka 3df94f868f chg: [freetext] Various code fixes and optimisations 2020-07-13 21:12:26 +02:00
Jakub Onderka a34141c099 chg: [internal] More tests for ComplexTypeTool::checkFreeText 2020-07-13 15:29:17 +02:00
Jakub Onderka 06c7af4f83 chg: [internal] Simplified ComplexTypeTool::checkFreeText 2020-07-13 12:24:52 +02:00
Jakub Onderka e908a80656 fix: [internal] Reduce number of regexp in refang table 2020-07-13 10:13:26 +02:00
Jakub Onderka 9150c2be85 new: [freetext] Convert `[at]` to `@` and `hxtp` and `htxp` to `http`
Fixes #4908 and #4805
2020-07-06 18:22:40 +02:00
Jakub Onderka 73ccbd1f83 fix: [freetext] Handle IPv6 and punycode domains when import 2020-07-06 16:25:24 +02:00
Jakub Onderka cfe18d8c39
chg: [internal] Removed unused function 2020-02-16 14:13:34 +01:00
Andras Iklody d10495f789
Relaxed defanging rules, fixes #5203
Removed multiple dot implosion for links/urls
2019-09-23 14:26:42 +02:00
iglocska 69c6562888 fix: [freetext] Also trim out no-break spaces
░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░
░░░░░░░░███████████████░░░░░░░░░░
░░░░░░███████████████████░░░░░░░░
░░░░░███░░░░░░░░░░░░░░████░░░░░░░
░░░░██░░░░░░░░░░░░░░░░░░░███░░░░░
░░░██░░░░░░░░░░░░░░░░░░░░░███░░░░
░░██░░███████░░░░░░██████░░██░░░░
░██░░██─────██░░░░██────██░░██░░░
░██░░█▄▄▄▄▄▄▄██░░░█▄▄▄▄▄▄██░░██░░
░██░░████─────█░░░████────█░░░██░
░██░░█────────█░░░█───────█░░░██░
██░░░██──────██░░░██─────██░░░░██
██░░░░████████░░░░░███████░░░░░██
█░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░█
█░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░█
█░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░█
█░░░░░███████████████░░░░░░░░░░░█
█░░░████░░░░░░░░░░░░░░░░░░░░░░░░█
█░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░█
█░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░█
██░░░░░░░░░░░░░░░░░░░░░░░░░░░░░██
░██░░░░░░░░░░░░░░░░░░░░░░░░░░░░█░
░░███░░░░░░░░░░░░░░░░░░░░░░░░░██░
░░░░██░░░░░░░░░░░░░░░░░░░░░░░██░░
2019-04-26 09:39:10 +02:00
iglocska 8076dbfad1 fix: [refanging] Removed invalid pattern 2019-04-09 15:51:13 +02:00
iglocska 5eecd75e5b fix: [bug] Typo causing "\" to be stripped from attributes where it shouldn't be stripped 2019-04-09 15:48:29 +02:00
iglocska a3381b8196 new: [refanging] Attributes automatically refanged in beforeValidate, fixes #4442 2019-04-09 14:53:39 +02:00
iglocska 510b781762 fix: [freetext] Stop parsing dates as phone numbers 2019-03-20 13:10:53 +01:00
iglocska 4dd53eb8e3 fix: [freetext import] Handle cases where a value can be both a hash and a btc address better 2019-01-22 08:58:02 +01:00
Daniel Roethlisberger 5b4079637a new: [attributes] Add cdhash attribute, 40+ digit hash, default Payload delivery, ids=1 (#3965) 2018-12-19 20:19:49 +01:00
iglocska a28909d366 new: [freetext] Added BTC recognition, fixes #3864 2018-11-13 12:06:00 +01:00
iglocska cefab3e01c new: [freetext import] Added detection for AS 2018-09-23 11:43:55 +02:00
iglocska 48c6150257 new: [Complex type tool] Detection of [1] style refanging 2018-09-21 15:08:33 +02:00
iglocska bc9524c712 fix: [feeds] Feed caching generates a lot of notices 2018-09-07 13:29:26 +02:00
iglocska a81894f14c chg: [CS] Changed to PSR-2
- to make contributions easier, adopted PSR-2
- used php-cs-fixer to rework the style
- *sniff sniff* Goodbye tab indentation
2018-07-19 11:48:22 +02:00
iglocska 90a8e9110b fix: [freetext] parser was detecting any number as a phone number, fixes #3469
- new requirement: must start with + or contain a -
2018-07-11 15:02:30 +02:00
iglocska 8cc1d86068 fix: Allow filename as an alternative for parsed domains/hostnames 2018-04-25 15:41:58 +02:00
iglocska 8c2dd6d00a fix: Fix to the invalid refanging (Third time's the charm) 2018-04-18 11:25:58 +02:00