Commit Graph

80 Commits (791dc9deabd2d7fdfd7c371331eb557d14782372)

Author SHA1 Message Date
Jakub Onderka 2dea93375e fix: [warnings] Cache deletion 2020-10-03 12:49:33 +02:00
Jakub Onderka 36a9b15211 chg: [warninglist] Use faster method for fetching data from Redis 2020-10-03 10:17:06 +02:00
Jakub Onderka 93b16280ca chg: [warninglist] Hash key in binary and store just for one hour 2020-10-03 10:17:06 +02:00
Jakub Onderka 41ec29e12a chg: [internal] Fix for exact string match 2020-10-03 10:17:05 +02:00
Jakub Onderka d6c83993c1 chg: [internal] Normalize CIDR and hostname warninglists 2020-10-03 10:17:05 +02:00
Jakub Onderka 4a339773b5 fix: [internal] IPv6 CIDR warninglist 2020-10-03 10:17:05 +02:00
Jakub Onderka a77ee50845 chg: [internal] Simplified Warninglist::__checkValue 2020-10-03 10:17:05 +02:00
Jakub Onderka b031ad3a07 chg: [internal] Change method name to show that it just filter one attr 2020-10-03 10:17:05 +02:00
Jakub Onderka e54482c77e chg: [internal] Save memory when storing warninglist to cache 2020-10-03 10:17:05 +02:00
Jakub Onderka 6eb66835e4 chg: [internal] Start IPv4 checking from zero 2020-10-03 10:17:05 +02:00
Jakub Onderka c79b282134 chg: [internal] Warninglist code cleanup 2020-10-03 10:17:05 +02:00
Jakub Onderka aeef4e2946 chg: [internal] Fix event warnings without redis cache 2020-10-03 10:17:05 +02:00
Jakub Onderka 1882b60ddf new: [internal] Allow to set warning checking for all attributes, not just IDS 2020-10-03 10:17:05 +02:00
Jakub Onderka 7173663c19 chg: [internal] Move getting missing tlds list to model 2020-10-03 10:17:05 +02:00
Jakub Onderka ce3581c291 chg: [internal] Refactoring warninglist loading and saving 2020-10-03 10:17:05 +02:00
Jakub Onderka b8a9b5e87e chg: [internal] Attach warnings to proposals 2020-10-03 10:17:05 +02:00
Jakub Onderka 66b270b42e chg: [internal] Rename Warninglist::simpleCheckForWarning to checkForWarning 2020-10-03 10:17:05 +02:00
Jakub Onderka 40ab937181 new: [warninglist] Allow to check if IP in CIDR is part of another CIDR 2020-10-03 10:17:05 +02:00
Jakub Onderka bbb08e4074 new: [warninglist] Cache warninglist results 2020-10-03 10:17:05 +02:00
Jakub Onderka c9b024e220 chg: [internal] Faster checking if warninglist already exists for event 2020-07-13 17:53:09 +02:00
Jason Kendall aa0b79925b Clean up errors when trying to update warning lists 2020-05-15 12:26:06 -04:00
iglocska e11490494e
fix: [internal] Added a code branch to check if saddarray is available - if yes, use it
- for the warninglist model's cacheWarninglistEntries function
2019-09-16 09:28:43 +02:00
Andras Iklody 3e3318c419
fix: [internal] warninglist missing Redis::sAddArray() fixed 2019-09-15 11:15:34 +02:00
Andras Iklody 3b555ec2c7
Merge pull request #5014 from JakubOnderka/filter-cidr
Much faster IPv4 warninglists
2019-08-21 10:29:42 +02:00
Jakub Onderka c580b52e11
chg: [warning-list] Use different algorithm for IPv4 CIDR comparsion 2019-08-20 15:44:32 +02:00
Jakub Onderka 99adde7406 chg: [warning-list] Filter CIDR warning list before eval 2019-08-18 09:56:37 +02:00
Jakub Onderka 4d66609262 fix: [warninglist] Entries cache is properly deleted 2019-08-16 19:49:35 +02:00
Jakub Onderka 6b968895f0 chg: [warninglist] Do not check twice if key in cache exists 2019-08-16 19:27:23 +02:00
iglocska 3bde3d8086
Revert "chg: [warning-list] Filter CIDR warning list before eval"
This reverts commit 20632d5e10.
2019-08-15 20:04:31 +02:00
Andras Iklody fdf66029c5
Merge pull request #4971 from JakubOnderka/patch-5
fix: [warning-list] Split value just if type is malware-sample or contains `|` char
2019-08-11 10:52:25 +02:00
Jakub Onderka fdd4de6988 fix: [warning-list] Split value just if type is malware-sample or contains `|` char 2019-08-10 13:25:30 +02:00
Jakub Onderka 20632d5e10 chg: [warning-list] Filter CIDR warning list before eval 2019-08-08 18:42:03 +02:00
Jakub Onderka 24f37230f6
chg: Use faster algorithm for Warninglist::__ipv6InCidr 2019-08-02 13:06:06 +02:00
Jakub Onderka 5615d9fd1b
chg: More efficient Warninglist::__evalCIDR 2019-08-02 09:31:40 +02:00
iglocska 5c9332072f new: [API] Added includeWarninglistHits to the attribute search API 2019-05-09 17:25:39 +02:00
iglocska 6150d9e4a6 new: [API] Added includeWarninglistHits as a possible filter for the event level restsearch 2019-05-09 17:14:25 +02:00
iglocska 2d0259ce13 fix: [CS] coding standards script re-run 2018-11-23 14:11:33 +01:00
iglocska 7a01de5359 new: [API] Added a way to use the API to throw values at the warninglist for quick evaluations of the values 2018-10-16 17:57:14 +02:00
iglocska a81894f14c chg: [CS] Changed to PSR-2
- to make contributions easier, adopted PSR-2
- used php-cs-fixer to rework the style
- *sniff sniff* Goodbye tab indentation
2018-07-19 11:48:22 +02:00
iglocska 51142f0e0f fix: [performance API] fix performance issues with warninglists via the API 2018-06-04 23:10:53 +02:00
iglocska 5b53eb49f8 new: [performance] Massive performance gains for the warninglists 2018-06-04 23:00:07 +02:00
iglocska 5795b1974a new: Added warning about missing warninglists used for TLD resolution in the freetext import tool
- following the twitter feedback
2018-04-26 18:57:00 +02:00
iglocska 98e07175a8 new: Add regex type to warninglists 2018-01-20 08:15:02 +01:00
iglocska 85a89a3da6 fix: Some fixes to the hostname parsing for warninglists 2017-12-22 14:31:15 +01:00
iglocska dba77b4762 fix: Fixed various warninglist performance issues for updating 2017-12-22 14:11:00 +01:00
iglocska 2006d20326 fix: Fixed various warninglist issues
- no more mysql packet size issues on ingestion
- much hfaster ingestion of warninglists
- delete warninglists from the UI
2017-12-22 13:15:22 +01:00
iglocska 53ff0b926b fix: Inverted check on filterwarninglistAttributes causing the warninglist not to be adhered to correctly 2017-12-20 09:35:47 +01:00
iglocska fd45eed6c4 chg: Added .onion to the TLD list for the complext type tool 2017-09-26 09:14:00 +02:00
iglocska 8cd31dd76c new: Further work on the object UI
- refactoring
- added objects fields to object rows
- nested rows within the object
- massive cleanup
2017-08-02 23:01:12 +02:00
iglocska 3d74dbee28 new: First round of massive performance tuning (tm)(c)
- Make MISP fast again
2017-06-09 15:38:45 +02:00