Commit Graph

2583 Commits (feature-feedgenerator-exclude-malwares)

Author SHA1 Message Date
Sami Mokaddem 57de6de139
chg: [feed-generator] Make the feature to exlude attribute type more generic 2021-11-17 12:38:25 +01:00
Sami Mokaddem 820eb77cff
fix: [feed-generator] Revert back the event initial search to use the index endpoint instead of RestSearch
Relying on RestSearch was offering more flexibility than index in terms of filtering options,
however, it might introduce a significant overhead potentially leading to timeout.
2021-11-17 12:35:26 +01:00
Sami Mokaddem 93cff2e50e
chg: [feed-generator] Added exclude malware samples option 2021-11-05 11:37:10 +01:00
Raphaël Vinot 3b77b5e3b3 chg: Bump changelog 2021-09-30 11:16:36 +02:00
Raphaël Vinot 21dd71bf4b chg: Bump misp-objects 2021-09-30 11:16:03 +02:00
Raphaël Vinot 17ada5a2bd chg: Bump version 2021-09-30 11:16:03 +02:00
Raphaël Vinot abbcc5bd7b chg: Bump deps 2021-09-30 11:16:03 +02:00
Raphaël Vinot 54d38df6dc fix: message_from_bytes really dislikes newline at the beginning of a mail 2021-09-30 11:16:03 +02:00
Raphaël Vinot 85ac1b0e6a
Merge pull request #789 from samitainio/samitainio-patch-1
Fix #787 and add Unicode to ASCII function
2021-09-28 16:15:40 +02:00
Sami Tainio f6c8e2ad0d
Remove unicode to ascii parts 2021-09-28 16:42:15 +03:00
Sami Tainio 2fb354a938
Fix #787 and add Unicode to ASCII function
Fix #787
- Uses regex to pick up the hostnames/domains from the "Received: from" headers.

Unicode to ASCII function
- Spam messages more often than not contain junk text as unicode characters in the headers. The "from" and "subject" headers being the most common ones. Before this change the script would error on such emails or sometimes replace the unicode characters with questionmarks "?".
- Function takes argument as an input and then encodes it in ascii while ignoring any malformed data. It then returns an ASCII string without the unicode characters.
- Currently implemented for "from" and "subject" handling.
2021-09-28 14:50:17 +03:00
Raphaël Vinot d44847b63a fix: skip IPs in Received header
Related:  #787
2021-09-27 10:27:14 +02:00
Alexandre Dulaunoy 28b016ace1
Merge branch 'main' of github.com:MISP/PyMISP into main 2021-09-24 15:39:56 +02:00
Alexandre Dulaunoy bf8c8711ab
chg: [misp-objects] updated to the latest version 2021-09-24 15:39:35 +02:00
Raphaël Vinot 9fc4d90454 new: Add few keys to email object creator
Fix #787
2021-09-23 17:10:27 +02:00
Raphaël Vinot 3072dac568 fix: name is passed to super 2021-09-22 11:47:14 +02:00
Raphaël Vinot 309eb3e8ab fix: Do not create empty manifest, json load dislikes it. 2021-09-22 10:14:56 +02:00
Raphaël Vinot 7379d82734 fix: Initial round of cleanup on redis feed generator 2021-09-22 10:10:51 +02:00
Steve Clement 212a4e2ade
Merge pull request #786 from SteveClement/main 2021-09-22 15:54:56 +09:00
Steve Clement bb921533fa
chg: [doc] Minor fixes, note and typo 2021-09-22 15:53:07 +09:00
Raphaël Vinot cf36dadc01 chg: Bump deps 2021-09-20 22:36:05 +02:00
Alexandre Dulaunoy 06d034947d
chg: [misp-objects] updated to the latest version 2021-09-15 13:31:30 +02:00
Raphaël Vinot 253730759a fix: Upload of STIX document with non-ascii characters
Due to: https://github.com/psf/requests/issues/5560

TL;DR: a variable of type str passed to data in a POST request will be
silently re-encoded to ISO-8859-1, making MISP barf on the other side.
2021-09-09 16:58:27 +02:00
Raphaël Vinot eafbb76441 chg: Update tutorial for custom objects 2021-09-09 12:05:55 +02:00
Raphaël Vinot 37731afb9c chg: Bump deps 2021-09-07 14:28:00 +02:00
Raphaël Vinot 0bdfb3892d chg: Bump live tests 2021-09-07 14:26:22 +02:00
Raphaël Vinot 93e3da2df9 fix: remove outdated deps from setup.py
Fix https://github.com/MISP/MISP/issues/7729
2021-09-06 10:40:53 +02:00
Raphaël Vinot 8e5f4b7aba new: test cases for edit objects and upload stix 2021-09-03 15:25:45 +02:00
Alexandre Dulaunoy 90e988cf48
chg: [misp-objects] updated to the latest version 2021-08-27 11:02:30 +02:00
Raphaël Vinot 3986a1ad74
Merge pull request #779 from cvandeplas/main
chg: [types] updated types/categories mapping
2021-08-20 09:22:39 +02:00
Christophe Vandeplas d82a50efb7 chg: [types] updated types/categories mapping 2021-08-20 08:42:00 +02:00
Raphaël Vinot 735fb88c37 chg: Remove test files 2021-08-17 12:51:04 +02:00
Raphaël Vinot a2dc13c5e5 chg: Automatically pull the malwares repo when running tests/testlive_comprehensive.py 2021-08-17 12:45:27 +02:00
Raphaël Vinot 00be8d8809 chg: remove submodules with malware 2021-08-17 12:40:56 +02:00
Raphaël Vinot 4ec01bb096 chg: Add test for updating a objects from a custom template
Related: #776
2021-08-09 09:16:04 +02:00
Raphaël Vinot 903e74efd3
Update README.md
Not using travis anymore.
2021-08-08 20:56:44 +02:00
Raphaël Vinot ad354a2566 chg: re-bump changelog 2021-08-05 11:34:49 +02:00
Raphaël Vinot 6f7157cf26 chg: Bump objects template 2021-08-05 11:34:20 +02:00
Raphaël Vinot 26eb4bcfa7 chg: Bump changelog 2021-08-05 11:33:34 +02:00
Raphaël Vinot fc9e7ca59b chg: Bump version 2021-08-05 11:32:28 +02:00
Raphaël Vinot 81e7db14bb Merge branch 'JakubOnderka-to_dict_json_format' 2021-08-05 11:22:45 +02:00
Raphaël Vinot 630cb73dec chg: Remove duplicates tests 2021-08-05 11:19:58 +02:00
Raphaël Vinot 3dd88a1418 fix: Typo in key name 2021-08-05 11:14:04 +02:00
iglocska 70d716622e chg: [testlive_comprehensive] correct path to access sharing group releasability after edit 2021-08-05 11:12:54 +02:00
Jakub Onderka 475525429a fix: [test] test_sharing_groups 2021-08-05 11:11:42 +02:00
Jakub Onderka 9e71e859e9 new: Method `sharing_group_exists` 2021-08-05 11:11:42 +02:00
Jakub Onderka b963c41716 new: Method `update_sharing_group` 2021-08-05 11:11:40 +02:00
Jakub Onderka 76ce8d8c38 new: Save one REST call when initialize PyMISP class 2021-08-05 11:11:06 +02:00
Raphaël Vinot 7f53761403 chg: properly validate update_sharing_group without pythonify 2021-08-05 11:11:06 +02:00
Raphaël Vinot 71ea0cc19d chg: Bump missing dep 2021-08-05 11:11:06 +02:00