Commit Graph

3127 Commits (9ba04ee0217bff48e9466346d782719ee1df2772)

Author SHA1 Message Date
Sami Tainio 2fb354a938
Fix #787 and add Unicode to ASCII function
Fix #787
- Uses regex to pick up the hostnames/domains from the "Received: from" headers.

Unicode to ASCII function
- Spam messages more often than not contain junk text as unicode characters in the headers. The "from" and "subject" headers being the most common ones. Before this change the script would error on such emails or sometimes replace the unicode characters with questionmarks "?".
- Function takes argument as an input and then encodes it in ascii while ignoring any malformed data. It then returns an ASCII string without the unicode characters.
- Currently implemented for "from" and "subject" handling.
2021-09-28 14:50:17 +03:00
Raphaël Vinot d44847b63a fix: skip IPs in Received header
Related:  #787
2021-09-27 10:27:14 +02:00
Alexandre Dulaunoy 28b016ace1
Merge branch 'main' of github.com:MISP/PyMISP into main 2021-09-24 15:39:56 +02:00
Alexandre Dulaunoy bf8c8711ab
chg: [misp-objects] updated to the latest version 2021-09-24 15:39:35 +02:00
Raphaël Vinot 9fc4d90454 new: Add few keys to email object creator
Fix #787
2021-09-23 17:10:27 +02:00
Raphaël Vinot 3072dac568 fix: name is passed to super 2021-09-22 11:47:14 +02:00
Raphaël Vinot 309eb3e8ab fix: Do not create empty manifest, json load dislikes it. 2021-09-22 10:14:56 +02:00
Raphaël Vinot 7379d82734 fix: Initial round of cleanup on redis feed generator 2021-09-22 10:10:51 +02:00
Steve Clement 212a4e2ade
Merge pull request #786 from SteveClement/main 2021-09-22 15:54:56 +09:00
Steve Clement bb921533fa
chg: [doc] Minor fixes, note and typo 2021-09-22 15:53:07 +09:00
Raphaël Vinot cf36dadc01 chg: Bump deps 2021-09-20 22:36:05 +02:00
Alexandre Dulaunoy 06d034947d
chg: [misp-objects] updated to the latest version 2021-09-15 13:31:30 +02:00
Raphaël Vinot 253730759a fix: Upload of STIX document with non-ascii characters
Due to: https://github.com/psf/requests/issues/5560

TL;DR: a variable of type str passed to data in a POST request will be
silently re-encoded to ISO-8859-1, making MISP barf on the other side.
2021-09-09 16:58:27 +02:00
Raphaël Vinot eafbb76441 chg: Update tutorial for custom objects 2021-09-09 12:05:55 +02:00
Raphaël Vinot 37731afb9c chg: Bump deps 2021-09-07 14:28:00 +02:00
Raphaël Vinot 0bdfb3892d chg: Bump live tests 2021-09-07 14:26:22 +02:00
Raphaël Vinot 93e3da2df9 fix: remove outdated deps from setup.py
Fix https://github.com/MISP/MISP/issues/7729
2021-09-06 10:40:53 +02:00
Raphaël Vinot 8e5f4b7aba new: test cases for edit objects and upload stix 2021-09-03 15:25:45 +02:00
Jakub Onderka e227cd970b fix: [types] Update types to use `filename-pattern` type 2021-08-31 16:57:54 +02:00
Jakub Onderka 545f149480 chg: [test] Check if all category types exists 2021-08-31 16:56:28 +02:00
Jakub Onderka 0abe34f106 fix: [test] Remove debug print 2021-08-31 16:55:25 +02:00
Jakub Onderka 2e698d70ba fix: [test] Correct error messages for blocked event 2021-08-31 16:54:46 +02:00
Alexandre Dulaunoy 90e988cf48
chg: [misp-objects] updated to the latest version 2021-08-27 11:02:30 +02:00
Raphaël Vinot 3986a1ad74
Merge pull request #779 from cvandeplas/main
chg: [types] updated types/categories mapping
2021-08-20 09:22:39 +02:00
Christophe Vandeplas d82a50efb7 chg: [types] updated types/categories mapping 2021-08-20 08:42:00 +02:00
Raphaël Vinot 735fb88c37 chg: Remove test files 2021-08-17 12:51:04 +02:00
Raphaël Vinot a2dc13c5e5 chg: Automatically pull the malwares repo when running tests/testlive_comprehensive.py 2021-08-17 12:45:27 +02:00
Raphaël Vinot 00be8d8809 chg: remove submodules with malware 2021-08-17 12:40:56 +02:00
Raphaël Vinot 4ec01bb096 chg: Add test for updating a objects from a custom template
Related: #776
2021-08-09 09:16:04 +02:00
Raphaël Vinot 903e74efd3
Update README.md
Not using travis anymore.
2021-08-08 20:56:44 +02:00
Raphaël Vinot ad354a2566 chg: re-bump changelog 2021-08-05 11:34:49 +02:00
Raphaël Vinot 6f7157cf26 chg: Bump objects template 2021-08-05 11:34:20 +02:00
Raphaël Vinot 26eb4bcfa7 chg: Bump changelog 2021-08-05 11:33:34 +02:00
Raphaël Vinot fc9e7ca59b chg: Bump version 2021-08-05 11:32:28 +02:00
Raphaël Vinot 81e7db14bb Merge branch 'JakubOnderka-to_dict_json_format' 2021-08-05 11:22:45 +02:00
Raphaël Vinot 630cb73dec chg: Remove duplicates tests 2021-08-05 11:19:58 +02:00
Raphaël Vinot 3dd88a1418 fix: Typo in key name 2021-08-05 11:14:04 +02:00
iglocska 70d716622e chg: [testlive_comprehensive] correct path to access sharing group releasability after edit 2021-08-05 11:12:54 +02:00
Jakub Onderka 475525429a fix: [test] test_sharing_groups 2021-08-05 11:11:42 +02:00
Jakub Onderka 9e71e859e9 new: Method `sharing_group_exists` 2021-08-05 11:11:42 +02:00
Jakub Onderka b963c41716 new: Method `update_sharing_group` 2021-08-05 11:11:40 +02:00
Jakub Onderka 76ce8d8c38 new: Save one REST call when initialize PyMISP class 2021-08-05 11:11:06 +02:00
Raphaël Vinot 7f53761403 chg: properly validate update_sharing_group without pythonify 2021-08-05 11:11:06 +02:00
Raphaël Vinot 71ea0cc19d chg: Bump missing dep 2021-08-05 11:11:06 +02:00
Raphaël Vinot e3cda466e0 chg: Bump deps 2021-08-05 11:11:06 +02:00
iglocska 0bcd293c01 chg: [testlive_comprehensive] correct path to access sharing group releasability after edit 2021-08-05 11:11:04 +02:00
Jakub Onderka 379e1ded0a fix: [test] test_sharing_groups again 2021-08-05 11:10:33 +02:00
Jakub Onderka 9db0ddd14d fix: [test] test_sharing_groups 2021-08-05 11:10:33 +02:00
iglocska 8729adaed1 chg: [authkey test] removed from testlive_comprehensive
- the default now enables advanced authkeys making the retriaval of keys impossible after the user creation
2021-08-05 11:10:33 +02:00
Jakub Onderka 7ccf4c15d2 chg: Do not load schema for event when not necessary 2021-08-05 11:10:33 +02:00