Commit Graph

1339 Commits (2fb354a938983e755dea4ed056d220e2459996f8)

Author SHA1 Message Date
Sami Tainio 2fb354a938
Fix #787 and add Unicode to ASCII function
Fix #787
- Uses regex to pick up the hostnames/domains from the "Received: from" headers.

Unicode to ASCII function
- Spam messages more often than not contain junk text as unicode characters in the headers. The "from" and "subject" headers being the most common ones. Before this change the script would error on such emails or sometimes replace the unicode characters with questionmarks "?".
- Function takes argument as an input and then encodes it in ascii while ignoring any malformed data. It then returns an ASCII string without the unicode characters.
- Currently implemented for "from" and "subject" handling.
2021-09-28 14:50:17 +03:00
Raphaël Vinot d44847b63a fix: skip IPs in Received header
Related:  #787
2021-09-27 10:27:14 +02:00
Alexandre Dulaunoy 28b016ace1
Merge branch 'main' of github.com:MISP/PyMISP into main 2021-09-24 15:39:56 +02:00
Alexandre Dulaunoy bf8c8711ab
chg: [misp-objects] updated to the latest version 2021-09-24 15:39:35 +02:00
Raphaël Vinot 9fc4d90454 new: Add few keys to email object creator
Fix #787
2021-09-23 17:10:27 +02:00
Alexandre Dulaunoy 06d034947d
chg: [misp-objects] updated to the latest version 2021-09-15 13:31:30 +02:00
Raphaël Vinot 253730759a fix: Upload of STIX document with non-ascii characters
Due to: https://github.com/psf/requests/issues/5560

TL;DR: a variable of type str passed to data in a POST request will be
silently re-encoded to ISO-8859-1, making MISP barf on the other side.
2021-09-09 16:58:27 +02:00
Raphaël Vinot 0bdfb3892d chg: Bump live tests 2021-09-07 14:26:22 +02:00
Alexandre Dulaunoy 90e988cf48
chg: [misp-objects] updated to the latest version 2021-08-27 11:02:30 +02:00
Christophe Vandeplas d82a50efb7 chg: [types] updated types/categories mapping 2021-08-20 08:42:00 +02:00
Raphaël Vinot 6f7157cf26 chg: Bump objects template 2021-08-05 11:34:20 +02:00
Raphaël Vinot fc9e7ca59b chg: Bump version 2021-08-05 11:32:28 +02:00
Raphaël Vinot 3dd88a1418 fix: Typo in key name 2021-08-05 11:14:04 +02:00
Jakub Onderka 76ce8d8c38 new: Save one REST call when initialize PyMISP class 2021-08-05 11:11:06 +02:00
Jakub Onderka 7ccf4c15d2 chg: Do not load schema for event when not necessary 2021-08-05 11:10:33 +02:00
iglocska 9ea5ec8b1f Revert "chg: Remove legacy stix converter."
This reverts commit 94ce4a367b.

- breaks misp-stix converter, reverting it for now, let's find a way to deprecate this without outright removing it
2021-08-05 11:10:33 +02:00
Jakub Onderka 1746138eb3 chg: `get_taxonomy` supports namespace 2021-08-05 11:10:33 +02:00
Jakub Onderka 2ecfc24c14 new: Method `organisation_exists` 2021-08-05 11:10:33 +02:00
Jakub Onderka 7dab091c85 new: Method `sharing_group_exists` 2021-08-05 11:10:31 +02:00
Jakub Onderka 88d0b4ac93 new: Method `update_sharing_group` 2021-08-05 11:09:33 +02:00
Jakub Onderka 270d16cd4c new: `to_dict` method supports `json_format` parameter 2021-06-29 13:28:24 +02:00
Raphaël Vinot 481284dc12 chg: Update mypy, change accordingly 2021-06-21 11:20:41 -07:00
Raphaël Vinot 436181e5bb fix: properly handle the case MISP is in a sub redirect
Fix #757
2021-06-17 19:48:15 -07:00
Raphaël Vinot fcb4d41d63 new: Exclude decayed attributes in search
Fix #753
2021-06-08 10:09:14 -07:00
Raphaël Vinot c14d599d15 chg: Bump version 2021-06-07 07:36:33 -07:00
Raphaël Vinot dd007ce6a7 chg: Bump object templates 2021-06-07 07:35:37 -07:00
Raphaël Vinot 107561e574 chg: bump version, deps 2021-05-13 22:53:12 -07:00
Raphaël Vinot db1ffe7be6 new: method to get the raw object template 2021-05-11 12:30:00 -07:00
Raphaël Vinot 286712d0e1 fix: first-seen and last-seen on attributes and objects were not checked for sanity 2021-05-11 07:28:54 -07:00
Raphaël Vinot 2f1cf24eaa chg: Bump objects templates 2021-05-11 07:28:00 -07:00
Raphaël Vinot 18300f8aed chg: Bump version 2021-04-26 10:52:56 +02:00
Raphaël Vinot 18049212a5 new: Support for correlation exclusion list
Fix #732
2021-04-22 10:47:58 +02:00
Raphaël Vinot b471633acb fix: Enable/disable feeds 2021-04-20 15:36:11 +02:00
Raphaël Vinot cc1af2573f chg: Bump objects templates 2021-04-19 23:12:27 +02:00
Raphaël Vinot 95e31bd2e3 chg: Add comment for controller attribute in search 2021-04-06 20:05:10 +02:00
Raphaël Vinot f0b2a2b943 fix bump version, deps, templates 2021-04-02 16:35:22 +02:00
Raphaël Vinot 5cc994e253 chg: get_uuid_or_id_from_abstract_misp accepts dict 2021-03-30 14:31:31 +02:00
Raphaël Vinot c68ee576b3 fix: use get_uuid_or_id_from_abstract_misp in tag methods
Fix #725
2021-03-30 14:23:32 +02:00
Raphaël Vinot 51edb8ab33 chg: Remove references to ExpandedPyMISP
Fix #721
2021-03-16 18:32:50 +01:00
Raphaël Vinot 00ba313eae chg: Follow best practices and remove the logging handler.
Fixes: #717
Reference: https://docs.python.org/3/howto/logging.html#configuring-logging-for-a-library
Documentation: https://docs.python.org/3/howto/logging.html
2021-03-16 18:28:04 +01:00
Raphaël Vinot 3252361b3c fix: Skip nameless sections in ELF
Related: #678
2021-03-16 17:56:06 +01:00
Raphaël Vinot 31608b1480 chg: strip NULL string from value
https://github.com/MISP/PyMISP/issues/678
2021-03-15 14:09:50 +01:00
Raphaël Vinot aee6945e95 fix: enable taxonomy failed if global pythonify is on 2021-03-09 16:35:00 +01:00
Raphaël Vinot 2734224958 chg: Raise exception on missing template in CSVLoader
Related: #714
2021-03-05 19:33:27 +01:00
Raphaël Vinot b5b2f7015b chg: Bump templates 2021-03-05 18:18:03 +01:00
Raphaël Vinot 2397732b03 chg: re-bump objects 2021-03-05 15:59:23 +01:00
Raphaël Vinot 100eeec77a chg: Bump object templates 2021-03-05 15:51:04 +01:00
Raphaël Vinot a0bda8736a chg: Add test case, fix mypy 2021-03-05 12:11:00 +01:00
Raphaël Vinot 59946a6a6d chg: take simple_value as value in MISPObject.add_attribute 2021-03-05 11:58:58 +01:00
Raphaël Vinot bbd341539a fix: properly pass content-type 2021-03-05 11:42:24 +01:00