Commit Graph

1578 Commits (wip_analystdata)

Author SHA1 Message Date
Raphaël Vinot c06c41956a chg: Bump version 2023-04-12 15:55:55 +02:00
Raphaël Vinot a9885d5e71
Merge pull request #958 from righel/attrs-break-on-dup
[new]: support breakOnDuplicate option for attributes:add()
2023-04-12 15:54:34 +02:00
Raphaël Vinot b28aba4581 chg: Bump deps 2023-04-12 15:51:39 +02:00
Alexandre Dulaunoy 31a3e3f1fd
Merge pull request #961 from c4rl0sL0ur31r0/main
Update reportlab_generator.py
2023-03-30 21:01:53 +02:00
Raphaël Vinot 72715013e8 chg: Bump deps, version. 2023-03-27 09:51:28 +02:00
CarlosLoureiro b4331c9761
Update reportlab_generator.py 2023-03-26 11:12:45 +02:00
Luciano Righetti d3c304a844 add: support breakOnDuplicate option for attributes:add() 2023-03-23 16:34:46 +01:00
Raphaël Vinot cca73e4c4e fix: invalid check if taxo is enabled 2023-03-17 15:44:03 +01:00
Raphaël Vinot eb44f88d25 chg: Bump version 2023-03-17 15:31:36 +01:00
Raphaël Vinot bf541167fd chg: Include event reports by default in feed 2023-03-17 15:31:20 +01:00
Raphaël Vinot a40d91666b fix: Use proper parameter to trigger the request in search_galaxy_clusters 2023-03-17 14:02:29 +01:00
Raphaël Vinot 4363b3f43b fix: use POST in search galaxy cluster 2023-03-17 13:32:40 +01:00
UFOSmuggler 15e6bc2c18 Rename include_event_reports kwarg to with_event_reports, in-line with other kwarg naming 2023-03-15 13:32:45 +11:00
UFOSmuggler 80f242bbea Add kwarg to allow the inclusion of event reports into to_feed(), honour with_distribution and valid_distributions kwargs 2023-03-15 13:27:59 +11:00
Raphaël Vinot d928853607 chg: Bump version 2023-03-14 18:49:45 +01:00
Raphaël Vinot 5226f5a6d4 chg: Add greynoise-ip object
Fix #951
2023-03-14 18:49:05 +01:00
Raphaël Vinot ac784cbdee chg: Bump version 2023-03-10 15:10:51 +02:00
Raphaël Vinot 88291561a5 chg: bump templates 2023-03-09 16:18:53 +02:00
Raphaël Vinot 070472fd9a chg: Bump deps 2023-03-08 14:24:47 +02:00
Raphaël Vinot 590dc768cf fix: Add local key in MISPTag
Related #947
2023-03-08 13:48:22 +02:00
Raphaël Vinot 5fa99aa557 chg: Bump changelog, version 2023-02-28 13:18:35 +01:00
Raphaël Vinot 892c5ade94 chg: Bump templates, again 2023-02-28 13:14:34 +01:00
Raphaël Vinot 54fe400c13 chg: Bump templates 2023-02-28 13:10:59 +01:00
Raphaël Vinot cdf5a1bbda chg: Bump deps, templates 2023-02-28 12:49:59 +01:00
Raphaël Vinot d6460eb9b0 chg: Bump deps 2023-02-15 23:39:36 +01:00
Raphaël Vinot 8b1ae28cc9 fix: undefined variable in event delegation 2023-02-10 13:44:30 +01:00
Raphaël Vinot 5e9433206e fix: Remove reference to old pydeep
Fix #914
2023-02-06 20:43:47 +01:00
Raphaël Vinot c36050db33 chg: Bump version 2023-01-23 10:05:32 +01:00
Raphaël Vinot c95bd5d378 chg: Bump deps, version 2023-01-17 10:26:46 +01:00
Raphaël Vinot c7b67e33a8 fix: Set relationship_type default in MISPTag to empty string 2023-01-17 10:26:46 +01:00
Raphaël Vinot a93131e4bd chg: Bump version 2023-01-16 11:00:42 +01:00
Raphaël Vinot aeae160e3d chg: Bump deps 2023-01-16 10:59:40 +01:00
Raphaël Vinot 024283ba01 new: Add relationship_type in Tag entries for feeds 2023-01-13 20:49:53 +01:00
Raphaël Vinot d7f28aa4cb chg: Bump warning to inform user that python 3.10 wil be required in 12 months 2023-01-07 14:16:45 +01:00
Raphaël Vinot 29dc2d6d1a chg: bump objects 2022-12-22 13:38:21 +01:00
Raphaël Vinot 9aee03e6e6 chg: Bump version 2022-12-22 11:35:23 +01:00
Raphaël Vinot 0917ed6b0b chg: Bump objects 2022-12-22 11:34:30 +01:00
Raphaël Vinot 8da684aad3
Merge pull request #877 from dragsu/feat/exception-when-tag-without-name
Graceful handling of tagging when name attribute is missing
2022-12-22 11:03:16 +01:00
Raphaël Vinot 1fb274821f chg: Re-order classes 2022-12-01 12:06:57 +01:00
Christian Studer 75a100a485
add: Added the `Galaxy` field to MISPAttribute using the MISPGalaxy class
- Including an `add_galaxy` method similar to the
  one used for events
- `attribute.galaxies` gives the list of attached
  galaxy clusters
2022-12-01 10:05:38 +01:00
Raphaël Vinot 22f1ea9a20 chg: Bump deps, version. 2022-11-28 10:26:06 +01:00
iglocska 0298094c05
fix: [describetypes] updated with the latest output from MISP 2022-11-28 10:22:24 +01:00
iglocska a9a56ae47b
fix: [types] added missing type value 2022-11-28 09:46:11 +01:00
iglocska 34a112c41b
chg: [types] added azure-application-id 2022-11-28 08:21:09 +01:00
Raphaël Vinot 2de22871d1 new: Basic support for listing, enabling and disabling decaying models 2022-11-22 14:48:23 +01:00
Sura De Silva 0f79e760c6 Graceful handling of tagging when name attribute is missing 2022-11-17 21:06:59 +11:00
Raphaël Vinot 320957f10c fix: Properly bump version 2022-11-10 15:25:17 +01:00
Marcelo Chaves 47d267dd16
Update __init__.py
Regardless of running the latest PyMISP version, the message below is presented:
```
The version of PyMISP recommended by the MISP instance (2.4.165) is newer than the one you're using now (2.4.162.1). Please upgrade PyMISP.
```
2022-11-10 11:15:57 -03:00
Raphaël Vinot fc7f273f76 fix: issue with EMailObject 2022-11-09 13:44:36 +01:00
Raphaël Vinot fd05292d7c chg: Bump mypy 2022-11-09 13:29:06 +01:00
Raphaël Vinot f1517dbf22 chg: Add links to doc 2022-11-07 15:04:15 +01:00
Alexandre Dulaunoy b8182c42d6
chg: [misp-objects] updated to the latest version 2022-10-27 09:42:40 +02:00
Raphaël Vinot 97fe962be7
Merge pull request #860 from tomking2/feature/taxonomy_required
Add in ability to set a taxonomies required status
2022-10-03 01:02:57 +02:00
Raphaël Vinot aecfad1168 chg: Bump deps and version
Fix LIEF vuln.
2022-10-03 00:52:36 +02:00
Raphaël Vinot 20ce207d18 chg: Bump deps, objects 2022-09-30 10:49:30 +02:00
Tom King b438c27b5e new: Add in ability to set a taxonomies required status 2022-09-14 10:29:38 +01:00
Raphaël Vinot b1896d43f2 fix: Missing place to update version 2022-09-09 14:10:35 +02:00
Raphaël Vinot c1dbd8b0dc chg: Bump deps 2022-09-09 11:49:14 +02:00
Raphaël Vinot c47e235a4e
Merge pull request #858 from tomking2/feature/index_sort_limit
Sort/desc for sorting results and limit/page for pagination
2022-09-09 11:16:26 +02:00
Raphaël Vinot e2f9a7c6f9 new: Pass arbitrary headers to a PyMISP request. 2022-09-08 10:54:54 +02:00
Tom King eb33a9deb9 chg: Add in sort/desc for sorting results and limit/page for pagination 2022-09-06 16:29:22 +01:00
Raphaël Vinot 289ce47d64 new: Allow to force the timestamps in to_dict/to_json, even if a change was made 2022-08-15 18:35:53 +02:00
Raphaël Vinot 3ca8717e6c chg: Improve documentation for add_attribute 2022-08-10 10:48:07 +02:00
Raphaël Vinot 3a387fe397 chg: Bump deps 2022-08-09 21:29:54 +02:00
Raphaël Vinot a5f9ac996c fix: make keepalive configuration linux only
Bump deps
2022-08-09 21:27:47 +02:00
Raphaël Vinot 0859c3d3ce chg: Bump version, deps 2022-08-04 18:03:42 +02:00
Raphaël Vinot 5a0080289f fix: Improper json check on non-json responses
Fix #854
2022-08-03 11:38:24 +02:00
Raphaël Vinot 3ceba3feb1 fix: Mark all attributes in a soft deleted object as soft deleted too.
Bump misp-objects, deps.
2022-08-03 11:10:35 +02:00
Raphaël Vinot 58976dc35c fix: make flake8 happy 2022-07-28 15:12:40 +02:00
Raphaël Vinot b85444a7ad chg: Improve warning on invalid template, bump deps 2022-07-28 15:10:42 +02:00
Derekt2 b36d1ba89f
Update api.py 2022-07-25 09:13:28 -05:00
Raphaël Vinot b251d70164 fix: Properly convert MSG to EML 2022-07-21 16:31:03 +02:00
Philipp Hauswirth 4e4e82d0c9 fix typo in logging message 2022-07-21 13:40:37 +02:00
Raphaël Vinot 3882ade918 chg: Bump deps 2022-07-21 11:18:00 +02:00
Raphaël Vinot 56a70265a0 new: Enable TCP keepalive
Related: https://github.com/MISP/PyMISP/issues/848
2022-07-21 11:18:00 +02:00
Christophe Vandeplas 4ddabe75b5 fig: [feed] fixes bugs during export with old data 2022-06-20 14:18:49 +02:00
Christophe Vandeplas e4919b6bbf Merge remote-tracking branch 'MISP/main' into main 2022-06-20 11:25:54 +02:00
Raphaël Vinot 63d402b358 chg: Make mypy happy 2022-06-16 13:15:27 +02:00
malvidin cfded6e8bb Fix multiple_space warning 2022-06-16 09:44:25 +02:00
malvidin 2b98616982 Option to include more URLObject attributes
Add publicsuffixlist faup for URLObject Windows support
URLObject with PSLFaup prefers IP to host/domain
2022-06-16 09:38:39 +02:00
Christophe Vandeplas 8b34993480 fix: [feed] fixes bug when template_uuid does not exist 2022-06-15 07:18:18 +02:00
Yun Zheng Hu 49b6a45502 Ensure that keys are sorted in the returned `_to_feed()` dictionary
This allows for better deterministic feed output generation.
2022-06-09 14:38:06 +02:00
Raphaël Vinot bb9f053b68
Merge pull request #835 from tomking2/feature/search_sharinggroup
new: Search by sharing groups
2022-06-07 13:18:35 +02:00
Raphaël Vinot cd4b5d533b chg: Bump version 2022-05-30 11:00:59 +02:00
Tom King 31958dd160 chg: Add ability to filter by sharing group for RestSearch for MISP >= v2.4.158 2022-04-21 10:38:52 +01:00
Raphaël Vinot b1892efb6a chg: Bump object templates 2022-03-24 15:45:34 +01:00
Raphaël Vinot 6799346aa0 chg: Bump version 2022-03-24 15:29:09 +01:00
Raphaël Vinot 2783879d72 chg: Bump deps, objects 2022-03-24 15:29:09 +01:00
Alexandre Dulaunoy 78ec1fd2f7
chg: [misp-objects] updated to the latest version 2022-03-17 10:26:56 +01:00
Raphaël Vinot 03dc22f959 chg: Bump changelog 2022-03-03 19:18:01 +01:00
Raphaël Vinot 883889c9c5 fix: Incorrect call when requesting a new API key 2022-03-03 19:09:58 +01:00
Raphaël Vinot fd6a396061 chg: Bump version 2022-03-03 15:09:57 +01:00
Raphaël Vinot 7321abdb1e chg: Bump misp-objects 2022-03-03 15:07:28 +01:00
Raphaël Vinot 24e79c8340 new: get_new_authkey for a user 2022-03-03 15:07:28 +01:00
Alexandre Dulaunoy e5ac59578b
chg: [misp-objects] updated to the latest version 2022-02-04 10:45:04 +01:00
Alexandre Dulaunoy cdf2ee08c1
chg: [FIPS] no clean way to support OpenSSL hashlib interface for FIPS 2022-01-27 15:56:16 +01:00
Alexandre Dulaunoy 14bf1f8189
chg: [FIPS] falling back on older version of Python not having usedforsecurity 2022-01-27 15:47:37 +01:00
Alexandre Dulaunoy 1efc735fb3
fix: [mispevent] cannot type 2022-01-27 15:34:18 +01:00
Alexandre Dulaunoy 6e018a4582
chg: [FIPS] in some cases, the `usedforsecurity` is not used. So fail if
the FIPS compliance is required and then the `usedforsecurity` is
disabled
2022-01-27 15:29:15 +01:00
Alexandre Dulaunoy 02bc129341
chg: [feeds] FIPS: when MD5 hashes are generated for fast-lookup it's not for security.
hashlib provides an option to tell if the hash is used for security or
not. By default, it's set to True. For the feed cache generation, it's
not. Then usedforsecurity=False

Ref: https://csrc.nist.gov/csrc/media/publications/fips/140/2/final/documents/fips1402annexa.pdf
2022-01-27 15:20:57 +01:00
deku c8d633f15b Add feed option for local tag exclusion #817 2022-01-19 21:30:30 +00:00
Raphaël Vinot 75cb39e0ca fix: Make mypy happy 2022-01-13 08:32:30 +01:00
Raphaël Vinot a3634742b3 chg: Bump deps, objects 2022-01-13 08:18:38 +01:00
Raphaël Vinot ae3c358dca chg: Bump version 2021-12-22 11:08:46 +01:00
Raphaël Vinot 43296cce45 chg: Bump deps, object templates 2021-12-22 11:07:38 +01:00
Raphaël Vinot e803d1358d chg: Bump objects templates 2021-12-20 13:18:30 +01:00
Raphaël Vinot 5e1e2b532f chg: Bump misp-objects 2021-12-20 12:05:32 +01:00
Raphaël Vinot bc37a03174 fix: Update live tests to support proper format of SGs 2021-11-30 11:41:53 +01:00
Christophe Vandeplas afedd8d90b fix: [sharinggroups] Fixes wrong model for SharingGroupOrg 2021-11-30 10:43:44 +01:00
Christophe Vandeplas 38105f68b0 fix: [feed-generator] code style fixes 2021-11-29 16:35:12 +01:00
Christophe Vandeplas dd5b448760 fix: [feed-generator] keeping function compatibility 2021-11-29 16:26:57 +01:00
Christophe Vandeplas a9970d3078 chg: [feed-generator] support for distribution and sharing groups 2021-11-29 15:54:34 +01:00
Raphaël Vinot a6fd8ca4b2 chg: Bump version 2021-11-19 01:52:14 -08:00
Raphaël Vinot 474794992b chg: Bump misp-objects 2021-11-17 11:50:01 -08:00
Sami Tainio 25fb7b5a28
chg: Removed a whitespace 2021-11-01 13:41:51 +02:00
Sami Tainio 8772c1fa5e
new: Add Blind Carbon Copy (bcc) headers 2021-11-01 13:35:39 +02:00
Raphaël Vinot f85ccb3e19
Merge pull request #802 from MISP/JakubOnderka-patch-2
fix: PyMISP.get_user_setting method
2021-10-28 16:34:43 -04:00
Raphaël Vinot a16aa03872 chg: Keep strict and generate attributes when needed 2021-10-28 16:29:27 -04:00
Raphaël Vinot 7e9490e12e chg: Slight changes regarding timezones 2021-10-28 16:21:08 -04:00
Thomas Dupuy c82dd6848f chg: Unified constructors 2021-10-27 14:27:38 -04:00
Alexandre Dulaunoy b212894152
chg: [types] remove the duplicate 2021-10-26 21:55:37 +02:00
Alexandre Dulaunoy 17b288d9ca
chg: [describeTypes] remove duplicate filename-pattern 2021-10-26 16:28:31 +02:00
Alexandre Dulaunoy 3b90ab722e
chg: [misp-objects] updated 2021-10-26 16:26:28 +02:00
Alexandre Dulaunoy 772bb52760
Merge branch 'main' of github.com:MISP/PyMISP into main 2021-10-26 11:43:36 +02:00
Alexandre Dulaunoy 4e495935b8
chg: [describeTypes] updated to include ssh-fingerprint 2021-10-26 11:42:26 +02:00
Jakub Onderka 74196ee96f
fix: PyMISP.get_user_setting method 2021-10-25 22:51:28 +02:00
Alexandre Dulaunoy 91f6c1e4b3
chg: [misp-objects] updated to the latest version 2021-10-25 15:40:38 +02:00
Raphaël Vinot ec4172dfba
Merge pull request #795 from tomking2/feature/sharing_group_improvements
Improve sharing groups, new get_sharing_group and return sharing group orgs
2021-10-14 14:51:11 +02:00
Raphaël Vinot e84d5a11f3
Merge pull request #794 from tomking2/feature/org_user_search
chg: Add ability to search against orgs and users by freetext search (both) or organisation (users)
2021-10-14 14:46:34 +02:00
Jakub Onderka 5064107093
Merge pull request #783 from JakubOnderka/fixes-149
Changes for upcoming MISP 2.4.150
2021-10-08 16:38:50 +02:00
Raphaël Vinot e07321bfa9 fix: Missing import in __init__
Fix #796
2021-10-08 15:43:16 +02:00
Tom King a56e344a21 fix: Fix final nosetest 2021-10-04 11:56:13 +01:00
Tom King b3dee88fab fix: Fix nosetests 2021-10-04 11:52:35 +01:00
Tom King c120db02b8 chg: Improve sharing groups, bring back organsations included and ability to get specific SG 2021-10-04 11:41:36 +01:00
Tom King 43d8cdff4a chg: Add ability to search against orgs and users by freetext search (both) or organisation (users) 2021-10-04 11:39:43 +01:00
Raphaël Vinot 21dd71bf4b chg: Bump misp-objects 2021-09-30 11:16:03 +02:00
Raphaël Vinot 54d38df6dc fix: message_from_bytes really dislikes newline at the beginning of a mail 2021-09-30 11:16:03 +02:00
Sami Tainio f6c8e2ad0d
Remove unicode to ascii parts 2021-09-28 16:42:15 +03:00
Sami Tainio 2fb354a938
Fix #787 and add Unicode to ASCII function
Fix #787
- Uses regex to pick up the hostnames/domains from the "Received: from" headers.

Unicode to ASCII function
- Spam messages more often than not contain junk text as unicode characters in the headers. The "from" and "subject" headers being the most common ones. Before this change the script would error on such emails or sometimes replace the unicode characters with questionmarks "?".
- Function takes argument as an input and then encodes it in ascii while ignoring any malformed data. It then returns an ASCII string without the unicode characters.
- Currently implemented for "from" and "subject" handling.
2021-09-28 14:50:17 +03:00
Raphaël Vinot d44847b63a fix: skip IPs in Received header
Related:  #787
2021-09-27 10:27:14 +02:00
Alexandre Dulaunoy 28b016ace1
Merge branch 'main' of github.com:MISP/PyMISP into main 2021-09-24 15:39:56 +02:00
Alexandre Dulaunoy bf8c8711ab
chg: [misp-objects] updated to the latest version 2021-09-24 15:39:35 +02:00
Raphaël Vinot 9fc4d90454 new: Add few keys to email object creator
Fix #787
2021-09-23 17:10:27 +02:00
Alexandre Dulaunoy 06d034947d
chg: [misp-objects] updated to the latest version 2021-09-15 13:31:30 +02:00
Raphaël Vinot 253730759a fix: Upload of STIX document with non-ascii characters
Due to: https://github.com/psf/requests/issues/5560

TL;DR: a variable of type str passed to data in a POST request will be
silently re-encoded to ISO-8859-1, making MISP barf on the other side.
2021-09-09 16:58:27 +02:00
Raphaël Vinot 0bdfb3892d chg: Bump live tests 2021-09-07 14:26:22 +02:00
Jakub Onderka e227cd970b fix: [types] Update types to use `filename-pattern` type 2021-08-31 16:57:54 +02:00
Alexandre Dulaunoy 90e988cf48
chg: [misp-objects] updated to the latest version 2021-08-27 11:02:30 +02:00
Christophe Vandeplas d82a50efb7 chg: [types] updated types/categories mapping 2021-08-20 08:42:00 +02:00
Raphaël Vinot 6f7157cf26 chg: Bump objects template 2021-08-05 11:34:20 +02:00