Commit Graph

1148 Commits (d1a2dd10abd588c3c342095c6c7032182b6efb07)

Author SHA1 Message Date
Raphaël Vinot 8980c2da3b fix: Typo, add test for extended event 2020-05-04 10:19:55 +02:00
VVX7 a76a85b616 chg: [dev] add extend_event() test. chg typo in get_event() 2020-05-03 20:58:33 -04:00
Raphaël Vinot 3ac8c5916b chg: Bump CHANGELOG 2020-04-30 10:23:31 +02:00
Raphaël Vinot 029aa8df79 chg: Bump objects, deps 2020-04-30 10:20:21 +02:00
Raphaël Vinot ed2a95fbdd new: Extended option on get event
Related to #567
2020-04-28 11:17:27 +02:00
mokaddem f965e579d7 fix: [abstract] Forces file to be read with utf8 encoding 2020-04-24 11:33:32 +02:00
DocArmoryTech 4ee4db16fe
Fixed __query_virustotal return type
__query_virustotal returned a Response object and not the json expected; modified so that report_json is returned instead of report.
2020-04-06 10:46:15 +01:00
Raphaël Vinot 92e884f15d chg: Bump version 2020-03-30 09:39:57 +02:00
Raphaël Vinot a64c79e960 chg: Bump misp-objects 2020-03-30 09:35:11 +02:00
Raphaël Vinot b5b40ae2c5 fix: Strip every string in AbstractMISP
fix #546
2020-03-24 14:34:29 +01:00
Raphaël Vinot 2a9c79a1e9 fix: Incorrect expectation of attribute value to be a str - take 2
Related #553
2020-03-13 12:02:11 +01:00
Raphaël Vinot 8cf3887d54 fix: Incorrect expectation of attribute value to be a str
Fix #553
2020-03-13 11:02:51 +01:00
Raphaël Vinot 1b4c74642d chg: Bump version 2020-03-10 14:10:38 +01:00
Raphaël Vinot 4fba2b05ad chg: Bump misp-objects 2020-03-10 10:27:52 +01:00
Raphaël Vinot eff7146b3c chg: JSON files are UTF8
Bump dev deps, update comment
2020-03-02 17:33:41 +01:00
Raphaël Vinot 67442dd503 new: Add import script for dxy data 2020-03-02 00:13:53 +01:00
Raphaël Vinot 68a2352afd chg: Bump misp-objects 2020-02-29 01:38:46 +01:00
Raphaël Vinot 0a696d8c14 chg: Bump misp-objects 2020-02-26 14:52:41 +01:00
Raphaël Vinot ffffbef69a chg: Bump misp-objects 2020-02-26 14:50:26 +01:00
Raphaël Vinot 92afc4a2a0 chg: Bump version 2020-02-26 14:39:58 +01:00
Raphaël Vinot 21a0c74443 chg: Bump misp-objects 2020-02-26 14:39:13 +01:00
Raphaël Vinot 8d6e69ce65 fix: mypy, more typing 2020-02-24 17:09:42 +01:00
Raphaël Vinot 94c2a644af fix: do not skip data in add_attribute methods 2020-02-24 14:13:10 +01:00
Raphaël Vinot 35377399e8 new: Add uuid by default in MISPEvent, add F/L seen in feed output. 2020-02-21 14:12:36 +01:00
Tom King b08d26d762 chg: Remove SG search for search() func as this doesn't support SG searching, but the index does 2020-02-13 16:35:11 +00:00
Tom King 394b7a545e Merge remote-tracking branch 'upstream/master' into feature/tagdelete_searchsg 2020-02-13 16:27:24 +00:00
Tom King 415e06f375 fix: merge SG params to allow search 2020-02-13 16:20:14 +00:00
Raphaël Vinot 55d1faac90 chg: Bump objects 2020-02-07 13:16:40 +01:00
Raphaël Vinot 0f72460d1a chg: Bump version 2020-02-07 13:15:18 +01:00
Raphaël Vinot 11353f8ae2 fix: Make lief optional again
fix #538
2020-02-07 11:51:48 +01:00
Raphaël Vinot 70dca1d408 fix: Bump objects 2020-02-06 10:58:40 +01:00
Raphaël Vinot f14963a656 chg: Bump version 2020-02-06 10:42:38 +01:00
Raphaël Vinot 8d58a50b9a chg: Bump objects 2020-02-06 10:30:16 +01:00
Raphaël Vinot 732908a1d3 fix: Remove debugging 2020-02-05 17:29:40 +01:00
Raphaël Vinot a1e96731b2 Merge branch 'master' of github.com:MISP/PyMISP 2020-02-05 13:11:56 +01:00
Raphaël Vinot fe80924d60 chg: str to int, properly load SharingGroup
Fix #535
2020-02-05 13:08:17 +01:00
mokaddem 52774769ac fix: [*-seen] Consider that `-` can also be in the date component while
parsing
2020-01-31 12:26:50 +01:00
Raphaël Vinot 3bfa202bfb new: Add decay score in search query 2020-01-30 14:05:02 +01:00
Raphaël Vinot 4e586d0de5 chg: Bump deps, add pep8 test 2020-01-30 11:44:13 +01:00
Raphaël Vinot cbce2cfbfe chg: Bump objects 2020-01-30 11:40:07 +01:00
Raphaël Vinot 864d294294 chg: Support dict in tag/untag 2020-01-30 11:07:49 +01:00
Raphaël Vinot 98e1feefa1 fix: Syntax and typos 2020-01-28 14:12:39 +01:00
Raphaël Vinot f43266fcf2 chg: Normalize to_datetime conversion 2020-01-27 20:14:14 +01:00
Raphaël Vinot 32445973bd new: Support for first_seen/last_seen
Cleaner import of datetime
2020-01-27 19:07:52 +01:00
Raphaël Vinot 97d960883c chg: Trustar example uses objects 2020-01-24 13:17:48 +01:00
Raphaël Vinot 2ab47e191a fix: Bugs introduced by last commit 2020-01-23 11:03:23 +01:00
Raphaël Vinot b0e95fd5af chg: Refactorize typing, validate 2020-01-23 10:27:40 +01:00
Raphaël Vinot c24cbbe141 chg: Bump version 2020-01-17 14:59:47 +01:00
Raphaël Vinot 9743c37fc8 chg: Bump misp-objects 2020-01-17 14:55:15 +01:00
AaronK c0d375473a
Update api.py
minor typo, can;t help it noticing those. sorry,
2020-01-15 17:26:08 +01:00
Raphaël Vinot aa17663b58 chg: Add more typing information 2020-01-03 15:42:15 +01:00
Raphaël Vinot 2e064563c3 chg: Add typing markup 2020-01-02 15:55:00 +01:00
Raphaël Vinot 6427ce3c84 chg: Bump misp-objects 2020-01-01 03:33:06 +01:00
Raphaël Vinot 6d4ae575e9 Merge branch 'master' into python3.6 2019-12-30 16:49:37 +01:00
Raphaël Vinot 3a858c1fc7 Merge branch 'master' into python3.6 2019-12-30 16:48:46 +01:00
Alexandre Dulaunoy 2d5e729025
new: [attribute type] kusto-query attribute type
Kusto query is the query language for the Kusto services in Azure used
to search large dataset. It's used in Windows Defender ATP Hunting-Queries
and also Azure Sentinel (Cloud-native SIEM).
2019-12-28 15:30:39 +01:00
Alexandre Dulaunoy 5493881d52
Merge branch 'master' of https://github.com/cudeso/PyMISP into cudeso-master 2019-12-27 17:33:06 +01:00
Raphaël Vinot 70510f5aa8 chg: Bump misp-objects 2019-12-26 17:13:59 +01:00
Koen Van Impe acae958947 Sync 2019-12-23 21:21:45 +01:00
Raphaël Vinot 24a8f90ea8 new: Remove python < 3.6 support. 2019-12-18 14:45:14 +01:00
Raphaël Vinot a8d1285be2 chg: Version bump 2019-12-17 10:45:55 +01:00
Raphaël Vinot 7ec1940d66 chg: Bump misp-objects 2019-12-16 15:03:30 +01:00
Raphaël Vinot 24594a5aea fix: Test case on reference 2019-12-11 23:38:41 +01:00
Raphaël Vinot c9b5d24073 fix: Add missing fields to event & attribute for the feed output 2019-12-11 23:12:14 +01:00
Raphaël Vinot 3983efa373 Merge branch 'master' of github.com:MISP/PyMISP 2019-12-10 17:28:10 +01:00
Raphaël Vinot 056cab15a0 chg: Move scrippsco2 feed generator to a sub directory 2019-12-10 16:39:24 +01:00
Alexandre Dulaunoy 36cc79ffb6
Merge branch 'master' of github.com:MISP/PyMISP 2019-12-05 19:18:44 +01:00
Alexandre Dulaunoy 954da3c365
chg: [types] eppn type added 2019-12-05 19:18:03 +01:00
Raphaël Vinot c03b26a18c new: URLObject (requires pyfaup) 2019-12-04 15:18:27 +01:00
Raphaël Vinot 99d015a0d1 chg: Update documentation
Fix #396
2019-12-02 23:33:01 +01:00
Raphaël Vinot 75ecabaccf chg: Bump objects 2019-12-02 09:57:29 +01:00
Raphaël Vinot 51b0ad58f3 chg: Bump version 2019-12-02 09:40:13 +01:00
Raphaël Vinot 0d354b2032 fix: Update tests. 2019-11-29 16:33:17 +01:00
Raphaël Vinot 446649992f fix: Raise PyMISPError instead of Exception 2019-11-27 17:08:15 +01:00
Raphaël Vinot 4fed55a09d fix: Rename feed_meta_generator so it clearly fails with python<3.6 2019-11-27 11:10:57 +01:00
Tom King cf45bf0c46 new: Delete tags via update_attribute, search by sharing group 2019-11-26 12:21:24 +00:00
VVX7 8177476d7c new: add includeDecayScore to rest search 2019-11-25 17:24:52 -05:00
Raphaël Vinot 9495ae8c89 chg: Bump version 2019-11-25 16:45:27 +01:00
Raphaël Vinot 78c9f4f605 chg: Few more improvements on the feed export 2019-11-25 16:35:56 +01:00
Raphaël Vinot af3e19a271 chg: Bump misp-objects 2019-11-25 16:29:18 +01:00
Raphaël Vinot 38ee7679a7 cch: Bump misp-objects 2019-11-25 14:44:53 +01:00
Raphaël Vinot 6098cd869f chg: Make the feed generator more generic 2019-11-22 17:36:24 +01:00
Raphaël Vinot 61867a8257 fix: improve stability of feed output 2019-11-20 12:49:42 +01:00
Raphaël Vinot 8d92a77c92 fix: Do not unitialize the uuid in MISPEvent 2019-11-20 10:52:27 +01:00
Raphaël Vinot b1818b1751 new: Add to_feed export to MISPEvent 2019-11-19 15:53:58 +01:00
Raphaël Vinot 928af44b4c chg: Bump misp-object 2019-11-18 18:04:24 +01:00
Raphaël Vinot 2da35829b1 chg: Allow to sort and indent the json output for objects 2019-11-18 18:04:02 +01:00
Raphaël Vinot cd2995a212 fix: Print the full json blob in debug mode
Related https://github.com/MISP/PyMISP/issues/462
2019-11-15 13:59:55 +01:00
Raphaël Vinot b1e50c8f6d chg: Bump objects 2019-11-15 13:35:18 +01:00
Raphaël Vinot c5dfa9b509 new: Test cases for restricted tags
Fix #483
2019-11-11 16:39:20 +01:00
Raphaël Vinot 8c2bbaa13c new: Get Database Schema Diagnostic
Fix #492
2019-11-11 14:28:17 +01:00
Raphaël Vinot 0c74ff7078 Merge branch 'master' of github.com:MISP/PyMISP 2019-10-30 16:27:42 +01:00
Raphaël Vinot 047f3f96e8 fix: Avoid exception on legacy MISP 2019-10-30 16:27:31 +01:00
Raphaël Vinot b273a308d0 chg: Bump version 2019-10-30 16:08:11 +01:00
Christophe Vandeplas 494e70eb69 fix: prevents exception when lief is not installed 2019-10-30 14:23:37 +01:00
Shortfinga f79f5584ed Corrected docstring 2019-10-23 13:41:11 +02:00
Raphaël Vinot ed6db5988a chg: Bump misp-objects 2019-10-18 14:46:23 +02:00
Raphaël Vinot 880fb300ea chg: Use default category from template
Fix #477
2019-10-18 14:44:57 +02:00
Raphaël Vinot fef328d395 fix: Python <3.4 should work again....
Fix #482
2019-10-18 11:56:09 +02:00
Raphaël Vinot 11d7ede2a2 fix: remote_describe_types response was invalid 2019-10-17 10:53:07 +02:00
Raphaël Vinot d643de7eea fix: Missing file in last commit 2019-10-16 17:25:22 +02:00
Raphaël Vinot cde248b825 Merge branch 'master' of github.com:MISP/PyMISP 2019-10-16 17:22:33 +02:00
Raphaël Vinot c509b22beb new: Add support for UserSettings 2019-10-16 17:22:19 +02:00
Raphaël Vinot aba8e322b6
Merge pull request #476 from ater49/patch-1
Update aping.py
2019-10-14 08:47:13 +02:00
ater49 6852887180
Update aping.py
Just fixing a typo
2019-10-14 08:42:29 +02:00
Marc Hoersken 1f4a475f48 Remove unused MISPFileCache from PyMISP class 2019-10-12 17:44:55 +02:00
Raphaël Vinot 82abf4c801 fix: Remove overwrite of remote_describe_types 2019-10-12 16:48:44 +02:00
Raphaël Vinot c7e8896864 chg: Bump version 2019-10-10 23:53:28 +02:00
Raphaël Vinot cc204475ff chg: Test if json exists in cached method 2019-10-10 18:33:55 +02:00
Raphaël Vinot 6cc7730d24 chg: Decode datetime without dateutils if possible 2019-10-10 18:27:47 +02:00
Raphaël Vinot 2785d0027d fix: [Python2] Use LRU cache decorator, fix call to describe_types in PyMISP 2019-10-10 10:15:23 +02:00
Raphaël Vinot 7c42a5f748 fix: Python2 SyntaxError... 2019-10-10 08:58:06 +02:00
Raphaël Vinot 02659a5782 chg: Add support for rapidjson, refactoring and code cleanup. 2019-10-09 16:07:40 +02:00
Raphaël Vinot 898bc96ea6 chg: Cleanups 2019-10-08 16:06:28 +02:00
Raphaël Vinot f312f87072 fix: Objects helpers were broken, do not overwrite describe_types 2019-10-08 09:28:33 +02:00
Raphaël Vinot 3bb220c94b chg: Cleanups and improvements 2019-10-08 08:15:56 +02:00
Raphaël Vinot f322e479cd fix: Support for legacy python versions
90 days and counting, folks.
2019-10-07 04:00:11 -06:00
Raphaël Vinot f9118f8c85 Merge branch 'mback2k-template-cache' into perf 2019-10-07 03:53:50 -06:00
Raphaël Vinot 6303c6c6a9 Merge branch 'template-cache' of https://github.com/mback2k/PyMISP into mback2k-template-cache 2019-10-06 13:08:39 -06:00
Marc Hoersken 4be029a0f6 Use classmethod instead of staticmethod and avoid hard-coded reference 2019-10-04 08:55:55 +02:00
Raphaël Vinot bae942d2ec fix: Cache object templates at AbstractMISP level
Related #468 and  #471
2019-10-03 13:54:43 -07:00
Raphaël Vinot 6c1f988b13 fix: Cache describeTypes at AbstractMISP level. 2019-10-03 13:23:00 -07:00
Marc Hoersken e05c7d9b4f Cache JSON definitions in memory LFU cache provided by cachetools
- Path and modified time of JSON file are used as the cache key
- Global state is hidden away inside a root-class for re-use
- Maximum size is 150 considering the number of JSON definitions

During my tests the memory usage of the test suites was halved.
2019-10-03 19:30:57 +02:00
Raphaël Vinot a2b66e943b fix: Big speed improvment when loading MISPEvent
1. `properties` is a list comprehension
2. Massively reduce the amount of calls to `properties`
2019-10-02 22:45:12 -07:00
Christophe Vandeplas 952c320b72 chg: [types] updated to the latest version
now using the gen_misp_types_categories using jq
2019-10-02 09:51:24 +02:00
Alexandre Dulaunoy de6a64ba45
chg: [describeTypes] updated to the latest version 2019-10-01 19:51:54 +02:00
Raphaël Vinot f50632579c Merge branch 'master' of github.com:MISP/PyMISP 2019-09-28 14:34:15 -06:00
Raphaël Vinot 629fd14310 chg: Add missing return formats in restsearch, bump objects 2019-09-28 14:33:38 -06:00
Antoine Cailliau 8d81f318cd Adds support to add local tags.
Requires https://github.com/MISP/MISP/pull/5215 to be merged first.
2019-09-26 10:26:59 +02:00
Alexandre Dulaunoy 1e0016cafa
chg: [misp-objects] updated to the latest version 2019-09-19 14:33:01 +02:00
Raphaël Vinot 7324ae72e6 new: Better handling of delete(d) attributes
* Hard delete on attribute
* Get the deleted attributes within an event
2019-09-13 16:12:45 +02:00
Raphaël Vinot a6dae9467b chg: Use default for warnings
fix: #453
2019-09-13 14:32:48 +02:00
Raphaël Vinot b800dcb4b4 chg: Dump dependencies, update tests 2019-09-11 14:20:55 +02:00
Raphaël Vinot 7912df8f37 fix: Python 2.7 support
I want a cookie.
2019-09-04 14:35:02 +02:00
Raphaël Vinot 9df636cd37 chg: Update upload malware/attachment example script
Fix #447

Make data at attibute level more generic with getter/setter methods
2019-09-04 13:59:25 +02:00
Raphaël Vinot daca32db36 fix: Event delegation was incorrect 2019-08-30 14:19:52 +02:00
Raphaël Vinot 1b2328d485 chg: Bump version 2019-08-30 11:50:36 +02:00
Raphaël Vinot 7bf6005576 new: [Community] Request access 2019-08-30 11:45:56 +02:00
Raphaël Vinot 7402e1b3b6 new: Initial support for communities 2019-08-29 18:08:53 +02:00
Raphaël Vinot a5d4910c1f new: Contact event reporter 2019-08-28 16:02:26 +02:00
Raphaël Vinot cebdc2ef3f fix: Automatically skip empty string in add_attribute at object level
Fix #439

Re-enable test cases.
2019-08-28 14:46:02 +02:00
Raphaël Vinot f0c103b73c chg: Bump misp-objects 2019-08-27 14:03:03 +02:00
Raphaël Vinot f133cb9477 chg: Re-enable a few test cases 2019-08-27 10:43:58 +02:00
Raphaël Vinot bfd57e7741 chg: [tests] Check the type of the response 2019-08-26 20:18:12 +02:00
Raphaël Vinot 0b7314c474 new: Delegate Event
And more test cases
2019-08-26 16:24:48 +02:00
Raphaël Vinot e95948bcf6 chg: Better handling of sightings. 2019-08-20 15:34:21 +02:00
Raphaël Vinot cbf3039735 chg: Bump version 2019-08-16 17:01:34 +02:00
Raphaël Vinot 85643da9ae fix: Fallback to propose attribute update. 2019-08-16 11:44:32 +02:00
Raphaël Vinot 2e84dd69fc chg: Update and improve live testing 2019-08-16 10:48:06 +02:00
Raphaël Vinot 2d37c68bd7 chg: Add tests cases for sync, bump describeTypes 2019-08-12 14:12:40 +02:00