Commit Graph

106 Commits (f86ad11bd1471a7d19c192ab79dc957d50ce7e5c)

Author SHA1 Message Date
Golbark 3a0bedb104 chg: [internal] Using Allowedlist instead of Whitelist 2020-09-01 16:28:20 +02:00
Vito Piserchia 850034ecc0 recover from upstream version missing bits 2020-08-17 17:57:30 +02:00
Vito Piserchia 7da8b32ada rebase continue 2020-08-17 17:25:02 +02:00
Jakub Onderka 1714c086b6 fix: [cli] Show error when invalid user ID provided 2020-08-12 18:32:12 +02:00
Jakub Onderka e4b061c744 fix: [security] Respect ACL for freetext import 2020-08-05 17:37:05 +02:00
mokaddem ff7ef393c5
fix: [EventShell:enrichment] Improved reporting of error messages 2020-06-05 07:46:46 +02:00
iglocska 5a29964924
chg: [cleanup] Taking out the trash
- old unused functions removed
2020-02-10 16:10:55 +01:00
iglocska af881189e5
new: [config load task] Added a task that will reload the settings on any console shell execution, fixes #5498
- helps with background workers being forced to fetch new settings whenever they start a new job
2020-02-10 15:15:59 +01:00
iglocska 46c3968755
fix: [internal] cleanup of unused line 2020-01-31 11:46:32 +01:00
iglocska 4806652448
fix: [API] several fixes to the Bro API
- always use flatten:1 to also include object attributes
- fix the generated full export to only include the header once
2020-01-31 11:45:23 +01:00
Richard van den Berg dd963c2e21 Sync sightings on push, pull and push on add 2019-11-22 21:53:51 +01:00
Jakub Onderka 4db9553f16
fix: [iternal] Remove unused method EventShell::__recursiveEcho 2019-10-06 21:06:06 +02:00
Bechkalo Evgeny 9cf2ef3a46 fix: more issues with PostgreSQL
- fixed error during update Job date_modified field (SQLSTATE[22008]:
Datetime field overflow: 7 ERROR:  date/time field value out of range)
- fixed error during fetching events while updating from feeds (
SQLSTATE[42P01]: Undefined table: 7 ERROR: missing FROM-clause entry for
table events)
- fixed Feed edit view with wrong boolean forms (combobox instead
checkbox)
2019-08-29 18:36:47 +03:00
chrisr3d 7b4c09a249
wip: [enrichment] Capturing objects & attributes 2019-04-08 19:07:13 +02:00
chrisr3d d13d898f7a
fix: [cleanup] Fixed indentations 2019-04-08 18:57:41 +02:00
iglocska 435bf28df6 fix: [publishing] Fixed several bugs in the background job responsible for publishing events 2018-12-19 15:55:06 +01:00
Kevin 9446c93ad4 Fixes #3907, enrich event job not marked as completed.
The enrichment background process did not do anything to update the job
after completing its task.  I used the same logic as the adjcacent
'publish' function to record progress, update the message and create a
log entry.
2018-12-17 13:55:59 -05:00
iglocska e592bb80ca new: [exports] New export system using restsearch 2018-10-05 14:48:02 +02:00
iglocska 9d83c840ec new: [freetext] Freetext ingestion is now delegated to the background processing
- no setup needed
- data to be ingested dropped to file, background worker ingests and processes the file
2018-09-23 17:44:23 +02:00
iglocska 3b2927a47f fix: [cleanup] removed debug, fixes #3257 2018-05-19 22:53:16 +02:00
iglocska 2af8bfec4e new: Added event enrichment functionality
- select and run a set of enrichments on all applicable attributes of the event
- exposed to the API
- exposed to the command line tool
- adheres to attribute distributions
2018-04-24 16:41:09 +02:00
StefanKelm 8692e7457a
Update EventShell.php 2018-04-04 12:26:12 +02:00
arnydo 20ff380e17 move ns_alt parameter to end of api list 2017-09-21 11:11:30 -04:00
Kyle Parrish c5d3ae7b1f RPZExport - Alternate NS
Added option to add an alternate nameserver to RPZ export.
2017-09-19 13:25:17 -04:00
iglocska 3b6807ef72 new: Rework of the restsearch APIs
- allows for alternate download types (supported for now: openioc)
- major refactor of the openioc export
- refactor of the CIDR tool
2017-03-31 19:27:34 +02:00
Richard van den Berg b7c8ea0ff5 Truncate bro cached export files 2017-01-23 13:32:06 +01:00
iglocska c14869a35b fix: Changed bro cached export to the .intel extension 2016-12-21 19:10:55 +01:00
Liviu Valsan 4c022beafc - Performance improvements when exporting a large number of attributes into Bro format.
- Fixed file header formatting for the export to Bro format (tabs used consistently).
- Computing the time needed for generating the export to Bro format when done using a background job.
- When generating the Bro export from the UI all the attributes are generated in one single text file similar to the CSV export instead of a zip file with different files inside.
- Changed the file extension of Bro export files from ".intel" to ".txt".
- Removed the allowNonIDS option from the Bro export as it doesn’t make sense to have it (Bro is an IDS).
- Fixed some of the API endpoints which were not accepted (ACL issues).
- Added support for a list of events that should be / should not be included in the export.
- Added a new "meta.desc" column (added in Bro 2.5, see https://www.bro.org/sphinx/frameworks/intel.html) containing the description of the event and of the attribute.
- Sanitized the exported data for Bro.
- Fixed a number of value substitutions which were imported from Snort/Suricata and which were not working for Bro. Did instead substitutions needed for Bro.
2016-12-07 16:33:17 +01:00
Iglocska d9bac88c73 fix: Attempted fix for an issue with large stix exports getting truncated 2016-11-01 17:57:56 +01:00
Richard van den Berg 87ac5f9f5a Fix indication of new attributes in E-mail alerts, fixes #1521 2016-10-02 14:46:51 +02:00
Iglocska cb956221b6 fix: Remove the temp directory after generating the bro cache 2016-09-16 16:53:58 +02:00
Iglocska 6d822ee45e fix: Refactor of the bro export to always create a zip archive with separate files if "all" types are queried 2016-09-16 16:49:54 +02:00
Iglocska 2cede15e68 Merge branch '2.4' into feature/bro-export
Conflicts:
	app/Model/Event.php
2016-09-15 18:00:25 +02:00
Iglocska 59ecf40f42 chg: Refactor of the Bro export 2016-09-15 17:44:59 +02:00
Iglocska 14b82c9277 fix: revert to the old functionality of the stix export where the data is passed back from the internal stix method, fixes #1509 2016-09-05 23:48:35 +02:00
ppanero 131e2f760a bro export funtionality 2016-08-29 17:26:14 +02:00
iglocska 3c424856bd fix: Fixed an invalid log entry breaking the publishing process 2016-08-28 22:31:26 +02:00
iglocska 734df04000 new: New piece by piece stix export allowing large datasets to be exported 2016-08-23 00:24:54 +02:00
iglocska 1ee2988ca6 fix: Refactoring of the STIX export
- Also adding it to the caching mechanism
- still WIP
2016-08-21 22:57:11 +02:00
iglocska e867a47569 Merge branch '2.4' of https://github.com/MISP/MISP into 2.4 2016-08-17 09:44:37 +02:00
iglocska c1cdb3b461 Fix: cleaner input for caching jobs 2016-08-17 09:43:57 +02:00
Richard van den Berg c77cd7eb7a fix: overwrite cached json exports, fixes #1439 2016-08-16 14:49:52 +02:00
Iglocska 1b73e38621 fix: Some fixes to the caching
- invalid linebreaks used for the hids caching
- added sha256 to the hids caches
2016-07-31 22:56:19 +02:00
Iglocska 37c9abfb7c fix: Added progress bar to JSON cache generation 2016-07-30 19:00:02 +02:00
Iglocska 47c6feab4d fix: Various fixes to the cached exports
- Tightened the rules for export generation when no valid published events exist
- Corrected various issues with the progress bars
- Added the missing JSON export to the caches
- XML/JSON caches now correctly take into account the cached attachent inclusion setting
- MISP will now show the users browsing the export page whether attachments will be cached with the current settings or not
- Added correct progress bar to the HIDS export
2016-07-30 18:08:19 +02:00
Cristian Bell 0cdcb23ca6 chg: adding job duration to the "Job done." text. 2016-07-01 14:52:02 +02:00
Cristian Bell 6e62a3b662 Email jobs do not update the date modified once completed. 2016-06-30 16:16:16 +02:00
Cristian Bell 74e6f9873d issue 1289 - Cache jobs do not update the date modified once completed.
I also added this to the contactemail(), publish(), postsemail() and alertemail(). But it's commented out as it's not part of the issue. I can commit it again w/ the lines uncommented.
2016-06-29 22:46:48 +02:00
Andreas Ziegler 985451642e add space after keywords if/for/foreach/while/switch/catch 2016-06-04 15:45:39 +02:00
Andreas Ziegler 0fe692c56a remove whitespace at end of line 2016-06-04 01:10:45 +02:00