Commit Graph

117 Commits (a61caa3a6a541e6f9761ae99c033c7457050bc0b)

Author SHA1 Message Date
iglocska 68b8266584 new: New flash message system, fixes #3252
- 3 types of flash messages (success, error, warning)
- uses bootstrap's own classes/structure
2018-05-16 19:32:38 +02:00
iglocska ffcecbf3cc fix: Fixed editing feeds via the UI 2018-04-24 10:44:02 +02:00
iglocska 4022285e06 new: Added Feed management API
- add/edit/delete feeds via the API
- new APIs are RestResponseComponent aware
- GET on add/edit to receive usage information
2018-04-23 14:57:59 +02:00
iglocska 2495dc8b38 chg: Renamed the cachefeeds console command to cachefeed for consistency's sake 2018-04-16 07:58:32 +02:00
iglocska e89d7ebc16 new: Added separation between enabled feeds and feeds enabled for caching 2018-03-30 23:30:54 +02:00
iglocska fd858d627b new: Allow passing headers along with feeds
- add any arbitrary header to a feed
- can be used for authentication via basic auth for example
2018-01-19 00:28:44 +01:00
Andras Iklody 04c89499a2
Merge pull request #2422 from panzertime/add-button-fetch-all-feeds
Added a button to fetch all enabled feeds
2018-01-16 12:52:06 +01:00
iglocska dedfea3610 new: Mass enable/disable feeds
- protecting the sanity of MISP admins since 2012!
2018-01-15 17:25:11 +01:00
iglocska 56dc5ea3bc fix: Better error handling when previewing csv/freetext feeds if no valid data is returned 2018-01-13 15:36:27 +01:00
iglocska 995a1c700e fix: Better handling of something going wrong whilst fetching a MISP feed's manifest 2018-01-13 15:33:00 +01:00
iglocska 4f6dba5f35 new: various improvements
- use the feed uuid caches to link directly to affected MISP events
- various UI improvements
- Feed preview pagination / POSTed event ID filters added
2017-12-05 00:05:11 +01:00
Andras Iklody 5157141425 fix: Change 2/2 for fixing the feed scheduler fixes #2503
As described by @lucamemini
2017-10-23 18:07:14 +02:00
RT Hatfield 9d38ca0c97 Added a "fetch all" button to the feeds page 2017-08-25 16:04:20 -04:00
iglocska 1dc58939f9 new: Exposed Feed previews to the API
- The following can now be fetched via the API (requires site admin access):
  CSV, Freetext, MISP feeds: /feeds/previewEvent/[feed_id]
  MISP feeds: /feeds/previewIndex/[feed_id]/[event_uuid]
2017-08-10 14:02:52 +02:00
iglocska 6c7c40e773 fix: Further performance tweaks to the feed fetcher 2017-07-07 12:58:51 +02:00
iglocska d42d290136 fix: Return json dict instead of string when queuing a feed pull job 2017-07-07 10:11:40 +02:00
iglocska 65c4c11c58 fix: Allow triggering the fetch feed from the API 2017-06-19 16:46:03 +02:00
iglocska 0b9d55c7b5 fix: Fixed invalid looping to pick up feed correlation event info fields 2017-06-12 09:51:04 +02:00
iglocska 7321e26151 chg: Added event info in feed correlations via a popover 2017-05-31 10:07:29 +02:00
iglocska 9f8954999a new: Auto load the default feeds from file 2017-05-30 11:42:57 +02:00
iglocska e18344b3f5 fix: several fixes to the feed overlay matrix
- lookup was broken for csv/freetext feeds
- allow users to see the feeds if the admin allows it
2017-05-09 16:35:59 +02:00
iglocska 96574ec335 new: First implementation of the feed analysis system 2017-05-08 14:22:27 +02:00
iglocska d212266984 fix: Fixed an issue that prevented a feed to be convertable between types 2017-01-25 05:59:22 +01:00
iglocska b2f008d5ce new: Added the option to delete files after ingestion of local feed 2017-01-25 05:53:04 +01:00
iglocska aba2491344 new: Local feeds
- still needs testing
2017-01-24 14:07:55 +01:00
iglocska 26df6d3fe5 new: Added a new field for an exclude regex for the CSV / Freetext feeds
- just set a php compatible PCRE regex pattern to exclude values
2017-01-01 16:25:08 +01:00
iglocska b40791e8b0 fix: fixed a copy paste bug and the default feed index scope
- defaults to all feeds now
2017-01-01 13:01:12 +01:00
iglocska df85d488d2 chg: Changed the feed cache locations 2017-01-01 12:52:17 +01:00
iglocska 2aad201f26 fix: Setting naming consistency fail
- separator != delimiter
2016-12-31 22:22:58 +01:00
iglocska 998294690f fix: Fixed some minor issues with the feed import 2016-12-31 09:52:12 +01:00
iglocska 53dad99e67 new: Added feed metadata download link 2016-12-31 09:46:03 +01:00
iglocska 12b904da13 fix: Added rest response to the importFeeds method 2016-12-31 09:13:34 +01:00
iglocska 76e9398df9 new: Various new feed features
- import feed descriptor json pastes to add a list of pre-defined feeds
- improvements to the feed pull (a single non validating attribute shouldn't break the process)
- altered the saving of the attributes to happen in chunks during a feed pull to avoid very large feeds from stalling the process
- split the feeds into 3 tabs: default, custom, all
2016-12-31 09:04:46 +01:00
iglocska 7f8a81e161 new: Added caching and pagination to freetext/csv feeds 2016-12-30 16:16:56 +01:00
iglocska 6ca728a674 chg: View the feed index via the API (to easily extract / share the settings) 2016-12-26 14:41:24 +01:00
Iglocska b1ab540f4f fix: Fixed an issue with editing MISP feeds, fixes #1664 2016-11-12 04:19:23 +01:00
Iglocska 9cc05a14e3 fix: Better fix than the previous one 2016-10-24 02:41:08 +02:00
Iglocska 7f0bc3a207 fix: Fixed a potential empty event_id field that blocked new CSV feeds from being added 2016-10-24 02:06:08 +02:00
Iglocska 1d5e1b3613 fix: Fixed an inverse lookup 2016-10-17 13:43:25 +02:00
Iglocska a03c339c5a fix: Fixed an issue with editing feeds 2016-10-14 11:01:49 +02:00
Iglocska 2f1b600bf2 fix: fixed an issue where a validation fail would only semi-populate the feed add form fields 2016-10-11 15:07:53 +02:00
Iglocska 9082e9b090 fix: fixed various minor issues and a potential more serious bug
- various UI issues prevented the freetext/csv feed related fields from being hidden when adding a new MISP feed
- issue that potentially prevented new feeds from being saved if no target event is set (cannot reproduce)
2016-10-10 18:23:59 +02:00
Iglocska 9891234662 new: CSV feeds and various fixes
- Added the CSV feed format
  - users can specify which fields in the CSV should be parsed
  - comment lines are automatically omitted
  - new settings system added to feeds, currently only used for the value fields

- Slight rework of the correlation lookup for the feeds
  - got the Speed Force treatment
  - correctly checks against value1 and value2 instead of value

- Various freetext import fixes
2016-10-08 14:36:24 +02:00
Iglocska 09d3720187 new: Added correlations to the freetext feed preview 2016-10-08 10:25:30 +02:00
Iglocska 9d4403ff3e fix: Resolved several issues with error handling in the new feed system 2016-10-07 20:08:57 +02:00
Iglocska 9649c608b4 fix: Various fixes to the feed system
- allow users to override the IDS flags and keep all attributes pulled from a freetext feed IDS = off
- UI changes
- fix to a bug that caused already deleted attributes to be counted as existing ones
2016-10-07 18:27:13 +02:00
Iglocska a6cb34e4a3 fix: Added missing initialisation of the synctool 2016-10-07 17:36:46 +02:00
Iglocska 503661a240 new: First implementation of the freetext feed pull 2016-10-07 17:33:54 +02:00
iglocska 822b0bf8fa chg: Cleanup of the controllers and models
- removed incorrect, useless boiler plate comments
- kept useful comments intact
- added some missing line breaks to make the codebase a bit more uniform
- removed some obviously obsolete TODO comments
2016-08-25 11:38:37 +02:00
iglocska 7b6604de5b chg: Added the tracking to all queued jobs 2016-08-15 16:30:37 +02:00
Andreas Ziegler 1d06f25b38 chg: add newline character before EOF to non-minified (text-)files 2016-06-06 10:09:55 +02:00
Andreas Ziegler 7cadf8340c remove space after unset before opening brace 2016-06-04 15:45:57 +02:00
Andreas Ziegler 0fe692c56a remove whitespace at end of line 2016-06-04 01:10:45 +02:00
Andreas Ziegler 898ea1d97c remove whitespace (space/tab) from empty lines 2016-06-04 01:08:16 +02:00
Iglocska f08ec04426 new: Enable/disable feed via API
- simply POST to /feeds/enable/feed_id or /feeds/disable/feed_id to enable and disable a feed
2016-05-26 01:39:31 +02:00
Iglocska 5d86ea11be Feed didn't respect the enabled flag
- if a feed was disabled a site admin could still pull the contents
2016-03-09 02:44:01 +01:00
Iglocska 79e41da383 First version of Feed system ready
- tied into background processes
2016-03-09 02:31:55 +01:00
Iglocska 8e8de0d258 Added default feeds 2016-03-09 01:34:02 +01:00
Iglocska 3845c7442a Correctly assign tag / sharing group to event fetched from feed 2016-03-09 00:44:09 +01:00
Iglocska fe3a94d3d1 New fields added
- set the distribution and sharing group of a feed
  - will set all events received to the appropriate setting

- set a tag that should be applied by default to the events received from the feed
2016-03-08 23:27:53 +01:00
Iglocska f767ddaec6 Added downloading of an event from the index, better error handling 2016-03-07 03:26:55 +01:00
Iglocska 7a20704f36 Preview Event implemented 2016-03-07 02:23:37 +01:00
Iglocska 03e19f6db0 Preview the index of a feed 2016-03-06 23:24:03 +01:00
Iglocska e176540bd3 Merge branch '2.4' into feature/feeds
Conflicts:
	app/Model/Attribute.php
2016-03-05 23:24:01 +01:00
Iglocska bebdde03e7 Further progress 2016-03-04 14:56:56 +01:00
Iglocska 255c65942e Further progress on the feeds 2016-02-29 22:32:04 +01:00
Iglocska 9cb796b394 Work in progress on the feeds 2016-02-28 22:54:09 +01:00