Commit Graph

53 Commits (e3bb9d3a4204ca00931e3f77afc318aaf292382e)

Author SHA1 Message Date
Cristian Bell e3bb9d3a42 fix: missing new TLDs in free text import, solves #1149 (#1574)
* fix: missing new TLDs in free text import, solves #1149
2016-09-27 15:53:43 +02:00
Andreas Ziegler 25e52a6786 chg: remove some references to variables 2016-09-15 17:08:58 +02:00
Andreas Ziegler 30fb4e2b2e chg: remove whitespace at end of line 2016-08-22 02:54:51 +02:00
iglocska 05fea819c2 fix: Some cleanup in the freetext tool 2016-08-08 17:32:01 +02:00
Iglocska fc9c0dcfe5 fix: Aligned freetext import with the changes to the attribute resolution 2016-07-26 11:42:38 +02:00
Iglocska 09ea3ab828 fix: Fix virustotal detection for the freetext import tool, fixes #1373
- regex currently looks for https://www.virustotal.com, but https://virustotal.com is also valid
2016-07-19 11:29:23 +02:00
Andras Iklody 5bd341b450 Merge pull request #1230 from rotanid/bugfix2
fix: brace ordering
2016-06-06 17:32:31 +02:00
Andras Iklody 25833a48fb Merge pull request #1233 from rotanid/cleanup-variables
chg: remove obsolete variables
2016-06-06 17:31:45 +02:00
Andreas Ziegler 44b7e93df6 chg: remove obsolete variables 2016-06-06 17:19:46 +02:00
Andreas Ziegler 81709b4395 fix: brace ordering 2016-06-06 16:43:25 +02:00
Andreas Ziegler f1c79ed4a6 fix: dont override type variable 2016-06-06 16:42:16 +02:00
Andreas Ziegler 57c1a71066 fix: case-sensitive functions calls 2016-06-06 16:32:56 +02:00
Andreas Ziegler c1eda1e04b remove single spaces after tabs 2016-06-04 01:54:19 +02:00
Andreas Ziegler 0fe692c56a remove whitespace at end of line 2016-06-04 01:10:45 +02:00
Andreas Ziegler 898ea1d97c remove whitespace (space/tab) from empty lines 2016-06-04 01:08:16 +02:00
Andreas Ziegler 7ae4c37f0b progressive removal of commented out if-statements 2016-05-20 00:48:54 +02:00
Iglocska 163f86ce35 Fix to an invalid check 2016-04-22 21:50:05 +02:00
Iglocska 1accaa2fee Small tune to the freetext import
- url vs filename differentiation still being a headache
- will need a more thorough look
2016-04-22 16:40:13 +02:00
Iglocska 681e8b5f72 Fixed the IDS flag default setting for freetext-imported virus total links 2016-04-20 17:02:46 +02:00
Iglocska 47e5d382ff Fixed several invalid detections in the freetext import tool
- Composite filename|hash types were incorrectly detected as hash types
2016-04-20 10:55:56 +02:00
Iglocska 4d57149e75 Freetext import tuning
- refanging of various . notations
2016-04-20 10:04:36 +02:00
Iglocska e826f98163 Fix to an issue with the freetext import tool
- Due to a typo 64 character long hashes could not be correctly added via the freetext import tool
- Should be fixed now.
2016-04-12 08:55:32 +02:00
Iglocska b3af1d0463 Some refactoring of the freetext tool 2016-03-29 23:03:01 +02:00
Iglocska 18ce6872d4 Handling of the "freetext" return format via the enrichment modules, and error handling fixed
- freetext is now a valid return format, it will allow module developers to return an unparsed text blob which MISP will try to loop through the freetext import's detection mechanism
- still a lot of improvements to be done for the detection mechanism

- error handling for modules, instead of discarding errors they are now shown as a flash message on the freetext import result screen
2016-03-29 20:05:50 +02:00
Iglocska 9f5cb88aca Correctly detect e-mail addresses in the freetext import tool 2016-03-11 16:02:38 +01:00
Iglocska c2c41b04d3 Fixed an issue with the freetext import
- url detection would detect any word with a trailing "." as a valid url
  - google. was detected as a url
- this also caused training "."s to be included in valid urls
  - http://www.google.com.
2016-01-23 20:19:44 +01:00
Iglocska 427da7d579 Removed lowercasing of parsed strings in the freetext import
- case sensitive values also got lower-cased
2016-01-18 15:24:48 +01:00
Iglocska b40e0fdc7c Merge branch 'master' into 2.4-syncrework
Conflicts:
	VERSION.json
	app/Controller/AttributesController.php
	app/Controller/ShadowAttributesController.php
	app/Lib/Tools/ComplexTypeTool.php
	app/Model/Attribute.php
	app/View/Pages/administration.ctp
2015-12-09 02:00:23 +01:00
iglocska fbd97df3ac Several fixes, among others fixes #748
- Double sanitisation when edditing an attribute/proposal comment removed
- Fixed an issue where an ip/resource was recognised as a CIDR notation IP range instead of a url
- Changed the flash message for publishing without e-mails to something less scary
2015-12-08 15:12:13 +01:00
iglocska 65faeb48d9 Further tweaks
- fixed some corner cases
- added support for the same defanging to the freetext import tool
2015-12-04 11:33:14 +01:00
iglocska 744cf50fb9 Update to attribute validation and the freetext import tool, fixes #742
- defanged URL type attributes are refanged on input
- admin script to do the same for all existing attributes

- admin tool doesn't recognise a word followed by a . as a url
2015-12-04 10:43:38 +01:00
iglocska 97f6da18da Added file as an option when a url like google.com is recognised 2015-11-22 17:50:22 +01:00
Iglocska 704880ce59 Merge branch 'master' into feature/sg
Conflicts:
	VERSION.json
	app/Controller/AttributesController.php
	app/Controller/EventsController.php
	app/Model/Attribute.php
	app/Model/Event.php
	app/Model/Server.php
2015-08-30 13:29:05 +02:00
Iglocska 5273c2c5aa New functionality: API to download sample by hash
- simply pass an MD5 hash along and receive a sample if available zipped and base64 encoded in a response object
- pass any hash along with a flag set and receive any samples from events that have the passed hash

- Also, fix for an issue with the freetext import not using semi-colons as separators
2015-08-07 12:04:44 +02:00
Iglocska 1bf2995f4e Merge branch 'master' into feature/sg
Conflicts:
	VERSION.json
2015-07-22 17:19:13 +02:00
Iglocska 1da5b71011 Some work on the new types 2015-07-16 09:18:21 +02:00
Iglocska 2438ec2f35 Some tuning to the hostname / url type recognition in the freetext import tool, fixes #562 2015-07-09 10:56:17 +02:00
Iglocska 3d2b8c3c10 Added pub/sub feature using ZeroMQ, fixes #540 and fixes #526
- by installing the requirements described in the update and the install instructions (ubuntu only for now, centos/red-hat versions to be tested and described), administrators can enable the pub/sub feature
- assign a port to the service via the interface
- each time an event is published, MISP will use ZMQ's PUB feature to push out a MISP JSON package using the "misp_json" prefix
2015-06-24 17:38:15 +02:00
Iglocska 0e09319eae Tuning of the complex type tool 2015-06-22 14:11:43 +02:00
iglocska a0afab66a7 Various changes and bug fixes
- contact reporter first tries to contact orgc users on the instance, if they don't exist, it will contact the owner (instead of going straight to the owner)
- hostname / domain name validation change broke validation of hostnames/domain names / email addresses with a "-"
- Some documentation changes for the REST API (more coming)
- some tuning of the freetext import
2015-06-18 14:49:25 +02:00
Iglocska 197e6a69cc Free text import tool tuning, fixes #510
- comma separated values now correctly parsed
- Ports in IP/url/link/domain/hostname now added as a comment
- virustotal now automatically recognised as external analysis / link
2015-06-02 12:02:07 +02:00
iglocska 2fd600b44a Left of tuning of complex type tool in previous commit
- also, appcontroller now loads the security component, so that the blackhole override doesn't produce errors
2015-05-27 19:10:14 +02:00
iglocska 5559536bf1 Freetext import tool now splits the input by line break and whitespace, fixes #502 2015-05-24 10:09:41 +02:00
iglocska 6e7554a26f Freetext import tool enhancement
- mass edit types where applicable
- ip-src/ip-dst type will create two attributes, one for each
2014-12-10 13:06:52 +01:00
iglocska dcc028516d Further improvements to the freetext regex to remove unprintable chars 2014-10-14 14:29:06 +02:00
iglocska 53d295868f Remove non printable characters from free text import 2014-10-14 10:59:12 +02:00
iglocska c7ec328fcf Better split on linebreaks for the freetext import 2014-10-13 17:43:31 +02:00
iglocska caeba7fb91 CIDR now recognised by freetext import 2014-10-13 09:16:09 +02:00
iglocska 9813a3cfaa Added CVE to the freetext tool 2014-08-20 15:34:42 +02:00
iglocska 893ef5a129 Freetext import tool
Added freetext import tool
2014-07-10 17:02:19 +02:00