CIRCL
/
AIL-framework
mirror of https://github.com/CIRCL/AIL-framework
2
1
Fork 0
Code Issues Releases Wiki Activity
2,577 Commits
6 Branches
43 Tags
110 MiB
Commit Graph

1468 Commits (d1608e89e13a4a1df8e83f2c87d941de3147a5f3)

Author SHA1 Message Date
Terrtia 529a24c191
chg: [module extrator] add debug 2023-08-08 10:40:44 +02:00
Terrtia bd7aa979bd
chg: [module extrator] add debug 2023-08-08 10:36:58 +02:00
Terrtia 2691000d0c
chg: [telegram fedeer] use meta of the new feeder 2023-08-02 15:49:12 +02:00
Terrtia 14a76a91d9
fix: [tags ui] fix galaxy, get number of tags enabled + add toolip helper 2023-08-01 11:07:06 +02:00
Terrtia 1aa0bd8a0e
fix: [settings] fix edit user 2023-07-31 16:25:28 +02:00
Terrtia 64252ddf75
fix: [Tracker] edit tracker filters 2023-07-31 16:00:31 +02:00
Terrtia 4eb5b4c4b9
fix: [MailExporter] improve logs + SMTP over SSL: add an option to validate self signed CA 
This exporter use STARTTLS by defaults. If the SMTP server does not support the STARTTLS extension, the client will switch to SSL instead.
 2023-07-28 11:10:21 +02:00
Terrtia 68dffcd26b
chg: [api crawler] fix response + add cookiejar, proxy and frequency parameters 2023-07-25 15:57:11 +02:00
Terrtia fe2769308b
fix: [crawler] fix down domain + domain redirection history 2023-07-18 14:30:00 +02:00
Terrtia 77e8cc6c02
Merge branch 'master' of github.com:ail-project/ail-framework 2023-07-17 15:47:32 +02:00
Terrtia a9485928db
chg: [HHHash] add HHHash object and correlation https://www.foo.be/2023/07/HTTP-Headers-Hashing_HHHash 2023-07-17 15:47:17 +02:00
fukusuket 22dff19004 fix: [domain search] returns an empty string when searched with invalid characters 2023-07-14 18:28:34 +09:00
Terrtia 780b4f9f9c
fix: [background update] fix logger 2023-07-12 14:37:59 +02:00
Terrtia 73bfe614df
chg: [updater] refactor background updater + add v5.2 update 2023-07-12 11:36:47 +02:00
Terrtia 28c647d370
chg: [crawler har] compress HAR 2023-07-10 15:56:34 +02:00
Terrtia c719990125
fix: [crawler] add timeout to Unknown captures 2023-07-10 11:23:44 +02:00
Thirion Aurélien 8f0e7f1434
Merge pull request #174 from fukusuket/fix-500-erro-when-invalid-lacus-url 
fix: [crawler] add exception handing for `ping_lacus`
 2023-07-10 10:05:20 +02:00
fukusuket fcd6a98fb0 fix: [crawler] added existence check for screenshot set 2023-07-09 12:50:13 +09:00
fukusuket e35924ec22 fix: [crawler] add exception handing for ping_lacus 2023-07-08 12:11:25 +09:00
Terrtia 482fc21b5e
chg: [correlation] correlation graph, add an option to hide an object/node by pressing H + reset correlation graph 2023-07-07 16:29:32 +02:00
Terrtia 450ebdd789
chg: [etag] add new etag object 2023-07-06 11:26:32 +02:00
Terrtia 35f678245f
fix: [decoded] fix download file 2023-06-30 16:22:30 +02:00
Terrtia 0fa0984ec4
fix: [updater] fix db checker 2023-06-30 16:19:38 +02:00
Terrtia fa8b4a67d9
fix: [correlation tags] fix tag all objects 2023-06-29 15:02:57 +02:00
Terrtia 279ec00990
fix: [correlation card decoded meta] mimetype + size 2023-06-29 11:40:57 +02:00
Terrtia fce63d52a0
fix: [updater] remove old ARDB env 2023-06-29 09:07:00 +02:00
Terrtia d6a24c0357
fix: [hunter + misp export] fix misp event json export + retro hunt date search and description 2023-06-29 08:48:50 +02:00
Terrtia b4d536f174
chg: [investigation] add object comment 2023-06-26 16:28:31 +02:00
Terrtia a0686eefcf
fix: [pystemon importer] fix base64 encoding 2023-06-26 11:24:04 +02:00
Terrtia f1f33d6c1b
chg: [pystemon importer] fix gzipped pastes 2023-06-22 16:34:14 +02:00
Terrtia 47e1343187
fix: [crawler] same capture uuid if a domain is already crawled 2023-06-22 16:09:18 +02:00
Terrtia b459498db2
chg: [queues] track object + check if object processed 2023-06-22 15:38:04 +02:00
Terrtia 4567c9d400
chg: [correlation graph] show message if max_nodes reached + fix cookie-name sparkline 2023-06-20 11:23:58 +02:00
Terrtia 501d10bbbd
chg: [crawler] auto tag crawled domains 2023-06-20 08:11:44 +02:00
Terrtia c02b9f2a81
fix: [IPAdress module] empty queue if no IP ranges provided 2023-06-19 15:17:41 +02:00
Terrtia b64c70e0cd
fix: [retro hunt] fix object tag queue + decoded content 2023-06-19 10:53:15 +02:00
Terrtia 6c21a8f8cf
fix: [daterange object] fix objects by date 2023-06-19 08:55:56 +02:00
Terrtia 84bc2c0669
chg: [correlation] add an option to remove max number of nodes if max_node == 0 2023-06-18 16:09:57 +02:00
Terrtia e9539e640b
fix: [crawler] fix incomplete response 2023-06-18 15:09:09 +02:00
Terrtia f8fd037bd2
chg: [object cookie-name] add new cookie-name object + correlation 2023-06-16 15:39:13 +02:00
Terrtia ee76d20277
fix: [user] fix get user token #163 2023-06-14 14:53:07 +02:00
Terrtia b38819fdaa
fix: [user] fix user delete #163 2023-06-14 14:40:01 +02:00
Terrtia d4152462f5
chg: [titles] add title IDs and contents search 2023-06-13 15:29:11 +02:00
Terrtia 94961f2eba
chg: [favicon object] add favicon object 2023-06-12 16:51:45 +02:00
Terrtia 580879ee5c
fix: [MISP export] fix ail object first/last seen + obj logger 2023-06-09 11:19:22 +02:00
Terrtia f540df0ff2
chg: [sow item] show item investigations 2023-06-07 14:17:06 +02:00
Terrtia 70802205f2
fix: [d4] change enable d4 2023-06-07 11:03:32 +02:00
Terrtia 4cd2b6517b
chg: [kvrocks migration] mv update/v.50 2023-06-07 10:33:45 +02:00
Terrtia a22e6f6180
fix: [kvrocks migration] 2023-06-07 10:21:49 +02:00
Terrtia f3c3cb5d05
fix: [objects] fix investigation + ail2ail + screenshot MISP export 2023-06-04 17:34:21 +02:00
Terrtia 62880e3a1c
fix: [show domains] fix down domains 2023-06-02 13:30:59 +02:00
Terrtia 9efc348506
chg: [correlation] filter blank screenshots 2023-06-02 11:23:52 +02:00
Terrtia 7c7799564f
chg: [importers] improve abstract class and logs 2023-06-02 11:03:32 +02:00
Terrtia 50abff66b4
chg: [HOWTO] improve HOWTO 2023-05-30 14:48:06 +02:00
Terrtia 2ebe4845a7
fix: [module extractor] fix tracker extractor 2023-05-30 10:11:12 +02:00
Terrtia 8252d6b69e
fix: [tracker] fix tracker delete 2023-05-26 14:09:12 +02:00
Terrtia 1e7b527e41
fix: [tracker] fix webhook 2023-05-26 13:57:34 +02:00
Terrtia b3cafd2a1d
chg: [correlation graph] update node legend 2023-05-26 11:44:29 +02:00
Terrtia b4f1a43208
chg: [correlation] correlation graph: filter title objects 2023-05-26 10:47:58 +02:00
Terrtia 405d097024
fix: [crawler] fix undefined capture status 2023-05-25 16:26:48 +02:00
Terrtia 9a4feb93a0
fix: [correlation btc info] catch btc txs error 2023-05-25 16:11:55 +02:00
Terrtia ee951ca948
chg: [correlation] add direct correlation stats 2023-05-25 16:00:27 +02:00
Terrtia c008366f02
chg: [new title object] add new title object + correlation on page title 2023-05-25 14:33:12 +02:00
Terrtia f7e0a357ea
fix: [Phone module] Filter Invalid Phone numbers 2023-05-24 13:31:10 +02:00
Terrtia 2c8b239eec
fix: [phone] fix phone module 2023-05-24 13:26:47 +02:00
Terrtia 19f154a81a
fix: [domain search] fix template domain types filter 2023-05-24 11:55:31 +02:00
Terrtia a30cc1539d
fix: [MISP auto export] fix module input message 2023-05-24 11:12:02 +02:00
Terrtia 353b290899
chg: [Phone module] Filter Invalid Phone numbers + UI Show extracted 2023-05-24 10:48:29 +02:00
Terrtia 7a52aec884
fix: [tests] replace unmaintened nose by nose2 2023-05-23 14:47:02 +02:00
Terrtia 94d7eaf11d
fix: [tests] fix tests 2023-05-23 13:38:33 +02:00
Terrtia af719d1d94
chg: [importers] add Dir/File Importer 2023-05-22 15:31:48 +02:00
Terrtia 175963e371
merge master 2023-05-17 16:07:32 +02:00
Terrtia 20fad97d6a
chg: [update] bump version < 5.0 roll back commit 2023-05-17 15:59:52 +02:00
Terrtia 2127b4363f
chg: [kvrocks] add migration notice 2023-05-17 15:46:44 +02:00
Terrtia 5b6a7f15ce
chg: [update] older versions: filter 5.0 updates 2023-05-17 11:40:42 +02:00
Terrtia 88d3870230
chg: [ail] cleanup 2023-05-17 10:26:54 +02:00
Terrtia 5ef29d8abb
chg: [MISP] refactor MISP thehive auto push 2023-05-16 16:34:22 +02:00
Terrtia 5d84b347bc
fix: [cves] fix cve search timeout 2023-05-16 13:28:31 +02:00
Terrtia ed9682798e
chg: [IPAddress module] migrate IPAddress module 2023-05-15 11:39:16 +02:00
Terrtia 7669c16c74
fix: [Onion module] fix kvrocks sismeber 2023-05-15 10:42:46 +02:00
Terrtia 2ae3ffd6d2
fix: [core] fix instance ail:uuid 2023-05-15 10:37:03 +02:00
Terrtia 8ec4370043
fix: [telegram] fix regex 2023-05-15 10:12:58 +02:00
Terrtia 1aa63e8a08
fix: [logger] rename default logger file + fix log messages 2023-05-15 09:51:10 +02:00
Terrtia e365555905
fix: [trackers] fix pgp yara tracker 2023-05-12 15:43:41 +02:00
Terrtia 9b2e8718d7
chg: [logs] add new logger 2023-05-12 15:29:53 +02:00
Terrtia 98cbaad1ad
fix: [cves] catch cve search errors 2023-05-12 09:59:18 +02:00
Terrtia f4d20533cc
chg: [trackers UI] add admin endpoint 2023-05-12 09:25:17 +02:00
Terrtia d4766c5adc
fix: [trackers] fix trackers edit 2023-05-11 16:49:09 +02:00
Terrtia 4473086f89
chg: [trackers] refactor trackers 2023-05-11 16:21:43 +02:00
Terrtia 6b60041db2
chg: [crawler] add unsafe tag if domain contain unsafe screenshot 2023-05-10 16:28:19 +02:00
Terrtia 37c71b8438
chg: [objects + retro hunt] refactor retro hunt + objects retro hunts + get objects generator by filters (date_from, sources, mimetypes, ...) 2023-05-10 16:26:46 +02:00
Terrtia 0daf5bad44
chg: [trackers] refactor trackers: track objects + filter by object types/sources/subtypes 2023-05-04 16:35:56 +02:00
Terrtia 8f65fd5fe7
fix: [search domains] fix search domains by daterange 2023-04-24 13:35:55 +02:00
Terrtia 10fbf228c1
fix: [domain explorer] fix search by daterange 2023-04-24 10:55:58 +02:00
Terrtia 3f8656a835
fix: [api] fix token length 2023-04-21 16:16:10 +02:00
Terrtia e0899e6e0d
chg: [corellation graph] hide unsafe screenshots 2023-04-21 15:38:48 +02:00
Terrtia 6c6a3b48e2
fix: [modules] log level 2023-04-21 14:53:33 +02:00
Terrtia 6338268e8c
fix: [domain UI] fix correlation card + language search 2023-04-21 10:26:14 +02:00
Terrtia 79fa5dc30b
fix: [investigation] fix create investigation 2023-04-20 16:17:54 +02:00
Terrtia 7ed7b4c63e
fix: [module extractor] fix cache + fix yara match 2023-04-20 16:05:58 +02:00
Terrtia 86b1fda59b
fix: [MISP exporter] fix MISP exporter CIRCL/AIL-framework#590 2023-04-20 10:44:17 +02:00
Terrtia ab7b2bdbab
chg: [pystemon importer] create new PystemonImporter module, refactor pystemon feeder 2023-04-14 14:43:07 +02:00
Terrtia ccf935700a
fix: [objects] show/add subtype objects tags 2023-04-14 10:50:58 +02:00
Terrtia 02814e7f81
chg: [UI settings] add ail modules svg + fix admin view 2023-04-13 15:59:44 +02:00
Terrtia 6b5e833fc1
fix: [tracker modulew] fix duplicate module stats 2023-04-13 14:42:57 +02:00
Terrtia 6f9e0c2f66
chg: [AIL queues] rewrite module queues. remove PUBSUB 2023-04-13 14:25:02 +02:00
Terrtia bc73b0ca27
fix: [crawler] typo 2023-04-11 09:44:49 +02:00
Terrtia e3171c8178
fix: [tags] fix delete subtype tags 2023-04-06 16:26:56 +02:00
Terrtia 2e11b04b6c
fix: [correlation] fix UI cve, decoded tags 2023-04-06 16:18:06 +02:00
Terrtia c7eeae2a44
chg: [correlation] new admin enpoint delete correlation + add screenshot correlation filter 2023-04-06 15:13:27 +02:00
Terrtia ab01de76e5
fix: [credential module] fix logging message 2023-04-06 09:18:57 +02:00
Terrtia f45f9e5836
chg: [correlation] tags all objects 2023-04-05 16:09:06 +02:00
Terrtia 3b1fc0fd2a
fix: [tags] enabled tags selector 2023-04-05 11:27:51 +02:00
Terrtia 885bdb115b
fix: [tags] fix UI enabled tags selector 2023-04-05 10:46:31 +02:00
Terrtia 5cfe7fffc9
fix: [tags] fix UI enabled tags selector 2023-04-05 10:26:21 +02:00
Terrtia d2fdc6107e
fix: [cve + crawler] fix crawler lacus client refresh + typo 2023-04-05 09:51:42 +02:00
Terrtia 427a6fbfa1
fix: [submit] fix UI submit 2023-04-04 15:25:59 +02:00
Terrtia 94a4aeebb1
fix: [queues] fix Mixer queue 2023-04-04 15:20:08 +02:00
Terrtia 72d774f37b
fix: [queues] fix Mixer queue 2023-04-04 15:18:15 +02:00
Terrtia 4c5b1b668f
fix: [submit] fix UI submit 2023-04-04 14:36:38 +02:00
Terrtia 2ace57c5a7
fix: [modules] small fixs 2023-04-04 14:15:35 +02:00
Terrtia c7aeb0c646
fix: [modules] small fixs 2023-04-04 14:12:23 +02:00
Terrtia 83ab4a93cd
fix: [LAUNCH] remove ardb check 2023-04-04 13:53:16 +02:00
Terrtia 80efc9cdbb
chg: [DB] remove ARDB + temp disable MISP import and auto export 2023-04-04 10:25:01 +02:00
Terrtia 54a0bcb022
chg: [crawler] update default user agent 2023-04-04 09:23:52 +02:00
Terrtia d01780dd95
chg: [Mixer] refactor Mixer + fix ZMQImporter config 2023-03-31 14:53:20 +02:00
Terrtia 47da4aa62c
chg: [crawle] migrate domains settings 2023-03-31 09:25:06 +02:00
Terrtia ac484bed71
chg: [stats] disable statistics 2023-03-30 15:23:41 +02:00
Terrtia 5f150489b6
fix: [tracker] fix exporters 2023-03-30 14:58:55 +02:00
Terrtia 126ecb2e39
fix: [core] fix merge 2023-03-16 16:49:53 +01:00
Terrtia 524a404dc8
chg: [core] merge conflict 2023-03-16 15:50:42 +01:00
Terrtia 55d71e0a0b
fix: [exporter] thehive exporter, create case 2023-03-16 14:51:53 +01:00
Terrtia c2a4224375
fix: [user] fix user creation 2023-03-16 14:47:59 +01:00
Terrtia 925d67a35e
chg: [crawler] add crawler scheduler 2023-03-14 17:36:42 +01:00
Terrtia ae6f8af09f
chg: [subtype objects] migrate UI cryptocurrency, pgp, username 2023-02-28 11:01:27 +01:00
Terrtia 0fa27c6a51
chg: [extractor] add cache + UI extractor + word/set extractor 2023-02-23 16:25:15 +01:00
Terrtia ab24343b48
fix: [modules] fix modules 2023-02-22 11:08:29 +01:00
Terrtia 6842efc15d
chg: [crawler] refactor crawler tasks + migrate cookiejars + add proxy option 2023-02-21 12:22:49 +01:00
Terrtia c04bc7bb57
chg: [crawler] cookies migration + refactor 2023-02-17 14:50:20 +01:00
Terrtia 11cd571f44
chg: [exporter] add TheHive exporter 2023-02-15 15:18:10 +01:00
Terrtia 24ffcae690
chg: [exporter] refactor + add a new way to create and use exporters 2023-02-15 11:02:47 +01:00
Terrtia de0a60ba8b
chg: [importer] refactor ZMQ + Feeder importer 2023-02-03 16:13:57 +01:00
Terrtia 3365a054a8
chg: [cleanup] remove ARDB + fix hive case 2023-01-18 16:28:08 +01:00
Terrtia 0e41c95b5c
chg: [MISP export + redis] refactor MISP, export all relationships between objects, relationships between investigated objects + bump redis-py version + theHive export 2023-01-16 16:27:49 +01:00
Terrtia 7fa19efc1e
fix: [data_rentention_engine] fix object first/last seen 2023-01-10 11:41:21 +01:00
Terrtia b0891f45ec
chg: [Item] change parent-child key 2023-01-10 10:32:01 +01:00
Terrtia d295c084c6
chg: [decoded migration] migrate Decoded Objects 2023-01-09 16:03:06 +01:00
Terrtia b5d285b5b4
chg: [CVE] CVE search integration 2022-12-21 16:48:08 +01:00
Terrtia 82ff568feb
chg: [CVE] migrate CVE + get CVEs by daterange 2022-12-21 14:20:13 +01:00
Terrtia bf71c9ba99
chg: [DB Migration] UI: Extract + highlight leaks and trackers match, Data Retention save object first/last date, Refactor Tools 2022-12-19 16:38:20 +01:00