CIRCL
/
AIL-framework
mirror of https://github.com/CIRCL/AIL-framework
2
1
Fork 0
Code Issues Releases Wiki Activity
2,660 Commits
7 Branches
43 Tags
110 MiB
Commit Graph

1509 Commits (ad6365183818a8ec7f843422adc7604fb24b7622)

Author SHA1 Message Date
terrtia edf0c4c454
chg: [message] UI translate message object 2024-01-16 14:38:29 +01:00
terrtia f586baa0c5
fix: [Language] fix language source 2024-01-16 12:04:39 +01:00
terrtia 1c46bb4296
chg: [Language] replace pycld3 by gcld3 + clean text before language detection 2024-01-15 14:17:15 +01:00
terrtia d6d67f6a4c
chg: [hosts] filter onion 2024-01-09 14:31:55 +01:00
terrtia bdaa4c51c9
fix: [hosts] fix number of hosts extracted 2024-01-09 12:15:40 +01:00
terrtia 5094b2dcbb
fix: [DomClassifier] improve perf 2024-01-09 11:38:54 +01:00
terrtia 7263a9777c
fix: [DomClassifier] improve perf 2024-01-09 11:26:05 +01:00
terrtia 5c25ec0fea
fix: [DomClassifier] improve perf 2024-01-09 11:24:54 +01:00
terrtia f851cc9f42
fix: [queue] save last timout in cache 2024-01-09 11:19:01 +01:00
terrtia bd2ca4b319
fix: [crawler] fix api create_task 2024-01-09 09:47:49 +01:00
terrtia a14c0484af
fix: [tags] debug 2024-01-08 15:34:32 +01:00
terrtia be4feb7799
fix: [tags] debug 2024-01-08 15:28:31 +01:00
terrtia 259f29c10c
fix: [tags] debug 2024-01-08 15:27:08 +01:00
terrtia bfc018f929
fix: [tags] debug 2024-01-08 15:21:37 +01:00
terrtia f95d32d6dc
fix: [tags] debug 2024-01-08 15:02:39 +01:00
terrtia 4b21cc2939
fix: [tags] debug 2024-01-08 15:01:40 +01:00
terrtia 07c51e111f
fix: [tags] debug 2024-01-08 14:59:58 +01:00
terrtia efb8b2d0d3
fix: [tags] debug 2024-01-08 14:58:18 +01:00
terrtia 0abc3fee0e
fix: [tags] debug 2024-01-08 14:56:20 +01:00
terrtia 8bf67cf3b6
fix: [tags] remove invalid tags 2024-01-08 14:51:40 +01:00
terrtia d7c8262653
fix: [keys module] fix tags 2024-01-08 14:24:51 +01:00
terrtia 9716351196
Merge branch 'master' into dev 2024-01-08 14:05:34 +01:00
terrtia 0af5ea9d48
chg: [queues] timeout obj after 2 days 2024-01-08 13:50:56 +01:00
terrtia c05f4d7833
chg: [chats] get user message ids by chat 2024-01-02 17:15:45 +01:00
Markus Lassfolk 81f9a860d4
Fix IndexError in get_last_tag_from_remote function 
This commit adds a check to ensure that the output from the subprocess command in the get_last_tag_from_remote function has a sufficient number of lines before attempting to access specific indices. This change prevents the IndexError that occurred when the git command's output was shorter than expected.
 2024-01-01 21:54:29 +01:00
terrtia 70bb6757f8
chg: [correlation] UI chats filters + correation user-account/username 2023-12-13 11:51:53 +01:00
terrtia 9221e532c4
fix: [crawlers] fix task start 2023-12-12 11:32:33 +01:00
terrtia 7e9ea48c81
fix: [crawler] debug 2023-12-12 11:20:21 +01:00
terrtia cdfc9f64e5
fix: [crawler] debug 2023-12-12 11:13:58 +01:00
terrtia 847d004c13
fix: [crawler] debug 2023-12-12 11:05:23 +01:00
terrtia c20c41c50f
fix: [libinjection] memory leak, disable module 2023-12-12 10:30:40 +01:00
terrtia 4529a76d13
fix: [zmq importer] fix object source name 2023-12-12 10:14:59 +01:00
terrtia 235539ea42
fix: [crawler] fix capture start time 2023-12-11 09:30:09 +01:00
terrtia 5fc9b1403f
chg: [chats] add pagination 2023-12-11 00:46:15 +01:00
terrtia 943a873124
chg: [tags] searech messages tags by daterange 2023-12-09 16:50:43 +01:00
terrtia 73185f19fd
chg: [categ] messages, bypass categ module + fix correlation 2023-12-08 15:40:05 +01:00
terrtia 5b808ed416
fix: [translate] fix exception 2023-12-08 14:38:55 +01:00
terrtia 1c52c187ad
fix: [api] fix add crawler capture return 2023-12-08 10:37:58 +01:00
terrtia cea96863ba
fix: [language] libretranslate unreachable 2023-12-07 14:59:40 +01:00
terrtia 3e591d95bc
fix: [retro_hunt] fix daterange 2023-12-07 14:40:51 +01:00
terrtia a382b572c6
chg: [crawler] push onion discovery capture_uuid to another AIL 2023-12-07 11:28:35 +01:00
terrtia 38ce17bc8a
chg: [chats] add chats participants + user-accounts basic template 2023-12-06 16:26:26 +01:00
terrtia bef4e69a68
chg: [chats] translate messages on demand 2023-12-04 15:47:58 +01:00
terrtia 941838ab76
chg: [chats] add discord threads, Forum channel 2023-12-04 10:26:02 +01:00
terrtia 93ef541862
chg: [chats] add messages threads 2023-11-29 16:28:25 +01:00
terrtia f766cbebda
chg: [chats] add message file-name object + str emoticon reactions 2023-11-27 16:25:09 +01:00
terrtia fa4f1269cd
chg: [chat users] add users icons 2023-11-24 16:35:45 +01:00
terrtia 2b8e9b43f3
chg: [chats] factorise heatmap + chat icon 2023-11-24 15:05:19 +01:00
terrtia 9fbd3f4bb6
chg: [chats] add message and blur blocks 2023-11-16 14:50:03 +01:00
terrtia 2ea5f82760
chg: [queues] add new image queue + add exif module 2023-11-15 15:45:25 +01:00
terrtia 4142ad9884
chg: [chats] add image object + show message image 2023-11-15 14:12:50 +01:00
terrtia 7bf0fe8992
chg: [chats] add heatmap nb week messages by hour 2023-11-13 14:10:24 +01:00
terrtia 54c57ea35b
chg: [chats] message object template 2023-11-08 15:46:05 +01:00
terrtia e0f70c5072
fix: [investigations] delete obj 2023-11-08 13:35:13 +01:00
terrtia ce989adbd3
fix: [chats] fix username meta 2023-11-08 13:07:00 +01:00
terrtia 207a6524d7
fix: [languages] fix language module 2023-11-08 11:59:06 +01:00
terrtia 6c77ca5136
fix: [chats] fix chat username 2023-11-08 11:25:30 +01:00
terrtia 5068287c76
Merge branch 'master' into dev 2023-11-08 10:42:02 +01:00
terrtia acef57bb36
fix: [tags] fix galaxies synonyms 2023-11-08 10:41:32 +01:00
terrtia e7f060c23d
chg: [messages] refactor get_messages_meta + add basic message template 2023-11-08 10:31:51 +01:00
terrtia 4cc9608a3f
chg: [chats explorer] show chats/subchannels creation date 2023-11-07 15:24:40 +01:00
terrtia 3fb1d0ad74
fix: [chats] fix messages replies 2023-11-07 11:24:24 +01:00
terrtia b1d5399607
chg: [chats] add UI shortcut + networks list + show chats/subchannels info 2023-11-06 16:38:31 +01:00
terrtia 789210bcba
chg: [chats] improve UI + fix importer 2023-11-06 14:08:23 +01:00
terrtia 9125119764
chg: [chats] add chats explorer v0 2023-11-02 16:28:33 +01:00
terrtia c5cef5fd00
chg: [core] merge master + fix object subtype correlation stats 2023-10-12 13:53:00 +02:00
terrtia 6978764b02
fix: [module] fix module obj type: language + mail 2023-10-11 14:53:12 +02:00
terrtia 623ba455ff
fix: [queues] fix ended duplicate + sync queue 2023-10-11 14:31:13 +02:00
terrtia 676b0f84ef
chg: [module + queues] track + rename object global ID by module 2023-10-11 12:06:01 +02:00
terrtia eae57fb813
chg: [importers obj_type] importers queues: add feeder source + object global ID 2023-10-05 16:24:28 +02:00
terrtia daf9f6fb5d
fix: [chats] message css + reply ID 2023-10-04 14:40:13 +02:00
terrtia fee3332edb
fix: [tracker] delete yara rule, fix filter by object type 2023-09-29 15:43:37 +02:00
terrtia c19b1f34e3
chg: [ail queues] merge 2023-09-08 10:52:55 +02:00
terrtia bb3dad2873
chg: [objs processed] xxhash messages 2023-09-07 10:38:03 +02:00
Jean-Louis Huynen 68c17c3fbc
chg: [crawlers] submit cookies to the crawler task API 2023-08-31 16:13:20 +02:00
Jean-Louis Huynen ed0423118e
chg: [crawlers] submit a single cookie to the crawler task API 2023-08-31 15:42:44 +02:00
Terrtia 7c73f0944a
fix: [items source] filter invalid item sources 2023-08-29 14:03:26 +02:00
Terrtia 099253f854
fix: [json importer] fix empty source name 2023-08-29 13:50:16 +02:00
Terrtia 24969610cc
fix: [items source] fix empty sources list 2023-08-29 11:59:39 +02:00
Terrtia b32f110285
chg: [chat + user-account] correlations + usernames timeline 2023-08-28 16:29:38 +02:00
Terrtia 546d6538fd
chg: [mail exporter] add obj content extract for each regex match 2023-08-24 14:37:50 +02:00
Terrtia c01b806ae3
chg: [mail exporter] add obj content extract for each yara rule match 2023-08-24 11:11:57 +02:00
Terrtia 843b2d3134
fix: correlations 2023-08-23 16:13:20 +02:00
Terrtia 4e3784922c
fix: typo 2023-08-23 11:47:39 +02:00
Terrtia 2145eb7b8a
fix: [title] fix None title 2023-08-23 11:46:37 +02:00
Terrtia f44c5509da
chg: [titles] add yara tracker on title + tags domains if unsafe title tags 2023-08-23 11:16:22 +02:00
Terrtia 045aab6f34
fix: [module pasties] fix module name 2023-08-21 15:52:33 +02:00
Terrtia 0cb7431e10
chg: [modules] crawl pasties domains 2023-08-21 15:49:32 +02:00
Terrtia 3c1813ba02
chg: [core] add telegram importer + Chat object + message Object + add timeline engine 2023-08-18 11:05:21 +02:00
Terrtia f05c7b6a93
fix: [module extractor] fix invalid yara offset 2023-08-08 11:27:57 +02:00
Terrtia 4dc5527c1a
fix: [module extractor] fix invalid yara offset 2023-08-08 11:26:16 +02:00
Terrtia 529a24c191
chg: [module extrator] add debug 2023-08-08 10:40:44 +02:00
Terrtia bd7aa979bd
chg: [module extrator] add debug 2023-08-08 10:36:58 +02:00
Terrtia 2691000d0c
chg: [telegram fedeer] use meta of the new feeder 2023-08-02 15:49:12 +02:00
Terrtia 14a76a91d9
fix: [tags ui] fix galaxy, get number of tags enabled + add toolip helper 2023-08-01 11:07:06 +02:00
Terrtia 1aa0bd8a0e
fix: [settings] fix edit user 2023-07-31 16:25:28 +02:00
Terrtia 64252ddf75
fix: [Tracker] edit tracker filters 2023-07-31 16:00:31 +02:00
Terrtia 4eb5b4c4b9
fix: [MailExporter] improve logs + SMTP over SSL: add an option to validate self signed CA 
This exporter use STARTTLS by defaults. If the SMTP server does not support the STARTTLS extension, the client will switch to SSL instead.
 2023-07-28 11:10:21 +02:00
Terrtia 68dffcd26b
chg: [api crawler] fix response + add cookiejar, proxy and frequency parameters 2023-07-25 15:57:11 +02:00
Terrtia fe2769308b
fix: [crawler] fix down domain + domain redirection history 2023-07-18 14:30:00 +02:00