CIRCL
/
AIL-framework
mirror of https://github.com/CIRCL/AIL-framework
2
1
Fork 0
Code Issues Releases Wiki Activity
2,921 Commits
7 Branches
44 Tags
110 MiB
Commit Graph

50 Commits (f4584f7e98eaac77e04ce3baab7ad3c25589c61e)

Author SHA1 Message Date
terrtia ea12a44836
fix: [crawler] avoid crawler loop if a capture end up in an invalid state 2024-12-09 16:44:40 +01:00
terrtia b988f46c90
chg: [dom-hash] add dom-hash object compute dom-hash for domains and crawled items 2024-10-17 12:14:48 +02:00
terrtia 6d3d331fb3
chg: [titles] setup Titles queues + CEDetector module 2024-10-16 11:02:18 +02:00
terrtia 1112615ec3
chg: [crawler] disable unsafe title auto tagging 2024-10-14 14:27:45 +02:00
terrtia 2ead8c21aa
chg: [crawler] tag domain by vanity 2024-10-10 11:03:07 +02:00
terrtia 83e11082b5
fix: [crawler] filter lookup parent + domain daterange 2024-10-07 11:03:56 +02:00
terrtia 9f45202658
chg: [qrcode] extract qrcode content from images and screenshots + qrcode object + correlation 2024-10-01 15:12:15 +02:00
terrtia a20b6054e8
fix: [crawler] fix crawler queue stats 2024-09-17 15:36:15 +02:00
terrtia ba61d1ae69
chg: [modules] disable LibInjection 2024-09-17 14:53:50 +02:00
terrtia 81c4dde7b0
fix: [favicon] crawler favicon 2024-02-21 14:34:20 +01:00
terrtia 88fbe36f70
fix: [vanity] update id domains is up + min vanity = 4 2024-02-19 15:23:16 +01:00
terrtia f07a4b422b
chg: [vanity] add vanity domain explorer + fix blurred screenshot + fix languages search filter 2024-02-19 15:14:37 +01:00
terrtia b6eb6c9016
fix: [crawler] fix capture None domain name 2024-02-02 14:48:19 +01:00
terrtia 194ae960fc
fix: [crawlers] fix capture return error code 2024-01-30 11:35:43 +01:00
terrtia d1608e89e1
fix: [crawlers] fix errored capture queue 2024-01-30 11:29:42 +01:00
terrtia 9c6619aed3
fix: [crawler] log UNKNOWN timeout 2024-01-26 15:31:32 +01:00
terrtia 7e9ea48c81
fix: [crawler] debug 2023-12-12 11:20:21 +01:00
terrtia cdfc9f64e5
fix: [crawler] debug 2023-12-12 11:13:58 +01:00
terrtia 847d004c13
fix: [crawler] debug 2023-12-12 11:05:23 +01:00
terrtia 235539ea42
fix: [crawler] fix capture start time 2023-12-11 09:30:09 +01:00
terrtia a382b572c6
chg: [crawler] push onion discovery capture_uuid to another AIL 2023-12-07 11:28:35 +01:00
terrtia c5cef5fd00
chg: [core] merge master + fix object subtype correlation stats 2023-10-12 13:53:00 +02:00
terrtia 676b0f84ef
chg: [module + queues] track + rename object global ID by module 2023-10-11 12:06:01 +02:00
terrtia eae57fb813
chg: [importers obj_type] importers queues: add feeder source + object global ID 2023-10-05 16:24:28 +02:00
Terrtia b32f110285
chg: [chat + user-account] correlations + usernames timeline 2023-08-28 16:29:38 +02:00
Terrtia f44c5509da
chg: [titles] add yara tracker on title + tags domains if unsafe title tags 2023-08-23 11:16:22 +02:00
Terrtia fe2769308b
fix: [crawler] fix down domain + domain redirection history 2023-07-18 14:30:00 +02:00
Terrtia a9485928db
chg: [HHHash] add HHHash object and correlation https://www.foo.be/2023/07/HTTP-Headers-Hashing_HHHash 2023-07-17 15:47:17 +02:00
Terrtia c719990125
fix: [crawler] add timeout to Unknown captures 2023-07-10 11:23:44 +02:00
Terrtia 450ebdd789
chg: [etag] add new etag object 2023-07-06 11:26:32 +02:00
Terrtia 501d10bbbd
chg: [crawler] auto tag crawled domains 2023-06-20 08:11:44 +02:00
Terrtia e9539e640b
fix: [crawler] fix incomplete response 2023-06-18 15:09:09 +02:00
Terrtia f8fd037bd2
chg: [object cookie-name] add new cookie-name object + correlation 2023-06-16 15:39:13 +02:00
Terrtia 9efc348506
chg: [correlation] filter blank screenshots 2023-06-02 11:23:52 +02:00
Terrtia b4f1a43208
chg: [correlation] correlation graph: filter title objects 2023-05-26 10:47:58 +02:00
Terrtia c008366f02
chg: [new title object] add new title object + correlation on page title 2023-05-25 14:33:12 +02:00
Terrtia 9b2e8718d7
chg: [logs] add new logger 2023-05-12 15:29:53 +02:00
Terrtia 6b60041db2
chg: [crawler] add unsafe tag if domain contain unsafe screenshot 2023-05-10 16:28:19 +02:00
Terrtia 6f9e0c2f66
chg: [AIL queues] rewrite module queues. remove PUBSUB 2023-04-13 14:25:02 +02:00
Terrtia bc73b0ca27
fix: [crawler] typo 2023-04-11 09:44:49 +02:00
Terrtia c7eeae2a44
chg: [correlation] new admin enpoint delete correlation + add screenshot correlation filter 2023-04-06 15:13:27 +02:00
Terrtia d2fdc6107e
fix: [cve + crawler] fix crawler lacus client refresh + typo 2023-04-05 09:51:42 +02:00
Terrtia 72d774f37b
fix: [queues] fix Mixer queue 2023-04-04 15:18:15 +02:00
Terrtia 2ace57c5a7
fix: [modules] small fixs 2023-04-04 14:15:35 +02:00
Terrtia c7aeb0c646
fix: [modules] small fixs 2023-04-04 14:12:23 +02:00
Terrtia d01780dd95
chg: [Mixer] refactor Mixer + fix ZMQImporter config 2023-03-31 14:53:20 +02:00
Terrtia 925d67a35e
chg: [crawler] add crawler scheduler 2023-03-14 17:36:42 +01:00
Terrtia 6842efc15d
chg: [crawler] refactor crawler tasks + migrate cookiejars + add proxy option 2023-02-21 12:22:49 +01:00
Terrtia f9715408be
chg: [migration] migrate Item + Domain metas 2022-11-30 15:50:10 +01:00
Terrtia 104eaae793
chg: [crawler + core + cve] migrate crawler to lacus + add new CVE object and correlation + migrate core 2022-10-25 16:31:38 +02:00