CIRCL
/
AIL-framework
mirror of https://github.com/CIRCL/AIL-framework
2
1
Fork 0
Code Issues Releases Wiki Activity
2,232 Commits
7 Branches
44 Tags
110 MiB
Commit Graph

36 Commits (c04d12cb2d4c7be3435d0b1ffcff2008daf0d44f)

Author SHA1 Message Date
Terrtia 1372b1ef68
fix: [api] fix crawler api response 2022-09-14 10:27:17 +02:00
Terrtia 1254c1c9c0
chg: [api] send url to crawler 2022-09-14 10:02:38 +02:00
Terrtia ebcffd4b95
fix: [crawler] fix is_splash_manager_connected #133 2021-12-03 15:36:47 +01:00
Terrtia cb45fe9fab
fix: [crawler] add comment 2021-11-26 16:35:51 +01:00
Terrtia 4e481603b5
Merge branch 'master' of github.com:ail-project/ail-framework 2021-10-14 14:23:24 +02:00
Terrtia 57fbacc49c
chg: [crawler] add auto crawler functions 2021-10-14 14:23:11 +02:00
osagit fc2c3ea08f
fix: error message contains http protocol twice 
Error Can't connect to AIL Splash Manager, http://https://localhost:7001/
 2021-09-07 11:57:17 +02:00
Terrtia 7a652b5195
fix: [crawler] fix new crawled item id 2021-07-14 15:48:17 +02:00
Terrtia b29767a020
merge 2021-07-14 14:08:15 +02:00
Terrtia ec727338e6
fix: [crawlers] get_all_splash return type 2021-06-16 10:06:04 +02:00
Terrtia 759ec73f84
fix: [Splash_Manager errors] catch invalid response 2021-06-15 17:25:51 +02:00
Terrtia 2abe5217aa
fix: [Splash_Manager errors] catch invalid response 2021-06-15 17:19:57 +02:00
Terrtia 4896db98a3
chg: [launcher + modules] add module tests (Onion module) 2021-05-17 18:03:30 +02:00
Terrtia 4bbff47989
chg: [AIL items + Onion] create AIL item objects + Onion module refactor 2021-05-14 14:42:16 +02:00
Terrtia c0be210d2c
chg: [crawler] add test + relaunch crawlers + major fixs 2021-03-29 20:27:20 +02:00
Terrtia 503e7e33aa
fix: [crawler] typo 2021-03-05 18:52:14 +01:00
Terrtia 6daa750e3b
fix: [Crawler] faup 2021-03-05 18:47:38 +01:00
Terrtia 1f94c1c693
chg: [splash manager] update enpoints + use Splash name to restart docker 2021-03-04 09:26:28 +01:00
Terrtia fc7a61f67c
chg: [merge master] 2021-02-10 15:50:48 +01:00
Terrtia d941d8abb4
chg: [domains search] search domains by name 2021-02-05 17:42:33 +01:00
Terrtia abfad61581
fix: [crawler] fix ResponseNeverReceived hanlder, check if splash restarted 2020-09-14 17:03:36 +02:00
Terrtia d8b7ab4de5
chg: [crawler_manager] UI edit config + fix crawler queues 2020-08-24 22:31:41 +02:00
Terrtia 65f6ee4911
chg: [crawlers manager] show setings 2020-08-18 19:10:38 +02:00
Terrtia 3ea14b29b8
chg: [crawler] show all crawlers type on dashboard 2020-08-17 21:52:57 +02:00
Terrtia 8901ffe989
Merge branch 'master' into crawler_manager 2020-08-13 15:24:07 +02:00
Terrtia a88b57498d
fix: [crawler] fix auto crawler creation 2020-07-31 17:22:41 +02:00
Terrtia 39c3918d09
chg: [crawler] manage crawlers 2020-07-27 15:46:09 +02:00
Terrtia c31aae4efc
chg: [crawler] crawler queue + restart docker on error 2020-07-24 08:54:54 +02:00
Terrtia 41cacf7129
chg: [crawler manager] get all splash dockers, proxies and launch all crawlers 2020-06-09 18:33:41 +02:00
Terrtia d20ae35548
fix: [crawler] option to disable screenshots and har 2020-06-04 16:05:32 +02:00
Terrtia eec579c5d4
fix: [crawlers lib] missing config file 2020-05-25 08:54:19 +02:00
Terrtia 9991570499
fix: [create au to crawler] save crawler_delta time 2020-05-22 16:20:36 +02:00
Terrtia 3fd200be43
chg: [crawler proxy] interact with the splash manager API 
(get list of proxies + splash containers + launch them)
 2020-05-22 15:41:05 +02:00
Sunil D S c8c96937cc
crawler_time -> crawler_delta 2020-04-17 20:06:40 +05:30
Terrtia 72f1f15659
chg: [crawler] edit cookie and cookiejar + add cookie to cookiejar + fix screenshot duplicate 2020-04-01 09:58:47 +02:00
Terrtia 5f289f04f3
chg: [Crawler core + UI] crawler lua: handle retry + fix cookie loader and selector 2020-03-30 18:43:50 +02:00