Commit Graph

90 Commits (b50cc92573fddfa7f522ca0907bb8def0816ede1)

Author SHA1 Message Date
Terrtia d20ae35548
fix: [crawler] option to disable screenshots and har 2020-06-04 16:05:32 +02:00
Terrtia 6dc8f0a79d
chg: [API + item library] add a way to check if a user can access the API + item import (use item_basic) 2020-05-27 20:43:00 +02:00
Terrtia eec579c5d4
fix: [crawlers lib] missing config file 2020-05-25 08:54:19 +02:00
Terrtia 9991570499
fix: [create au to crawler] save crawler_delta time 2020-05-22 16:20:36 +02:00
Terrtia 3fd200be43
chg: [crawler proxy] interact with the splash manager API
(get list of proxies + splash containers + launch them)
2020-05-22 15:41:05 +02:00
Terrtia 5d7488f74a
fix: [Credential] fix timeout error 2020-05-20 17:29:51 +02:00
Terrtia f917357615
fix: [Credential] fix timeout message 2020-05-20 17:16:02 +02:00
Terrtia 4601003509
fix: [Mail module] regex timeout 2020-05-20 17:03:58 +02:00
Terrtia c675cb2eaa
chg: [UI dashboard] sort module by name 2020-05-16 22:35:24 +02:00
Terrtia 5475660785
fix: [UI Decoded items] fix download decoded file 2020-05-14 10:26:54 +02:00
Terrtia 19f7d8c1e8
chg: [UI correlation] add username correlation graph 2020-05-11 18:11:38 +02:00
Terrtia 297d5891a8
chg: [telegram backend] add username correlation + save invite hash 2020-05-11 14:21:10 +02:00
Terrtia 8c864fdba0
fix: [urlextract importer] fix parent map + replace set JSON queue by list 2020-05-06 16:57:13 +02:00
Terrtia bae2fd79df
fix: [import urlextract parent] fix typo 2020-05-05 11:39:06 +02:00
Terrtia 074ada504a
chg: [importer] add map twitter id - item id, add parents link between twitter and url extracted 2020-05-05 11:24:33 +02:00
Terrtia 64fae5d7df
fix: [urlexport importer] fix item name + redis config 2020-05-03 15:40:43 +02:00
Terrtia d269a5b31b
chg: [import er url_extract] add item twitter parent 2020-04-30 15:46:38 +02:00
Terrtia 8d727cbd31
chg: [core import] add AIL JSON import format, API endpoint added (AIL feeders) 2020-04-28 14:14:45 +02:00
Sunil D S c8c96937cc
crawler_time -> crawler_delta 2020-04-17 20:06:40 +05:30
Terrtia ef3d145c87
chg [telegram + correlation] new module: telegram (username + login code + join_chat) + add simple_correlation backend 2020-04-10 10:49:21 +02:00
Terrtia f97698ad44
Merge branch 'master' into crawler_v2 2020-04-01 09:59:33 +02:00
Terrtia 72f1f15659
chg: [crawler] edit cookie and cookiejar + add cookie to cookiejar + fix screenshot duplicate 2020-04-01 09:58:47 +02:00
Terrtia 5f289f04f3
chg: [Crawler core + UI] crawler lua: handle retry + fix cookie loader and selector 2020-03-30 18:43:50 +02:00
Terrtia 720ffa1c9c
chg: [MISP export] export domain as domain-crawled object 2020-03-26 17:03:57 +01:00
Terrtia d87ecff4a0
chg: [crawler - cookies] add/show/select cookies 2020-03-24 17:15:43 +01:00
Terrtia 1c45571042
chg: [crawler] add cookies list by user/global, save cookies from file + dict(name, value), TODO: API + handle errors 2020-03-23 18:00:09 +01:00
Terrtia db634e8866
fix: [crawler] cleanup 2020-03-20 16:20:01 +01:00
Terrtia 6cfd3fe36d
chg: [crawler] bypass login: use cookie provided by user and accept cookie from server + refractor 2020-03-20 16:15:25 +01:00
Terrtia 42ea678b7a
chg: [Splash Crawler] use cookies to bypass login 2020-03-09 17:02:18 +01:00
Terrtia 40b853cbe3
chg: [MISP Importer] files: handle missing sha1/sha256 attributes + fix Items and Screenshots dir 2020-02-26 13:45:47 +01:00
Terrtia 301e7e67d1
chg: [UI MISP export] add object export picker by user 2020-02-19 16:15:41 +01:00
Terrtia b0dde78c2e
chg: [UI MISP import]show error +imported uuid/global_id 2020-02-18 13:47:47 +01:00
Terrtia 1b861f55ee
chg: [UI MISP export] add error output 2020-02-18 11:27:00 +01:00
Terrtia 4d0e9a94d0
chg: [UI MISP export] add MISP export 2020-02-17 17:01:16 +01:00
Terrtia b641be3b58
chg: [MISP import export] item with relationships (domain not handled) 2020-02-14 09:57:42 +01:00
Terrtia 4d2449cd61
chg: [MISP import export] decoded with relationships 2020-02-13 15:03:05 +01:00
Terrtia eddb000890
chg: [MISP import-export] screenshots with relationships 2020-02-12 17:12:17 +01:00
Terrtia ac114814fd
chg: [MISP import-export] pgp and cryptocurrency with relationships 2020-02-12 16:36:02 +01:00
Terrtia 25e3022eab
chg: [MISP import] import files obj: decoded + screenshot 2020-02-11 15:48:30 +01:00
Terrtia 73f98c0897
chg: [add MISP import](no correlations) import item + pgp(incomplete) + screenshot(incomplete) 2020-02-06 17:14:08 +01:00
Terrtia b31fffa728
chg: [MISP export] add pgp object + add relationship: item + pgp + cryptocurrency 2020-02-04 13:04:09 +01:00
Terrtia 4a732ea9f3
chg: [export MISP] export Items + Screenshots objects with relationships 2020-01-31 17:01:47 +01:00
Terrtia b63fa51166
chg: [domain explorer] domains explorer v2, filter domains by daterange 2020-01-24 15:03:04 +01:00
Terrtia addb885674
chg: [domain core + UI] add domain explorer v1 2020-01-23 15:43:54 +01:00
Terrtia f139e9564e
fix: [expand btc adress] filter empty addr fields 2020-01-21 10:59:11 +01:00
Terrtia 9357097d2f
chg: [UI + core] tag decoded items, fix: #455 2020-01-20 16:42:26 +01:00
Terrtia a77d16f6d7
fix: [UI] screenshot url 2020-01-14 16:46:53 +01:00
Terrtia f06551f1a1
chg: [UI tags] add + delete image (screenshot) tags 2020-01-14 16:14:21 +01:00
Terrtia fb320ca5d5
chg: [UI tags] search domains by tags 2020-01-13 11:10:03 +01:00
Terrtia 99897ffa9b
chg: [core + UI] search domain by tags 2020-01-10 16:52:55 +01:00