Raphaël Vinot
|
1f998b457f
|
chg: use template
|
2021-10-18 13:06:43 +02:00 |
Raphaël Vinot
|
7caee08f76
|
chg: Bump deps, add logging.
|
2021-10-07 18:33:40 +02:00 |
Raphaël Vinot
|
1a0fe677ab
|
fix: Copy bodies before sending them over.
send_file in flask close the BytesIO, causing issue if we need to
re-access it.
|
2021-09-29 15:00:10 +02:00 |
Raphaël Vinot
|
0da28cef28
|
chg: Move MISP export to module, add phishtank permaURL
|
2021-09-27 16:04:00 +02:00 |
Raphaël Vinot
|
681e136ef4
|
chg: More cleanup to use the new caching system as it should be.
|
2021-09-27 11:36:27 +02:00 |
Raphaël Vinot
|
48fc807e7d
|
new: Add monitoring for pickle cache status
|
2021-09-24 12:02:28 +02:00 |
Raphaël Vinot
|
87c6925c7b
|
new: IPs lookup against phishtank
|
2021-09-23 13:58:40 +02:00 |
Raphaël Vinot
|
19c8c54b0b
|
fix: force-rebuild pickle if needed.
|
2021-09-22 22:23:20 +02:00 |
Raphaël Vinot
|
32ee474be2
|
chg: Improve tree creation and cache
|
2021-09-22 17:09:04 +02:00 |
Raphaël Vinot
|
01fff00cad
|
chg: Slight cleanup
|
2021-09-21 18:04:22 +02:00 |
Raphaël Vinot
|
cefb3fddbf
|
new: Phishtank lookup.
|
2021-09-16 16:33:44 +02:00 |
Raphaël Vinot
|
1d40dd44ae
|
new: Add urlscan permanent URL to MISP export
|
2021-09-15 15:42:02 +02:00 |
Raphaël Vinot
|
d1f673f3a7
|
chg: Cleanup passing listing key to and from bool in redis
|
2021-09-10 14:20:58 +02:00 |
Raphaël Vinot
|
5abc264159
|
fix: Better initialization of cache, avoid missing the error message.
|
2021-09-08 16:34:54 +02:00 |
Raphaël Vinot
|
902c8f81b6
|
chg: Improve error message if the capture fails
Fix #257
|
2021-09-07 18:16:01 +02:00 |
Raphaël Vinot
|
048e44ce91
|
fix: Avoid exception in _set_capture_cache in case of critical error
|
2021-09-07 16:00:07 +02:00 |
Raphaël Vinot
|
dfbe40a52e
|
chg: reorder imports
|
2021-09-07 16:00:07 +02:00 |
Raphaël Vinot
|
7d76d96ff7
|
fix: Avoid 500 error on the website if unable to dump pickle.
|
2021-09-06 16:30:43 +02:00 |
Raphaël Vinot
|
074bb675f6
|
fix: Handling of status code 0, export capture UUID
|
2021-09-06 16:12:41 +02:00 |
Raphaël Vinot
|
c09adec333
|
chg: Improve logging.
|
2021-09-01 14:08:25 +02:00 |
Raphaël Vinot
|
9042b73e69
|
chg: Remove dead code, proper use of exceptions.
|
2021-08-31 13:48:19 +02:00 |
Raphaël Vinot
|
1bff8f1529
|
fix: cast capture dir to string for redis
|
2021-08-28 20:36:50 +02:00 |
Raphaël Vinot
|
d41b7735dd
|
chg: Improve storage, support both modes.
|
2021-08-26 15:49:19 +02:00 |
Raphaël Vinot
|
bc5e41a1ca
|
fix: Properly re-set the cache if the tree was not built
|
2021-08-25 15:00:26 +02:00 |
Raphaël Vinot
|
bf700e7a7b
|
chg: Major refactoring, move capture code to external script.
|
2021-08-25 13:36:48 +02:00 |
Raphaël Vinot
|
81390d5ea0
|
chg: cleanup in the mail lookyloo class
|
2021-08-24 18:32:54 +02:00 |
Raphaël Vinot
|
8433cbcc1b
|
chg: Cleanup archiver, initialize index captures in start
|
2021-08-24 17:10:14 +02:00 |
Raphaël Vinot
|
53ceb9c329
|
chg: Cleanup when dir is moved, digit months on 2 values
|
2021-08-23 14:53:19 +02:00 |
Raphaël Vinot
|
b8109c6462
|
fix: Make mypy happy
|
2021-08-23 14:20:26 +02:00 |
Raphaël Vinot
|
d359bc7521
|
chg: Better use of cache, sanity checks
|
2021-08-23 12:17:44 +02:00 |
Raphaël Vinot
|
58b837cb6c
|
new: Archiver, refactoring.
|
2021-08-20 17:46:22 +02:00 |
Raphaël Vinot
|
6be9b69d95
|
chg: Use connection pool whenever possible
|
2021-08-18 18:01:04 +02:00 |
Raphaël Vinot
|
046387a9f4
|
chg: Make mypy happy
|
2021-08-18 16:37:50 +02:00 |
Raphaël Vinot
|
3a96e27f8c
|
chg: Try using redis connection pool
|
2021-08-18 16:07:39 +02:00 |
Raphaël Vinot
|
50dbbd6eba
|
new: [API] Trigger modules for a capture
|
2021-08-13 13:50:26 +02:00 |
Raphaël Vinot
|
3436f5bd4e
|
chg: Improve urlscan support, get results.
|
2021-08-11 15:26:12 +02:00 |
Raphaël Vinot
|
7933670941
|
new: Integration with urlscan.io
|
2021-08-10 17:38:47 +02:00 |
Raphaël Vinot
|
28e3162187
|
Merge branch 'restx'
|
2021-07-21 11:05:25 +02:00 |
Raphaël Vinot
|
59f2a510c0
|
fix: properly catch broken capture, bump deps
|
2021-07-14 11:34:10 +02:00 |
Raphaël Vinot
|
cc2e5a4159
|
Merge branch 'main' into restx
|
2021-07-05 09:54:37 +02:00 |
Raphaël Vinot
|
06aa85cfe8
|
fix: Do not return the whole database if the list of captures to sort is empty.
Related #227
|
2021-06-29 13:48:13 -07:00 |
felalex
|
d3e0b7f394
|
new: proxy parameter in crawl
|
2021-06-25 19:11:15 +02:00 |
felalex
|
1c89a80c7e
|
fix: expected format & passing proxy in _capture
|
2021-06-25 16:36:57 +02:00 |
Raphaël Vinot
|
26cbf94977
|
Merge branch 'main' into restx
|
2021-06-22 16:55:41 -07:00 |
Raphaël Vinot
|
a44b7b30b5
|
new: Get URLs and Hostnames from captures
|
2021-06-16 14:57:14 -07:00 |
Raphaël Vinot
|
7ad9aa7bbc
|
Merge branch 'main' into restx
|
2021-06-15 17:24:19 -07:00 |
Raphaël Vinot
|
4a8db1fc6e
|
fix: re-cache captures with incomplete redirects, code cleanup
|
2021-06-15 16:03:33 -07:00 |
Raphaël Vinot
|
c52509614e
|
new: get capture info API call
|
2021-06-09 17:59:24 -07:00 |
Raphaël Vinot
|
3d2c7420a4
|
chg: Bump mypy
|
2021-06-09 12:12:01 -07:00 |
Raphaël Vinot
|
cf65489cef
|
chg: Bump mypy
|
2021-06-09 12:04:26 -07:00 |