Raphaël Vinot
|
316338a213
|
chg: Better error handling
|
2020-07-06 15:33:00 +02:00 |
Raphaël Vinot
|
605dc00989
|
fix: Properly handle json dumps
|
2020-07-06 14:16:17 +02:00 |
Raphaël Vinot
|
1d77a2001e
|
chg: Bump deps, improve error handling
|
2020-07-03 18:25:16 +02:00 |
Raphaël Vinot
|
41acc544ef
|
chg: depth from UI is a string...
|
2020-06-29 19:23:16 +02:00 |
Raphaël Vinot
|
ce6deabdad
|
fix: convert max_depth from config to int
|
2020-06-29 19:21:38 +02:00 |
Raphaël Vinot
|
afe95c28f6
|
new: Add max depth for scraping.
|
2020-06-29 18:00:56 +02:00 |
Raphaël Vinot
|
05de56022f
|
chg: Use capture UUID as a reference everywhere
|
2020-06-29 12:01:31 +02:00 |
Raphaël Vinot
|
98495c40a9
|
chg: Make mypy happy
|
2020-06-25 17:08:11 +02:00 |
Raphaël Vinot
|
b818055f32
|
fix: Skip unparsable UAs
|
2020-06-25 16:50:57 +02:00 |
Raphaël Vinot
|
cde3d29892
|
new: Add option to use User agents of the Lookyloo users for scraping
|
2020-06-25 16:43:58 +02:00 |
Raphaël Vinot
|
f4bf64a485
|
fix: Do not fail if the meta file is missing.
|
2020-06-24 11:49:10 +02:00 |
Raphaël Vinot
|
6871912e64
|
chg: Expose the picklized tree in lookyloo
|
2020-06-12 11:18:54 +02:00 |
Raphaël Vinot
|
9873d3ebc3
|
fix: Incorrect typing
|
2020-06-11 15:32:43 +02:00 |
Raphaël Vinot
|
1c408af3b0
|
chg: Improve cookies in hostnode view
|
2020-06-11 15:13:31 +02:00 |
Raphaël Vinot
|
285a0cf727
|
new: Phishing Initiative module
|
2020-06-09 15:06:35 +02:00 |
Raphaël Vinot
|
6a8bafd9dc
|
chg: Cleanup, move to Lookyloo organization
|
2020-06-08 16:37:59 +02:00 |
Raphaël Vinot
|
0751321e9b
|
new: Cookies investigation
|
2020-06-04 18:23:36 +02:00 |
Raphaël Vinot
|
bed6b4e39e
|
chg: Add initial URL in email notification
|
2020-05-27 15:39:06 +02:00 |
Raphaël Vinot
|
5ebb35c161
|
new: Add redirects in notifications, optional reply-to
|
2020-05-27 15:15:45 +02:00 |
Raphaël Vinot
|
3a3be0cb46
|
new: Add handles for cookies
|
2020-05-26 17:45:04 +02:00 |
Raphaël Vinot
|
5baab51951
|
fix: Proper fallback for the user agent.
|
2020-05-24 15:35:30 +02:00 |
Raphaël Vinot
|
16c2f63cac
|
chg: Bump dependencies
|
2020-05-24 01:56:42 +02:00 |
Raphaël Vinot
|
83aef5d680
|
chg: Fix typing
|
2020-05-21 23:46:35 +02:00 |
Raphaël Vinot
|
3b631f2c92
|
chg: Improve popup, remove session.
|
2020-05-20 19:11:15 +02:00 |
Raphaël Vinot
|
c3bf87beca
|
chg: Improve popup, make sanejs a module, cache
|
2020-05-19 17:47:55 +02:00 |
Raphaël Vinot
|
466cb5fcd5
|
chg: Improve typing
|
2020-05-18 18:32:59 +02:00 |
Raphaël Vinot
|
1882c9d71a
|
fix: Please mypy
|
2020-05-15 11:39:16 +02:00 |
Raphaël Vinot
|
d3971cc47c
|
new: Add stats
|
2020-05-13 17:31:27 +02:00 |
Raphaël Vinot
|
cd972076b5
|
new: Add url to do a full export, and get the page
|
2020-05-12 16:53:10 +02:00 |
Raphaël Vinot
|
754ae9354d
|
new: Add email notification feature
|
2020-05-11 19:01:06 +02:00 |
Raphaël Vinot
|
70c642b0f6
|
fix: Do not display the full path to the capture
|
2020-05-07 15:46:45 +02:00 |
Raphaël Vinot
|
996bd74e30
|
fix: Missing f-string
|
2020-04-24 15:57:16 +02:00 |
Raphaël Vinot
|
ae49fd2c11
|
new: Add support to pass more parameters via the API
|
2020-04-21 18:41:57 +02:00 |
Raphaël Vinot
|
b1034739ad
|
chg: Fix mypy, bump deps
|
2020-04-20 16:52:46 +02:00 |
Raphaël Vinot
|
a0c906d3dc
|
new: Initial view for 3rd party modules
|
2020-04-20 16:41:42 +02:00 |
Raphaël Vinot
|
de7f50c3b0
|
chg: Improve logging
|
2020-04-03 17:51:58 +02:00 |
Raphaël Vinot
|
1c2cdad38b
|
new: Allow admin to rebuild cache
|
2020-04-01 17:44:06 +02:00 |
Raphaël Vinot
|
e62d56e555
|
chg: Bump har2tree, cleanup
|
2020-04-01 14:33:35 +02:00 |
Raphaël Vinot
|
17c3473d95
|
new: Add config files, initial support for 3rd party modules
|
2020-03-31 14:12:57 +02:00 |
Raphaël Vinot
|
c322bc1b23
|
fix: Pass proper path to the pickled dump
|
2020-03-26 14:55:01 +01:00 |
Raphaël Vinot
|
949ad58667
|
chg: Refactoring of the redirects, rename report -> capture
|
2020-03-26 01:56:24 +01:00 |
Raphaël Vinot
|
c97537fbe9
|
fix: Strip tabs/spaces around URL
|
2020-03-19 14:05:19 +01:00 |
Raphaël Vinot
|
1fd48df470
|
fix: Refang the URL at the right place
|
2020-03-19 11:05:29 +01:00 |
Raphaël Vinot
|
971877954e
|
new: Add support for last redirect
|
2020-03-18 21:14:48 +01:00 |
Fafner [_KeyZee_]
|
3a8b7e6077
|
Fixing Unknown domain if only_global_lookups is set
|
2020-03-17 16:32:39 +01:00 |
Fafner [_KeyZee_]
|
5c5577b97d
|
Fixing Unknown domain if only_global_lookups is set
|
2020-03-17 16:26:31 +01:00 |
Raphaël Vinot
|
9aa995092e
|
chg: Improve error notification
|
2020-03-17 15:27:04 +01:00 |
Raphaël Vinot
|
af98c2b075
|
chg: Better handling of error messages, display them.
|
2020-03-17 14:17:18 +01:00 |
Raphaël Vinot
|
75cb4d3246
|
new: refang urls when needed
|
2020-03-16 13:51:21 +01:00 |
Raphaël Vinot
|
9b4bbb2450
|
fix: Missing cast
|
2020-02-16 23:51:04 +01:00 |
Raphaël Vinot
|
7d2f50174d
|
chg: Bump dependencies, Improve HTTP errors handling
Fix https://github.com/CIRCL/lookyloo/issues/66
|
2020-02-16 23:38:42 +01:00 |
Raphaël Vinot
|
09b3b16910
|
fix: Properly check keys in cache
|
2020-02-11 17:26:01 +01:00 |
Raphaël Vinot
|
794d9745ab
|
fix: wrong variable in last commit
|
2020-02-11 17:09:15 +01:00 |
Raphaël Vinot
|
e7b97d23b7
|
fix: Better handling of cache issues
|
2020-02-11 17:03:25 +01:00 |
Raphaël Vinot
|
4234e44470
|
new: Add initial redirects columns
|
2020-02-03 22:25:48 +01:00 |
Raphaël Vinot
|
89edef68ab
|
new: Improve index
|
2020-02-03 18:30:41 +01:00 |
Raphaël Vinot
|
c9cbf27acc
|
chg: Fix typing
|
2020-01-24 11:25:53 +01:00 |
Raphaël Vinot
|
f1309ce5e3
|
new: Upload optional cookie file
|
2020-01-24 10:17:41 +01:00 |
Raphaël Vinot
|
f1d83d29cf
|
new: Add support for user defined cookies, bump deps
|
2020-01-23 10:52:50 +01:00 |
Raphaël Vinot
|
2d82303ef6
|
chg: Support cookies from/to splash (no UI yet)
|
2020-01-21 11:47:36 +01:00 |
Raphaël Vinot
|
0aaa814224
|
new: Initial commit for cookies tracking. No update on the view yet.
|
2020-01-10 17:28:15 +01:00 |
Raphaël Vinot
|
dec6920cb8
|
chg: Add typing
|
2020-01-06 15:32:38 +01:00 |
Raphaël Vinot
|
4c86b65c56
|
fix: Avoid bypass with "http://user:pwd@host.tld"
|
2019-07-05 18:42:18 +02:00 |
Raphaël Vinot
|
a6693535de
|
fix: Allow to disable scraping private IPs.
|
2019-07-05 16:27:23 +02:00 |
Raphaël Vinot
|
8165913206
|
fix: Initialize cache only once
|
2019-06-25 18:08:52 +02:00 |
Raphaël Vinot
|
66545c26a5
|
new: keep track of metadata about OS and Browser when scraping
|
2019-04-07 23:54:16 +02:00 |
Raphaël Vinot
|
12b8e4f949
|
chg: Improve async processing
|
2019-04-05 16:12:54 +02:00 |
Raphaël Vinot
|
da3d1fe392
|
fix: Avoid loading the cache multiple times
|
2019-04-05 15:07:22 +02:00 |
Raphaël Vinot
|
6b10e74470
|
fix: do not initialize the redis cache more than once.
|
2019-04-05 14:48:25 +02:00 |
Raphaël Vinot
|
0d937b02c9
|
fix: Properly remove files if the scraping failed
|
2019-04-04 00:41:15 +02:00 |
Raphaël Vinot
|
49654b6b11
|
fix: Automatically remove failed runs.
|
2019-03-27 10:21:37 +01:00 |
Raphaël Vinot
|
fdcc566e05
|
chg: Slight cleanup
|
2019-02-18 14:29:15 +01:00 |
Raphaël Vinot
|
747ce7e52d
|
Merge branch 'anonyme' of https://github.com/Th4nat0s/lookyloo into Th4nat0s-anonyme
|
2019-02-18 13:53:04 +01:00 |
Raphaël Vinot
|
9f2b7f7b93
|
new: Add error page
|
2019-02-18 13:52:48 +01:00 |
Th4nat0s
|
8afcc30840
|
clarifie index enable/disable
|
2019-02-17 21:45:23 +00:00 |
thanat0s
|
f029b5d324
|
Add noindex button
|
2019-02-17 17:43:25 +00:00 |
Raphaël Vinot
|
189b78e20f
|
chg: pre-load the existing reports
|
2019-02-01 16:11:16 +01:00 |
Raphaël Vinot
|
1d244ef456
|
chg: Refactor code organisation
|
2019-01-30 14:30:01 +01:00 |