Raphaël Vinot
|
b09aec5b84
|
fix: un-break json dump
|
2021-02-12 12:06:26 +01:00 |
Raphaël Vinot
|
d711fd3644
|
fix: Make get legacy user config quiet
|
2021-02-05 15:24:11 +01:00 |
Raphaël Vinot
|
39dd2021dd
|
chg: Complete rework of the login system, add UI for MISP Push
|
2021-02-04 19:51:43 +01:00 |
Raphaël Vinot
|
610ffef43a
|
new: Add VT objects to MISP export
|
2021-02-02 15:23:38 +01:00 |
Raphaël Vinot
|
a68400dac7
|
chg: Add comments in MISP export
|
2021-02-02 15:23:38 +01:00 |
Raphaël Vinot
|
fca3290ef0
|
fix: Make sure to skip last year's final week in the stats
|
2021-02-02 15:23:38 +01:00 |
Raphaël Vinot
|
a7484e6cc4
|
chg: Improve MISP export
* IPs of redirects
* default tags
* auto publish
|
2021-02-01 18:09:32 +01:00 |
Raphaël Vinot
|
54ba67bb87
|
chg: Make lookyloo link org only in MISP export for private instances
|
2021-02-01 14:58:06 +01:00 |
Raphaël Vinot
|
f017ef5bef
|
chg: Add support to timeout in the MISP module
|
2021-02-01 13:01:44 +01:00 |
Raphaël Vinot
|
60ad0dc7ce
|
fix: add warning if MISP module is enabled, but instance unreachable.
|
2021-01-29 16:33:56 +01:00 |
Raphaël Vinot
|
c358c08640
|
fix: Make mypy happy.
|
2021-01-28 19:28:54 +01:00 |
Raphaël Vinot
|
acfb0d1c26
|
new: Add push to MISP feature
|
2021-01-28 18:37:47 +01:00 |
Raphaël Vinot
|
d8d2c59f8b
|
chg: Make mypy happy.
|
2021-01-25 13:14:33 +01:00 |
Raphaël Vinot
|
f9d8081efa
|
fix: hidden view
|
2021-01-18 13:26:02 +01:00 |
Raphaël Vinot
|
8bd874e2b0
|
new: Add variable width thumbnail method
|
2021-01-18 12:30:07 +01:00 |
Raphaël Vinot
|
72463cc898
|
chg: Slight cleanups and improvments
|
2021-01-14 17:28:59 +01:00 |
Raphaël Vinot
|
6149df06eb
|
chg: Make the cache entries a dataclass
Fix #99
|
2021-01-14 17:12:23 +01:00 |
Raphaël Vinot
|
61baab1fbe
|
fix: make mypy happy
|
2021-01-13 15:16:36 +01:00 |
Raphaël Vinot
|
4686b560dc
|
chg: Better handling of insanely long webpages.
|
2021-01-13 14:33:20 +01:00 |
Raphaël Vinot
|
0d68844c90
|
chg: Refactoring and documenting
|
2021-01-12 17:22:51 +01:00 |
Raphaël Vinot
|
33326c2463
|
new: Extract URLs from rendered pages
|
2021-01-08 13:03:23 +01:00 |
Raphaël Vinot
|
2e0671fd96
|
fix: Properly handle new year in week stats
|
2021-01-04 12:34:00 +01:00 |
Raphaël Vinot
|
7241ae2ea1
|
fix: Do not fail on MISP export if there are no redirects
|
2020-12-24 15:43:56 +01:00 |
Raphaël Vinot
|
9b18370fe1
|
fix: Properly generate meta keys related to the User Agents
|
2020-12-22 19:16:46 +01:00 |
Raphaël Vinot
|
fcae1d42d0
|
new: Show images in tooltip in hostnode popup
|
2020-12-22 18:23:39 +01:00 |
Raphaël Vinot
|
62cb5a9eb7
|
fix: Failure on new install
|
2020-12-11 10:26:42 +01:00 |
Raphaël Vinot
|
ed6a53d211
|
chg: small visual improvments
|
2020-12-09 21:08:34 +01:00 |
Raphaël Vinot
|
3c6eca3567
|
new: Add screenshot thumbnail on tree, move links to the end of the node
|
2020-12-09 19:11:19 +01:00 |
Raphaël Vinot
|
b73a3b7533
|
chg: Add attachements to MISP export
|
2020-12-08 14:59:34 +01:00 |
Raphaël Vinot
|
fbbfa3082d
|
chg: Fix typing
|
2020-12-07 20:54:33 +01:00 |
Raphaël Vinot
|
8eab287721
|
new: Initial implementation of MISP export
|
2020-12-07 20:50:46 +01:00 |
Raphaël Vinot
|
9b3d338d3c
|
chg: Rename analisys->submission, add unique urls on stats graph
|
2020-12-07 13:55:03 +01:00 |
Raphaël Vinot
|
7bba854e0a
|
fix: Properly call logger
|
2020-12-04 01:33:58 +01:00 |
Raphaël Vinot
|
5897f8024d
|
chg: Do not fail when sanejs is too slow to answer
|
2020-12-04 00:31:53 +01:00 |
Raphaël Vinot
|
d353463548
|
chg: Simplify modules activation
|
2020-12-03 12:33:35 +01:00 |
Raphaël Vinot
|
820c7c5a4d
|
fix: remove broken pickles if needed
|
2020-12-01 17:00:44 +01:00 |
Raphaël Vinot
|
1a7a74cccd
|
chg: Cleanup stats page
|
2020-11-27 16:27:29 +01:00 |
Fafner [_KeyZee_]
|
0e3d007bf5
|
fixing typo (again)
|
2020-11-25 12:22:45 +01:00 |
Fafner [_KeyZee_]
|
7bf13db3f2
|
fixing ttypo
|
2020-11-25 12:05:08 +01:00 |
Raphaël Vinot
|
d964549e56
|
fix: Typing, dump to json
|
2020-11-24 21:01:30 +01:00 |
Fafner [_KeyZee_]
|
d77dfb1cac
|
updating output for stats
|
2020-11-24 18:55:13 +01:00 |
Raphaël Vinot
|
c54d29601d
|
chg: Fix typing
|
2020-11-24 18:19:53 +01:00 |
Fafner [_KeyZee_]
|
bedbb8eb45
|
adding get_stats()
|
2020-11-24 16:46:01 +01:00 |
Fafner [_KeyZee_]
|
2ae7d87420
|
Adding uniq_domains
|
2020-11-24 16:44:43 +01:00 |
Raphaël Vinot
|
9c382890f5
|
fix: Improve lokking on error in capture
|
2020-11-10 20:27:01 +01:00 |
Raphaël Vinot
|
354f269218
|
new: Integrate categorization in indexing
|
2020-11-09 16:02:54 +01:00 |
Raphaël Vinot
|
9243f84295
|
fix: No exception if body_hash is not indexed
|
2020-11-06 15:59:13 +01:00 |
Raphaël Vinot
|
99c939fd7f
|
chg: Rename scrape -> capture everywhere
Related to #118
|
2020-11-03 16:34:52 +01:00 |
Raphaël Vinot
|
69d34b803c
|
fix: Duplicates on index.
|
2020-11-03 12:21:14 +01:00 |
Raphaël Vinot
|
8b1e3585ea
|
chg: Improve initial caching.
|
2020-10-29 23:25:20 +01:00 |
Raphaël Vinot
|
69f65c9a87
|
chg: Update cache on tree visualization
|
2020-10-29 17:55:43 +01:00 |
Raphaël Vinot
|
5f4a97e11b
|
fix: Typing meta
|
2020-10-29 14:19:17 +01:00 |
Raphaël Vinot
|
06a4c2cc87
|
fix: Speedup sorted cache
|
2020-10-29 14:06:38 +01:00 |
Raphaël Vinot
|
da85aa0fb7
|
fix: Pre-sort entries on index
|
2020-10-29 13:29:13 +01:00 |
Raphaël Vinot
|
2802cfd46c
|
new: Add captures categorization
|
2020-10-28 18:49:15 +01:00 |
Raphaël Vinot
|
451553e60d
|
fix: Do not overwrite the urlnodes
|
2020-10-27 01:52:28 +01:00 |
Raphaël Vinot
|
068c92d5a4
|
new: API to query hostnames
|
2020-10-27 01:42:00 +01:00 |
Raphaël Vinot
|
39f88e9121
|
new: API to query URLs
|
2020-10-27 00:02:18 +01:00 |
Raphaël Vinot
|
bdc0488e38
|
new: Hash lookup method
|
2020-10-23 20:51:15 +02:00 |
Raphaël Vinot
|
c6c4da981c
|
chg: Improve start/stop
|
2020-10-22 16:41:00 +02:00 |
Raphaël Vinot
|
f062895801
|
fix: Add max size to lru_cache
|
2020-10-13 13:03:57 +02:00 |
Raphaël Vinot
|
4f52804361
|
chg: Make new version of mypy happy
|
2020-10-12 12:15:07 +02:00 |
Raphaël Vinot
|
90a9ff9bb5
|
chg: Refactoring, add get_hashes
|
2020-10-09 18:05:25 +02:00 |
Raphaël Vinot
|
be2cd18d2b
|
chg: Cleanup mypy config
|
2020-10-01 11:48:00 +02:00 |
Raphaël Vinot
|
9ce06b8821
|
chg: Add resolved IP on hostnode page
|
2020-09-29 14:24:18 +02:00 |
Raphaël Vinot
|
ef6eb1c253
|
new: Initial support for CNAME lookups
|
2020-09-25 17:23:10 +02:00 |
Raphaël Vinot
|
3ce4f85118
|
fix: Avoid 500 when sanejs is unreachable
|
2020-09-25 12:02:40 +02:00 |
Raphaël Vinot
|
9663c5de87
|
fix: Properly load the config files when needed.
|
2020-09-21 16:54:07 +02:00 |
Raphaël Vinot
|
a7ecaee8c4
|
chg: If apikey is None in the modules, break immediately.
|
2020-09-21 16:47:49 +02:00 |
Raphaël Vinot
|
7a34095d9c
|
new: Config option for Flask IP and Port, reorganize config loading
|
2020-09-21 16:41:30 +02:00 |
Raphaël Vinot
|
b06f02e101
|
new: Expose rendered content on hostnode page
|
2020-09-09 15:04:21 +02:00 |
Raphaël Vinot
|
2b237a7416
|
new: Use rendered HTML
|
2020-09-08 19:18:55 +02:00 |
Raphaël Vinot
|
457829a23f
|
chg: cleanup and improve views
|
2020-09-04 18:40:51 +02:00 |
Raphaël Vinot
|
9f4c77d5d2
|
chg: Cleanups, allow to add context from ressources page
|
2020-09-03 16:32:53 +02:00 |
Raphaël Vinot
|
407a9a5511
|
new: Download ressource from ressources page
|
2020-09-03 14:39:38 +02:00 |
Raphaël Vinot
|
6d22085ceb
|
fix: do not crash on empty malicious file
|
2020-09-01 18:39:49 +02:00 |
Raphaël Vinot
|
ecbbceb781
|
fix: Typing
|
2020-09-01 17:54:54 +02:00 |
Raphaël Vinot
|
b16a5768ea
|
chg: Refactoring and normalizing the known hashes lookups
|
2020-09-01 17:33:36 +02:00 |
Raphaël Vinot
|
aee62136ab
|
fix: cache unknown hashes in sanejs
|
2020-09-01 00:51:44 +02:00 |
Raphaël Vinot
|
4a9a50e289
|
chg: Add icon for hostnodes with empty content.
|
2020-08-31 15:21:41 +02:00 |
Raphaël Vinot
|
a5c210a5de
|
new: Add checkmark for legitimate nodes.
|
2020-08-28 19:11:19 +02:00 |
Raphaël Vinot
|
6866b49c87
|
chg: Add support for legitimate content context
|
2020-08-28 18:24:14 +02:00 |
Raphaël Vinot
|
97b5b2d77f
|
chg: Working prototype for user-defined context
|
2020-08-28 18:03:52 +02:00 |
Raphaël Vinot
|
611b2a8ff5
|
fix: Crash if there are no ressources
|
2020-08-27 16:15:07 +02:00 |
Raphaël Vinot
|
9eb08beb3c
|
chg: Add load/dump of known legit captures
|
2020-08-27 15:48:56 +02:00 |
Raphaël Vinot
|
60b767d08f
|
chg: Normalize ressources details display, refactoring
|
2020-08-27 12:57:10 +02:00 |
Raphaël Vinot
|
11598fc3ba
|
chg: Major refactoring of the contextualization of the body contents
|
2020-08-26 16:52:59 +02:00 |
Raphaël Vinot
|
1b0cdde84e
|
chg: Normalize known content lookup
|
2020-08-25 18:00:16 +02:00 |
Raphaël Vinot
|
4d6237aae5
|
fix: Make mypy happy
|
2020-08-25 15:52:54 +02:00 |
Raphaël Vinot
|
c75b9e65fe
|
chg: Remove known content from SaneJS module
|
2020-08-25 15:51:08 +02:00 |
Raphaël Vinot
|
bdb726ca9e
|
new: Add malicious listing on hostnode
|
2020-08-24 15:31:53 +02:00 |
Raphaël Vinot
|
c5aabcf4a3
|
new: Initial commit to mark body responses as legitimate/malicious
|
2020-08-20 19:39:03 +02:00 |
Raphaël Vinot
|
fa57435433
|
chg: Sanity check in email send
|
2020-08-20 15:05:27 +02:00 |
Raphaël Vinot
|
339d0dd7e0
|
fix: Make mypy happy
|
2020-08-10 20:11:26 +02:00 |
Raphaël Vinot
|
83d8f49be9
|
fix: Missing change for last commit
|
2020-08-10 20:05:47 +02:00 |
Raphaël Vinot
|
2873773ee7
|
new: trigger to hide a capture from the front page (admin only)
|
2020-08-10 12:35:16 +02:00 |
Raphaël Vinot
|
f17acbce60
|
fix: Referer cannot be None
|
2020-07-20 23:04:11 +02:00 |
Raphaël Vinot
|
1c5f4f5710
|
fix: Do not index private captures on public instance
|
2020-07-20 13:39:08 +02:00 |
Raphaël Vinot
|
c7db7829a7
|
chg: More macros
|
2020-07-15 18:04:34 +02:00 |
Raphaël Vinot
|
0468317a20
|
chg: Improve rendering, bump deps.
|
2020-07-15 01:35:55 +02:00 |
Raphaël Vinot
|
89725b8ed0
|
new: Download embedded resource
|
2020-07-11 02:10:56 +02:00 |
Raphaël Vinot
|
e5e4e4972e
|
new: Add visualisation for embedded resources.
|
2020-07-10 18:57:16 +02:00 |
Raphaël Vinot
|
db0d5b3f2d
|
chg: Remove unused parameter.
|
2020-07-08 15:52:26 +02:00 |
Raphaël Vinot
|
0c5501016c
|
fix: Rebuild caches when tree doesn't exists
|
2020-07-08 15:52:26 +02:00 |
Raphaël Vinot
|
23419a31b9
|
fix: cleanup
|
2020-07-08 15:52:26 +02:00 |
Raphaël Vinot
|
4851436999
|
chg: More improvements in body hash display
|
2020-07-08 15:51:45 +02:00 |
Raphaël Vinot
|
bfa39223c8
|
chg: Improve hash lookup rendering
|
2020-07-08 15:51:45 +02:00 |
Raphaël Vinot
|
34a5dff055
|
chg: Refactoring, use capture UUID insted of path as reference for public methods
|
2020-07-08 15:51:45 +02:00 |
Raphaël Vinot
|
95a08f5655
|
fix: Make mypy happy
|
2020-07-08 15:51:45 +02:00 |
Raphaël Vinot
|
a4bc2b2818
|
new: Improve hostnode popup, center tree on node
|
2020-07-08 15:51:45 +02:00 |
Raphaël Vinot
|
29c78d3485
|
chg: Cleanup and improve index rendering
|
2020-07-08 15:51:45 +02:00 |
Raphaël Vinot
|
7772706262
|
new: Display body hashes matches on hostnode page
|
2020-07-08 15:51:01 +02:00 |
Raphaël Vinot
|
6e13622d88
|
fix: Typing
|
2020-07-08 15:51:01 +02:00 |
Raphaël Vinot
|
6bb26c4358
|
new: Initial support for body hashes index
|
2020-07-08 15:51:01 +02:00 |
Raphaël Vinot
|
e6aded6c12
|
chg: Add domains aggregation by cookies names
|
2020-07-08 15:51:01 +02:00 |
Raphaël Vinot
|
67b41ca8fb
|
chg: Improve intergration of cookies indexing
|
2020-07-08 15:51:01 +02:00 |
Raphaël Vinot
|
e6c9f6dada
|
new: Add capture meta on the related cookies page
|
2020-07-08 15:42:13 +02:00 |
Raphaël Vinot
|
5ae7f0f7e4
|
new: Initial version of cookies indexing
|
2020-07-08 15:42:13 +02:00 |
Raphaël Vinot
|
d18f5f4f88
|
fix: Docker, capture form, error message.
|
2020-07-08 02:25:15 +02:00 |
Raphaël Vinot
|
33fb74ae83
|
new: Add referer to initial URL
|
2020-07-08 00:37:29 +02:00 |
Raphaël Vinot
|
4cfe91392a
|
chg: Docker, default to env variable for splash URL
|
2020-07-07 13:51:09 +02:00 |
Raphaël Vinot
|
316338a213
|
chg: Better error handling
|
2020-07-06 15:33:00 +02:00 |
Raphaël Vinot
|
605dc00989
|
fix: Properly handle json dumps
|
2020-07-06 14:16:17 +02:00 |
Raphaël Vinot
|
1d77a2001e
|
chg: Bump deps, improve error handling
|
2020-07-03 18:25:16 +02:00 |
Raphaël Vinot
|
41acc544ef
|
chg: depth from UI is a string...
|
2020-06-29 19:23:16 +02:00 |
Raphaël Vinot
|
ce6deabdad
|
fix: convert max_depth from config to int
|
2020-06-29 19:21:38 +02:00 |
Raphaël Vinot
|
afe95c28f6
|
new: Add max depth for scraping.
|
2020-06-29 18:00:56 +02:00 |
Raphaël Vinot
|
05de56022f
|
chg: Use capture UUID as a reference everywhere
|
2020-06-29 12:01:31 +02:00 |
Raphaël Vinot
|
98495c40a9
|
chg: Make mypy happy
|
2020-06-25 17:08:11 +02:00 |
Raphaël Vinot
|
b818055f32
|
fix: Skip unparsable UAs
|
2020-06-25 16:50:57 +02:00 |
Raphaël Vinot
|
cde3d29892
|
new: Add option to use User agents of the Lookyloo users for scraping
|
2020-06-25 16:43:58 +02:00 |
Raphaël Vinot
|
f4bf64a485
|
fix: Do not fail if the meta file is missing.
|
2020-06-24 11:49:10 +02:00 |
Raphaël Vinot
|
6871912e64
|
chg: Expose the picklized tree in lookyloo
|
2020-06-12 11:18:54 +02:00 |
Raphaël Vinot
|
9873d3ebc3
|
fix: Incorrect typing
|
2020-06-11 15:32:43 +02:00 |
Raphaël Vinot
|
1c408af3b0
|
chg: Improve cookies in hostnode view
|
2020-06-11 15:13:31 +02:00 |
Raphaël Vinot
|
0ed7dbb5cb
|
chg: Cleanup deps, use tagged versions
|
2020-06-10 18:41:03 +02:00 |
Raphaël Vinot
|
285a0cf727
|
new: Phishing Initiative module
|
2020-06-09 15:06:35 +02:00 |
Raphaël Vinot
|
6a8bafd9dc
|
chg: Cleanup, move to Lookyloo organization
|
2020-06-08 16:37:59 +02:00 |
Raphaël Vinot
|
0751321e9b
|
new: Cookies investigation
|
2020-06-04 18:23:36 +02:00 |
Raphaël Vinot
|
bed6b4e39e
|
chg: Add initial URL in email notification
|
2020-05-27 15:39:06 +02:00 |
Raphaël Vinot
|
5ebb35c161
|
new: Add redirects in notifications, optional reply-to
|
2020-05-27 15:15:45 +02:00 |
Raphaël Vinot
|
3a3be0cb46
|
new: Add handles for cookies
|
2020-05-26 17:45:04 +02:00 |
Raphaël Vinot
|
5baab51951
|
fix: Proper fallback for the user agent.
|
2020-05-24 15:35:30 +02:00 |
Raphaël Vinot
|
ea1df97524
|
chg: Add 1px files
|
2020-05-24 03:26:16 +02:00 |
Raphaël Vinot
|
16c2f63cac
|
chg: Bump dependencies
|
2020-05-24 01:56:42 +02:00 |
Raphaël Vinot
|
876352c2f7
|
chg: Improve pop-up, cleanup old code.
|
2020-05-23 03:37:24 +02:00 |
Raphaël Vinot
|
d04db67d2d
|
Improve hostname popup
|
2020-05-22 17:36:22 +02:00 |
Raphaël Vinot
|
83aef5d680
|
chg: Fix typing
|
2020-05-21 23:46:35 +02:00 |
Raphaël Vinot
|
3b631f2c92
|
chg: Improve popup, remove session.
|
2020-05-20 19:11:15 +02:00 |
Raphaël Vinot
|
c3bf87beca
|
chg: Improve popup, make sanejs a module, cache
|
2020-05-19 17:47:55 +02:00 |
Raphaël Vinot
|
466cb5fcd5
|
chg: Improve typing
|
2020-05-18 18:32:59 +02:00 |
Raphaël Vinot
|
1882c9d71a
|
fix: Please mypy
|
2020-05-15 11:39:16 +02:00 |
Raphaël Vinot
|
d3971cc47c
|
new: Add stats
|
2020-05-13 17:31:27 +02:00 |
Raphaël Vinot
|
cd972076b5
|
new: Add url to do a full export, and get the page
|
2020-05-12 16:53:10 +02:00 |
Raphaël Vinot
|
754ae9354d
|
new: Add email notification feature
|
2020-05-11 19:01:06 +02:00 |
Raphaël Vinot
|
70c642b0f6
|
fix: Do not display the full path to the capture
|
2020-05-07 15:46:45 +02:00 |
Raphaël Vinot
|
487222b81e
|
fix: Do not fail when getting the UA breaks
|
2020-05-02 01:41:29 +02:00 |
Raphaël Vinot
|
996bd74e30
|
fix: Missing f-string
|
2020-04-24 15:57:16 +02:00 |
Raphaël Vinot
|
ae49fd2c11
|
new: Add support to pass more parameters via the API
|
2020-04-21 18:41:57 +02:00 |
Raphaël Vinot
|
b1034739ad
|
chg: Fix mypy, bump deps
|
2020-04-20 16:52:46 +02:00 |
Raphaël Vinot
|
a0c906d3dc
|
new: Initial view for 3rd party modules
|
2020-04-20 16:41:42 +02:00 |
Raphaël Vinot
|
de7f50c3b0
|
chg: Improve logging
|
2020-04-03 17:51:58 +02:00 |
Raphaël Vinot
|
1c2cdad38b
|
new: Allow admin to rebuild cache
|
2020-04-01 17:44:06 +02:00 |
Raphaël Vinot
|
e62d56e555
|
chg: Bump har2tree, cleanup
|
2020-04-01 14:33:35 +02:00 |
Raphaël Vinot
|
17c3473d95
|
new: Add config files, initial support for 3rd party modules
|
2020-03-31 14:12:57 +02:00 |
Raphaël Vinot
|
c322bc1b23
|
fix: Pass proper path to the pickled dump
|
2020-03-26 14:55:01 +01:00 |
Raphaël Vinot
|
949ad58667
|
chg: Refactoring of the redirects, rename report -> capture
|
2020-03-26 01:56:24 +01:00 |
Raphaël Vinot
|
f26a02ef86
|
new: Add link redirects on index
|
2020-03-23 12:45:57 +01:00 |
Raphaël Vinot
|
c97537fbe9
|
fix: Strip tabs/spaces around URL
|
2020-03-19 14:05:19 +01:00 |
Raphaël Vinot
|
1fd48df470
|
fix: Refang the URL at the right place
|
2020-03-19 11:05:29 +01:00 |
Raphaël Vinot
|
971877954e
|
new: Add support for last redirect
|
2020-03-18 21:14:48 +01:00 |
Fafner [_KeyZee_]
|
3a8b7e6077
|
Fixing Unknown domain if only_global_lookups is set
|
2020-03-17 16:32:39 +01:00 |
Fafner [_KeyZee_]
|
5c5577b97d
|
Fixing Unknown domain if only_global_lookups is set
|
2020-03-17 16:26:31 +01:00 |
Raphaël Vinot
|
9aa995092e
|
chg: Improve error notification
|
2020-03-17 15:27:04 +01:00 |
Raphaël Vinot
|
af98c2b075
|
chg: Better handling of error messages, display them.
|
2020-03-17 14:17:18 +01:00 |
Raphaël Vinot
|
75cb4d3246
|
new: refang urls when needed
|
2020-03-16 13:51:21 +01:00 |
Raphaël Vinot
|
9b4bbb2450
|
fix: Missing cast
|
2020-02-16 23:51:04 +01:00 |
Raphaël Vinot
|
7d2f50174d
|
chg: Bump dependencies, Improve HTTP errors handling
Fix https://github.com/CIRCL/lookyloo/issues/66
|
2020-02-16 23:38:42 +01:00 |
Raphaël Vinot
|
09b3b16910
|
fix: Properly check keys in cache
|
2020-02-11 17:26:01 +01:00 |
Raphaël Vinot
|
794d9745ab
|
fix: wrong variable in last commit
|
2020-02-11 17:09:15 +01:00 |
Raphaël Vinot
|
e7b97d23b7
|
fix: Better handling of cache issues
|
2020-02-11 17:03:25 +01:00 |
Raphaël Vinot
|
4234e44470
|
new: Add initial redirects columns
|
2020-02-03 22:25:48 +01:00 |
Raphaël Vinot
|
89edef68ab
|
new: Improve index
|
2020-02-03 18:30:41 +01:00 |
Raphaël Vinot
|
c9cbf27acc
|
chg: Fix typing
|
2020-01-24 11:25:53 +01:00 |
Raphaël Vinot
|
f1309ce5e3
|
new: Upload optional cookie file
|
2020-01-24 10:17:41 +01:00 |
Raphaël Vinot
|
f1d83d29cf
|
new: Add support for user defined cookies, bump deps
|
2020-01-23 10:52:50 +01:00 |
Raphaël Vinot
|
d34233ad5c
|
chg: Use poetry instead of pipenv
|
2020-01-21 17:39:18 +01:00 |
Raphaël Vinot
|
2d82303ef6
|
chg: Support cookies from/to splash (no UI yet)
|
2020-01-21 11:47:36 +01:00 |
Raphaël Vinot
|
0aaa814224
|
new: Initial commit for cookies tracking. No update on the view yet.
|
2020-01-10 17:28:15 +01:00 |
Raphaël Vinot
|
dec6920cb8
|
chg: Add typing
|
2020-01-06 15:32:38 +01:00 |
Raphaël Vinot
|
5cfe5306b2
|
fix: Skip UA fetch on cloudflare website until the lib is updated
|
2019-12-17 14:29:58 +01:00 |
Raphaël Vinot
|
4c86b65c56
|
fix: Avoid bypass with "http://user:pwd@host.tld"
|
2019-07-05 18:42:18 +02:00 |
Raphaël Vinot
|
a6693535de
|
fix: Allow to disable scraping private IPs.
|
2019-07-05 16:27:23 +02:00 |
Raphaël Vinot
|
8165913206
|
fix: Initialize cache only once
|
2019-06-25 18:08:52 +02:00 |
Raphaël Vinot
|
320105aca1
|
fix: Get most common user agents from willshouse.com behind cloudflare
|
2019-05-27 15:34:26 +02:00 |
Raphaël Vinot
|
66545c26a5
|
new: keep track of metadata about OS and Browser when scraping
|
2019-04-07 23:54:16 +02:00 |
Raphaël Vinot
|
12b8e4f949
|
chg: Improve async processing
|
2019-04-05 16:12:54 +02:00 |
Raphaël Vinot
|
da3d1fe392
|
fix: Avoid loading the cache multiple times
|
2019-04-05 15:07:22 +02:00 |
Raphaël Vinot
|
6b10e74470
|
fix: do not initialize the redis cache more than once.
|
2019-04-05 14:48:25 +02:00 |
Raphaël Vinot
|
0d937b02c9
|
fix: Properly remove files if the scraping failed
|
2019-04-04 00:41:15 +02:00 |
Raphaël Vinot
|
36c856ef9b
|
new: Add initial support for user-agent
|
2019-03-29 20:11:44 +01:00 |
Raphaël Vinot
|
49654b6b11
|
fix: Automatically remove failed runs.
|
2019-03-27 10:21:37 +01:00 |
Raphaël Vinot
|
fdcc566e05
|
chg: Slight cleanup
|
2019-02-18 14:29:15 +01:00 |
Raphaël Vinot
|
747ce7e52d
|
Merge branch 'anonyme' of https://github.com/Th4nat0s/lookyloo into Th4nat0s-anonyme
|
2019-02-18 13:53:04 +01:00 |
Raphaël Vinot
|
9f2b7f7b93
|
new: Add error page
|
2019-02-18 13:52:48 +01:00 |
Th4nat0s
|
8afcc30840
|
clarifie index enable/disable
|
2019-02-17 21:45:23 +00:00 |
thanat0s
|
f029b5d324
|
Add noindex button
|
2019-02-17 17:43:25 +00:00 |
Raphaël Vinot
|
189b78e20f
|
chg: pre-load the existing reports
|
2019-02-01 16:11:16 +01:00 |
Raphaël Vinot
|
1d244ef456
|
chg: Refactor code organisation
|
2019-01-30 14:30:01 +01:00 |
Raphaël Vinot
|
e5de1a9958
|
fix: Make sure sanejs is optional
|
2019-01-30 13:14:16 +01:00 |
Raphaël Vinot
|
6bc316ebcf
|
new: Initial commit for client and async scraping
|
2019-01-29 18:37:13 +01:00 |
Raphaël Vinot
|
e14a0150a0
|
chg: Assign a UUID for each scraped page, allow permalinks
|
2019-01-29 11:42:56 +01:00 |
Raphaël Vinot
|
945511d6b3
|
chg: Use PySaneJS to query SaneJS
|
2019-01-27 17:17:31 +01:00 |
Raphaël Vinot
|
bbb8c5343f
|
chg: Cleanup, use pipfile
|
2019-01-23 15:13:29 +01:00 |
Raphaël Vinot
|
2825096dc7
|
fix: Do not fail if SaneJS is not available
|
2018-07-20 11:36:54 +02:00 |
Raphaël Vinot
|
3c9b28b704
|
new: Add integration with SaneJS
|
2018-07-19 18:18:22 +02:00 |
Raphaël Vinot
|
5202630278
|
fix: Improve URL overlay
|
2018-06-29 14:03:52 +08:00 |
Raphaël Vinot
|
c8fb313d28
|
new: Download screenshot of the page.
|
2018-05-10 09:48:48 +02:00 |
Raphaël Vinot
|
6329e7747f
|
fix: Wrong URL path
|
2018-04-09 11:16:22 +02:00 |
Raphaël Vinot
|
f6345e47e1
|
new: allow to download the URLs list in a text file
|
2018-04-06 18:06:41 +02:00 |
Raphaël Vinot
|
d7cf92db21
|
new: Close button for the overlays
|
2018-04-05 22:59:45 +02:00 |
Raphaël Vinot
|
72759850ac
|
chg: Use d3v5, cleanup.
|
2018-04-05 11:17:26 +02:00 |
Raphaël Vinot
|
fb195971e8
|
chg: use pathlib everywhere, remove old tmpfiles
|
2018-03-22 18:33:42 +01:00 |
Raphaël Vinot
|
247a4a26b0
|
chg: Change cookie name, update legend, remove old pickled trees
Fix #18
|
2018-03-22 17:22:19 +01:00 |
Raphaël Vinot
|
32ba719d5c
|
new: Add Icons
|
2018-03-15 09:33:38 +01:00 |
Raphaël Vinot
|
22f1474120
|
new: Link to URL overlay
|
2018-02-23 18:45:12 +01:00 |
Raphaël Vinot
|
510c35b57f
|
chg: Store iframe info and PNG
|
2018-02-09 18:30:19 +01:00 |
Raphaël Vinot
|
92ffd1b7da
|
new: Allow to download the bodies
|
2018-02-06 01:23:00 +01:00 |
Raphaël Vinot
|
f3ee006047
|
new: Generic generator for icon list
|
2018-02-01 23:58:26 +01:00 |
Raphaël Vinot
|
6f31c2bce0
|
chg: make methods.
|
2018-02-01 01:16:20 +01:00 |
Raphaël Vinot
|
8955c9c7f7
|
chg: Slight refactoring
|
2018-01-30 15:41:35 +01:00 |
Raphaël Vinot
|
40569a3a73
|
new: Improve the URL box.
Remove all tabs.
|
2018-01-22 10:49:45 +01:00 |
Raphaël Vinot
|
34c1be7695
|
Get ready for building URL tree.
|
2018-01-16 18:06:43 +01:00 |
Raphaël Vinot
|
ab37ced391
|
chg: Dragable box for URLs of a domain
|
2018-01-16 17:48:11 +01:00 |
Raphaël Vinot
|
19b0cb25f8
|
up: UI improvments
|
2017-10-10 11:16:16 +02:00 |
Raphaël Vinot
|
629370fc74
|
Cleanup
|
2017-10-05 17:38:35 +02:00 |
Raphaël Vinot
|
8b353e3e76
|
Properly use click event
|
2017-10-04 17:09:00 +02:00 |
Raphaël Vinot
|
5102546789
|
Cleanup, set favicon
|
2017-10-04 16:39:03 +02:00 |
Raphaël Vinot
|
0ac38a0f2c
|
Add tooltip for URLs
|
2017-10-04 15:13:42 +02:00 |
Raphaël Vinot
|
85b8fd2c0a
|
Cleanup and improve tree view
|
2017-09-29 17:30:01 +02:00 |
Raphaël Vinot
|
2b9213eb1f
|
Only import tree.js in the tree view page
|
2017-09-29 14:48:37 +02:00 |
Raphaël Vinot
|
8d9122b36c
|
Make the svg size generic.
|
2017-09-29 14:43:40 +02:00 |
Raphaël Vinot
|
b9c3d0b276
|
Add favicon
|
2017-09-29 14:43:08 +02:00 |
Raphaël Vinot
|
9cb772eb79
|
Add infoboxes on the tree view
|
2017-09-25 14:11:01 +01:00 |
Raphaël Vinot
|
6900e08dc4
|
Make the node length dynamic
|
2017-09-25 11:13:45 +01:00 |
Raphaël Vinot
|
17e6b6cce5
|
Add background pattern
|
2017-09-25 10:23:32 +01:00 |
Raphaël Vinot
|
d22b6a9312
|
Initial commit
|
2017-09-23 23:54:38 +01:00 |
Raphaël Vinot
|
2755855c43
|
Reverse order index page
|
2017-09-13 09:38:25 +02:00 |
Raphaël Vinot
|
9e207290eb
|
Fix template
|
2017-09-07 16:22:16 +02:00 |
Raphaël Vinot
|
7f6902d910
|
Fix last commit
|
2017-09-07 13:44:32 +02:00 |