Commit Graph

182 Commits (eb7b8232e5228cf4fe6653d568485c791adea930)

Author SHA1 Message Date
Raphaël Vinot eb7b8232e5 chg: Bump dependencies 2020-02-03 18:20:25 +01:00
Raphaël Vinot 38fc42bdc7 chg: Bump dependencies 2020-01-30 14:17:07 +01:00
Raphaël Vinot c9cbf27acc chg: Fix typing 2020-01-24 11:25:53 +01:00
Raphaël Vinot f1309ce5e3 new: Upload optional cookie file 2020-01-24 10:17:41 +01:00
Raphaël Vinot 8e5d254caa chg: Bump readme 2020-01-23 15:03:36 +01:00
Raphaël Vinot e8dd279bd3 chg: Bump dependencies 2020-01-23 11:40:45 +01:00
Raphaël Vinot ba8574ff83 chg: Do not use eventlet/gevent anymore. 2020-01-23 11:32:36 +01:00
Raphaël Vinot 936f000586 chg: Bump har2tree 2020-01-23 11:04:59 +01:00
Raphaël Vinot f1d83d29cf new: Add support for user defined cookies, bump deps 2020-01-23 10:52:50 +01:00
Raphaël Vinot 32a07fc355 chg: Remove extra dependency 2020-01-21 18:00:25 +01:00
Raphaël Vinot 71aa1a4a97 chg: Bump dependencies 2020-01-21 17:55:29 +01:00
Raphaël Vinot b26e35e5f0 fix: Allow pylookyloo on Python 3.6 2020-01-21 17:50:24 +01:00
Raphaël Vinot 5566443888 fix: Missing dep in the docker image 2020-01-21 17:47:50 +01:00
Raphaël Vinot 94495afefb fix: Allow python 3.6 2020-01-21 17:44:47 +01:00
Raphaël Vinot d34233ad5c chg: Use poetry instead of pipenv 2020-01-21 17:39:18 +01:00
Raphaël Vinot 2d82303ef6 chg: Support cookies from/to splash (no UI yet) 2020-01-21 11:47:36 +01:00
Raphaël Vinot 9d33977d01 chg: Pipenv isn't compatible with Python 3.9 on travis 2020-01-13 10:20:41 +01:00
Raphaël Vinot 0aaa814224 new: Initial commit for cookies tracking. No update on the view yet. 2020-01-10 17:28:15 +01:00
Raphaël Vinot 662bca6ed0 fix: Properly display icons in URL view 2020-01-06 19:28:48 +01:00
Raphaël Vinot dec6920cb8 chg: Add typing 2020-01-06 15:32:38 +01:00
Raphaël Vinot 5cfe5306b2 fix: Skip UA fetch on cloudflare website until the lib is updated 2019-12-17 14:29:58 +01:00
Raphaël Vinot d6e1afae35 chg: Bump dependencies 2019-12-17 11:36:47 +01:00
Raphaël Vinot 200565f366
Create dockerimage.yml 2019-11-15 16:51:37 +01:00
Raphaël Vinot a648c997c7 chg: Bump dependencies
Note: Cannot use gunicorn 20 due to https://github.com/benoitc/gunicorn/issues/1925
2019-11-14 13:40:02 +01:00
Raphaël Vinot cfa300082f fix: docker-compose should now work. 2019-11-01 21:05:08 -07:00
Raphaël Vinot d83252930d chg: Bump dependencies 2019-10-29 15:07:15 +01:00
Raphaël Vinot 406973326b fix: Put redis dependency in a docker
Fix #57
2019-10-01 13:39:05 -07:00
Raphaël Vinot ba26056c6b chg: Bump dependencies 2019-10-01 13:16:40 -07:00
Raphaël Vinot d53c33533e chg: Bump dependencies 2019-08-28 15:35:06 +02:00
Raphaël Vinot 934324ed09 chg: Bump dependencies 2019-08-16 16:29:51 +02:00
Raphaël Vinot 4c86b65c56 fix: Avoid bypass with "http://user:pwd@host.tld" 2019-07-05 18:42:18 +02:00
Raphaël Vinot bbd573a69c chg: Update documentation 2019-07-05 16:59:23 +02:00
Raphaël Vinot 1dc71c4f0b fix: Allow to disable scraping private IPs (async module). 2019-07-05 16:37:57 +02:00
Raphaël Vinot a6693535de fix: Allow to disable scraping private IPs. 2019-07-05 16:27:23 +02:00
Raphaël Vinot 07d1636fdf fix: Properly pass OS, Browser, and User-Agent when scraping. 2019-07-05 15:44:52 +02:00
Raphaël Vinot 1af2aa88fa chg: Slight refactoring of the HTML views 2019-06-28 12:08:35 +02:00
Raphaël Vinot 957fc15e12 fix: Scrape page refactoring
Related #47
2019-06-28 11:59:39 +02:00
Raphaël Vinot 96d0723b17 chg: Improve scraping page
Related: #47
2019-06-27 17:47:25 +02:00
Raphaël Vinot 2a91111ac0 fix: Make orphan.url node non-clickable.
Fix #32
2019-06-27 16:15:53 +02:00
Raphaël Vinot f77f7188d1 chg: Add documentation for API 2019-06-26 17:38:07 +02:00
Raphaël Vinot d9cfb490a2 chg: Bump dependencies 2019-06-26 17:03:16 +02:00
Raphaël Vinot d57dc40e07 chg: Bump dependencies 2019-06-25 18:09:16 +02:00
Raphaël Vinot 8165913206 fix: Initialize cache only once 2019-06-25 18:08:52 +02:00
Raphaël Vinot 60d9038078 new: Mark all nodes with HTTP content 2019-06-25 16:49:15 +02:00
Raphaël Vinot 230b8e7842 chg: Bump dependencies 2019-06-25 16:48:02 +02:00
Raphaël Vinot 9fdd0d5782 new: Add warning when a node has mixed content. 2019-06-19 14:23:12 +01:00
Raphaël Vinot 23e3cc5d43 chg: Bump dependencies. 2019-06-17 18:14:01 +01:00
Raphaël Vinot 359418c254 chg: Add doc for aquarium 2019-06-06 15:35:24 +02:00
Raphaël Vinot 3f54a465fc chg: Update Readme 2019-05-27 15:36:49 +02:00
Raphaël Vinot 320105aca1 fix: Get most common user agents from willshouse.com behind cloudflare 2019-05-27 15:34:26 +02:00