Raphaël Vinot
|
6ba019ec83
|
chg: Improve somewhat the useragents available for capturing
Fix #416
|
2022-06-09 18:58:17 +02:00 |
Raphaël Vinot
|
1817a3e13b
|
chg: sunday cleanup
|
2022-05-23 00:15:52 +02:00 |
Raphaël Vinot
|
d222ae04aa
|
new: Keep capture even if we have a network error
|
2022-05-03 12:23:16 +02:00 |
Raphaël Vinot
|
463d1d2d1a
|
new: autosubmit to FOX, bump deps
|
2022-05-02 13:04:55 +02:00 |
Raphaël Vinot
|
1679ccf90f
|
chg: Improve capture, ignore ssl issues.
|
2022-04-26 13:49:24 +02:00 |
Raphaël Vinot
|
77fbf47e73
|
fix: capture cleanup
|
2022-04-26 10:25:11 +02:00 |
Raphaël Vinot
|
147bc65992
|
fix: Mypy, docker
|
2022-04-26 00:59:57 +02:00 |
Raphaël Vinot
|
41c7e87458
|
fix: docker, improve error catching
|
2022-04-26 00:33:50 +02:00 |
Raphaël Vinot
|
5af278f84d
|
fix: issue in playwrightcapture module
|
2022-04-25 15:20:05 +02:00 |
Raphaël Vinot
|
4ad898a375
|
chg: Use packaged playwright capture module
|
2022-04-25 13:34:01 +02:00 |
Raphaël Vinot
|
c93a6c307d
|
chg: properly set cookies
|
2022-04-24 20:17:54 +03:00 |
Raphaël Vinot
|
680eb1b309
|
fix: better handling if capture fails.
|
2022-04-21 15:48:28 +03:00 |
Raphaël Vinot
|
8d159ffba0
|
new: Switch away from splash to use playwright
|
2022-04-21 14:55:07 +03:00 |
Raphaël Vinot
|
cf46dde1ed
|
chg: Add basic pre-hook config
|
2022-03-31 11:30:53 +02:00 |
Raphaël Vinot
|
58b50f2b24
|
new: Pass optional arbitrary HTTP headers to capture
|
2021-11-23 12:59:56 -08:00 |
Raphaël Vinot
|
bfb1e6b181
|
fix: Use default_public for all capture, including if submitted via the API
|
2021-11-02 14:58:31 -07:00 |
Raphaël Vinot
|
1f998b457f
|
chg: use template
|
2021-10-18 13:06:43 +02:00 |
Raphaël Vinot
|
48fc807e7d
|
new: Add monitoring for pickle cache status
|
2021-09-24 12:02:28 +02:00 |
Raphaël Vinot
|
d1f673f3a7
|
chg: Cleanup passing listing key to and from bool in redis
|
2021-09-10 14:20:58 +02:00 |
Raphaël Vinot
|
9c7929569e
|
fix: The captures are visible on the index by default.
|
2021-09-08 20:43:56 +02:00 |
Raphaël Vinot
|
48b632aa1e
|
fix: Incorrect matching for listing key in capture (always false)
|
2021-09-08 10:53:31 +02:00 |
Raphaël Vinot
|
902c8f81b6
|
chg: Improve error message if the capture fails
Fix #257
|
2021-09-07 18:16:01 +02:00 |
Raphaël Vinot
|
dfbe40a52e
|
chg: reorder imports
|
2021-09-07 16:00:07 +02:00 |
Raphaël Vinot
|
c09adec333
|
chg: Improve logging.
|
2021-09-01 14:08:25 +02:00 |
Raphaël Vinot
|
797de9ddb3
|
fix: remove datefmt from logging.basicConfig, it was a bad idea.
|
2021-09-01 10:40:59 +02:00 |
Raphaël Vinot
|
8a51383d7a
|
chg: Move the process managment methods to the proper class
|
2021-08-27 17:28:26 +02:00 |
Raphaël Vinot
|
d41b7735dd
|
chg: Improve storage, support both modes.
|
2021-08-26 15:49:19 +02:00 |
Raphaël Vinot
|
407e78ae7f
|
chg: More cleanup, support clean shutdown of multiple async captures
|
2021-08-25 16:40:51 +02:00 |
Raphaël Vinot
|
bf700e7a7b
|
chg: Major refactoring, move capture code to external script.
|
2021-08-25 13:36:48 +02:00 |
Raphaël Vinot
|
f865ec912a
|
fix: Move set/unset running to abstract
Avoid issues when a script fails unexpectedly.
|
2021-04-09 14:33:42 +02:00 |
Raphaël Vinot
|
6059cb5219
|
chg: Remove useless code
|
2021-03-12 16:49:04 +01:00 |
Raphaël Vinot
|
ea052c7c12
|
fix: Rename scrape -> capture in async
|
2020-11-05 14:14:33 +01:00 |