Commit Graph

1340 Commits (fbeac2340d59ce37dab462d3f98f109360e7655b)

Author SHA1 Message Date
Terrtia fbeac2340d
chg: [UI crawler, show_domain] domain history: remove target blank 2019-06-18 11:01:54 +02:00
Terrtia e1bf59aded
chg: [UI crawler, show_domain] add domain history list + navigation 2019-06-18 10:58:37 +02:00
Terrtia 5183a3492a
chg: [UI crawled domains] Download all domain content (HTML + HAR + screenshot) 2019-06-12 10:58:13 +02:00
Terrtia 2b6cb86d55
fix: [PgpDump] catch UnicodeDecodeError error 2019-06-12 10:33:40 +02:00
Terrtia e71daac7d2
fix: [backend crawler] rename downloaded archive 2019-06-07 13:53:33 +02:00
Terrtia b4f06c21f9
chg: [backend crawler] domains: download 1 archive by crawled (most recent) 2019-06-07 13:47:44 +02:00
Terrtia 0d3d4aae1d
fix: [paste_submit UI] filter empty file field 2019-06-05 16:41:59 +02:00
Terrtia 601ea8f13e
chg: [paste_submit UI] add debug 2019-06-05 16:31:35 +02:00
Terrtia 17af705231
fix: [PgpDump] process large pgp blocks 2019-06-05 16:20:26 +02:00
Terrtia 1929b2c6a7
fix: [paste_submit UI] filter empty file field 2019-06-05 16:18:30 +02:00
Terrtia 9cb6312279
fix: [UI crawler endpoints] display crawler status + fix #353 2019-06-04 14:22:46 +02:00
Alexandre Dulaunoy f09bb63a35
chg: [template] the "item" project 2019-05-25 09:51:49 +02:00
Terrtia 67897eeef1
fix: [update v1.7] add bs4 requirement 2019-05-24 14:31:08 +02:00
Terrtia 3638dad480
Merge branch 'master' of https://github.com/CIRCL/AIL-framework 2019-05-24 14:14:28 +02:00
Terrtia 8dfe8fec91
fix: [correlation] fix graph node endpoint 2019-05-24 14:14:07 +02:00
Alexandre Dulaunoy fae3530fec
chg: [PgpDump] PMF fix - longer keys are truncated
TODO: Need to be updated by an async process handling the keys
2019-05-24 14:10:06 +02:00
Thirion Aurélien c27dfc035a
Update README.md 2019-05-24 13:32:50 +02:00
Terrtia 4b0a7210b8
Merge branch 'master' of https://github.com/CIRCL/AIL-framework 2019-05-24 13:27:44 +02:00
Terrtia bc6332dae4
fix: [correlation] fix endpoint 2019-05-24 13:19:11 +02:00
Terrtia eb9c81acef
chg: [correlation] clean files 2019-05-24 13:08:10 +02:00
Terrtia ffc10decc6
chg: [update v1.7] update thirdparty 2019-05-24 13:04:00 +02:00
Terrtia 4794cafe01
chg: [correlation] add cryptocurrency + refractor correlation 2019-05-24 12:02:43 +02:00
Terrtia ff23a2bce2
chg: [Bitcoin] map cryptocurrency: bitcoin (DB pivot) 2019-05-21 16:14:09 +02:00
Terrtia ff3d6e22ef
chg: [update v1.7] add update scripts 2019-05-20 14:48:20 +02:00
Terrtia da5579875d
chg: [pgpdump] reprocess tagged items + fix pgpdump 2019-05-20 14:32:07 +02:00
Terrtia 49f7429c5f
chg: [Update] force update order 2019-05-20 13:02:09 +02:00
Terrtia 9639a51abd
chg: [PgpDump] fix graph + add new tags: pgp-signature pgp-public-key-block + avoid keys injection in pgp user_id 2019-05-20 11:57:49 +02:00
Terrtia 7e8ba8cdaf
chg: [decoded UI] add PgpDump UI + fix hashdecoded js 2019-05-17 17:51:07 +02:00
Thirion Aurélien 9c6a1ea8ec
Merge pull request #349 from kovacsbalu/fix-paste-encoding
Fix #314
2019-05-16 14:30:33 +02:00
kovacsbalu f61d830678 Use default encoding error from redis. 2019-05-16 14:24:03 +02:00
Thirion Aurélien e09d49a658
Merge pull request #350 from kovacsbalu/fix-crawler-rotation
fix: [crawler] rotation
2019-05-16 13:31:09 +02:00
Terrtia cca69def71
chg: [decoded items] bootstrap 4 migration 2019-05-15 17:23:58 +02:00
kovacsbalu 7765ab92e0 Hopp, single quote :) 2019-05-15 10:00:51 +02:00
kovacsbalu 6092f482e6 Fix crawler rotation
Before this, crawler processed prioritized onions and after all starts prioritized regular.
2019-05-15 09:57:18 +02:00
Terrtia 6480744641
chg: [PgpDump] add PgpDump backend
TODO: UI
2019-05-14 17:49:31 +02:00
kovacsbalu 05079c143c Fix #314
Replace char on redis encoding error.
Try to use local file on other error.
2019-05-14 16:06:20 +02:00
Terrtia 0389b9c23b
chg: [crawler] manual/auto crawler: always save screenshots 2019-05-13 14:24:16 +02:00
Terrtia 254441f193
chg: [crawler] manual/auto crawler: always save screenshots 2019-05-13 13:56:43 +02:00
Terrtia 2606220c2b
fix: [faup] fix new return types (bytes to str) 2019-05-06 13:38:13 +02:00
Terrtia a4c03b4ba4
fix: [Crawler] force domains/subdomains lower case (rfc4343) 2019-05-06 11:46:20 +02:00
Terrtia cc61c99290
fix: [showpaste] fix: #346, avoid None screenshots 2019-05-06 10:00:39 +02:00
Terrtia 97fa1ddca4
fix: [python requirements] rename file 2019-05-03 17:02:56 +02:00
Terrtia 9b66fa703f
fix: [crawler] typo: domains down 2019-05-03 10:04:20 +02:00
Terrtia 1bf752fbfc
Merge branch 'master' of https://github.com/CIRCL/AIL-framework 2019-05-02 13:44:29 +02:00
Terrtia cf74adec65
chg; [doc crawler] use the torproject torrc 2019-05-02 13:43:54 +02:00
Steve Clement 71a6860323 fix: [travis] LAUNCH.sh needs -l to launch... 2019-05-01 22:03:32 +09:00
Steve Clement 9f65bc3788 chg: [travis] Travis has his own venv where it installs "stuff". Now we detect and us it in the launcher. 2019-05-01 21:31:47 +09:00
Steve Clement 57a344cfab fix: [travis] Next round of travis fixes. LAUNCH.sh is the only launch script needed.
chg: [installer] Be way more quiet, watching unzips is only fun during development.
chg: [installer] Make the arch one +x
2019-05-01 20:49:07 +09:00
Steve Clement 34ff6116a6 fix: [installer] Avoid doing funky **sudo pip install** moves, it breaks python on package managed python installs, if ever, use the **--user** flag. 2019-05-01 20:36:41 +09:00
Steve Clement 1b5e4f1bcb chg: [travis] Require Python 3.6 to make build faster. 2019-05-01 20:17:53 +09:00