CIRCL
/
AIL-framework
mirror of https://github.com/CIRCL/AIL-framework
2
1
Fork 0
Code Issues Releases Wiki Activity
1,561 Commits
7 Branches
43 Tags
110 MiB
Commit Graph

588 Commits (0af359e5e5ab771d66e60b16624b20245b54c11c)

Author SHA1 Message Date
Terrtia e71daac7d2
fix: [backend crawler] rename downloaded archive 2019-06-07 13:53:33 +02:00
Terrtia b4f06c21f9
chg: [backend crawler] domains: download 1 archive by crawled (most recent) 2019-06-07 13:47:44 +02:00
Terrtia 3fe9d14e9f
chg: [user_management] create default admin user (temp passwd save in AIL_HOME) + change password UI + logout UI + create random password 2019-06-06 21:27:13 +02:00
Terrtia 99e35c51ec
Merge branch 'master' into user_management 2019-06-05 16:59:36 +02:00
Terrtia 0d3d4aae1d
fix: [paste_submit UI] filter empty file field 2019-06-05 16:41:59 +02:00
Terrtia 601ea8f13e
chg: [paste_submit UI] add debug 2019-06-05 16:31:35 +02:00
Terrtia 1929b2c6a7
fix: [paste_submit UI] filter empty file field 2019-06-05 16:18:30 +02:00
Terrtia 9cb6312279
fix: [UI crawler endpoints] display crawler status + fix #353 2019-06-04 14:22:46 +02:00
Alexandre Dulaunoy f09bb63a35
chg: [template] the "item" project 2019-05-25 09:51:49 +02:00
Terrtia 8dfe8fec91
fix: [correlation] fix graph node endpoint 2019-05-24 14:14:07 +02:00
Terrtia bc6332dae4
fix: [correlation] fix endpoint 2019-05-24 13:19:11 +02:00
Terrtia eb9c81acef
chg: [correlation] clean files 2019-05-24 13:08:10 +02:00
Terrtia 4794cafe01
chg: [correlation] add cryptocurrency + refractor correlation 2019-05-24 12:02:43 +02:00
Terrtia ff23a2bce2
chg: [Bitcoin] map cryptocurrency: bitcoin (DB pivot) 2019-05-21 16:14:09 +02:00
Terrtia da5579875d
chg: [pgpdump] reprocess tagged items + fix pgpdump 2019-05-20 14:32:07 +02:00
Terrtia 9639a51abd
chg: [PgpDump] fix graph + add new tags: pgp-signature pgp-public-key-block + avoid keys injection in pgp user_id 2019-05-20 11:57:49 +02:00
Terrtia 7e8ba8cdaf
chg: [decoded UI] add PgpDump UI + fix hashdecoded js 2019-05-17 17:51:07 +02:00
Terrtia cca69def71
chg: [decoded items] bootstrap 4 migration 2019-05-15 17:23:58 +02:00
Terrtia f2ca241e4f
chg: [restapi] add rest api authentification + create default user 2019-05-08 14:58:41 +02:00
Terrtia 1dac8177fe
chg: [user_management] add user role_management 2019-05-06 16:58:36 +02:00
Terrtia 2606220c2b
fix: [faup] fix new return types (bytes to str) 2019-05-06 13:38:13 +02:00
Terrtia cc61c99290
fix: [showpaste] fix: #346, avoid None screenshots 2019-05-06 10:00:39 +02:00
Terrtia 64ff94ce5f
chg: [user_management] create + check user password 2019-05-03 16:52:05 +02:00
Terrtia 9b66fa703f
fix: [crawler] typo: domains down 2019-05-03 10:04:20 +02:00
Terrtia 1ab1a55a4f
chg: [UI] add basic user management 2019-05-02 17:31:14 +02:00
Steve Clement 57a344cfab fix: [travis] Next round of travis fixes. LAUNCH.sh is the only launch script needed. 
chg: [installer] Be way more quiet, watching unzips is only fun during development.
chg: [installer] Make the arch one +x
 2019-05-01 20:49:07 +09:00
Alexandre Dulaunoy 0f2b139625
chg: [hashDecoded] cleanup for the VT message + PEP 2019-04-30 15:50:06 +02:00
Terrtia a183695ddb
chg: [crawler UI] bootstrap 4 migration: show domains by daterange + bug fix hidden services tags 2019-04-26 15:14:29 +02:00
Terrtia 3e6fbc8f79
fix: [paste submit] update broken endpoint + get item date 2019-04-26 10:04:07 +02:00
Terrtia e6dca7f8bf
chg: [update v1.5] add background update: screenshots_crawled 2019-04-24 16:19:35 +02:00
Terrtia 9868833c77
chg: [crawled screenshot] use sha256 as filepath 2019-04-24 14:09:04 +02:00
Terrtia 4ecff21194
chg: [UI crawler] add splash dashboard 2019-04-23 14:26:26 +02:00
Terrtia 2a1cd4a009
chg: [Onion, crawler config] auto crawler: add config by url, fix onions tagging + filter subdomains 2019-04-23 11:15:34 +02:00
Terrtia 6fdf7c2123
chg: [UI crawler] status/remove auto crawler 2019-04-18 16:57:51 +02:00
Terrtia ecca5b11d0
fix: [UI dashboard] typo 2019-04-18 11:01:11 +02:00
Terrtia de285ed64c
chg: [UI DOC] add dynamic update message + add bootstrap 4 migration message + add update doc (DB) 2019-04-18 10:56:00 +02:00
Terrtia 7a5fac9a43
fix: [UI show domain] fix domain/port unpacking 2019-04-18 09:54:25 +02:00
Terrtia ddaad5db93
chg: [v1.5 background update] create update stats 2019-04-17 17:07:09 +02:00
Terrtia 4bff603d4f
chg: [settings UI] add background update progress 2019-04-17 14:39:29 +02:00
Terrtia 3b11df7f90
chg: [UI] add server Management, check if new update/version are available + background update status + link to new realease/commits 2019-04-16 17:24:59 +02:00
Terrtia ddf043059a
chg: [UI] update nav bar endpoint 2019-04-15 17:14:48 +02:00
Terrtia 346e26433a
fix: [Update tags + UI] use srandmember + display update warning 2019-04-15 14:30:28 +02:00
Terrtia 3f1e68f638
fix: [tracked terms] show mime type 2019-04-15 13:36:14 +02:00
Terrtia a43467a0f2
chg: [Update v1.5] update tracked terms path 2019-04-15 13:27:46 +02:00
Terrtia fc1a04336c
fix: [dynamic update v1.5] make sure updates are excuted in the correct order + fix nb_seen_hash dynamic update 2019-04-15 11:01:33 +02:00
Terrtia 1ed9468881
fix: [UI showpaste] min preview 2019-04-11 13:44:20 +02:00
Terrtia 3cc614a1ad
chg: [DB] update items tags metadata 2019-04-11 11:58:06 +02:00
Terrtia e83174327a
chg: [DB] remove absolute path 2019-04-10 17:47:40 +02:00
Terrtia d44acea04d
chg: [merge] merge update into advanced_crawler 2019-04-10 16:41:06 +02:00
Terrtia 2589fc2161
chg: [merge] merge master into update branche 2019-04-10 15:43:15 +02:00
Terrtia b4bee29a33
Merge branch 'master' into advanced_crawler 2019-04-10 15:37:42 +02:00
Terrtia 6165987ec3
chg: [DB Migration] add hash dynamic update 2019-04-10 15:36:41 +02:00
Terrtia 870fa1981c
fix: [update_thirdparty] detect and use virtualenv 2019-04-02 09:50:52 +02:00
Terrtia f64c385343
chg: [Crawler] handle port: crawling + history 2019-03-22 16:48:07 +01:00
Terrtia f4cdddbc7f
chg: [UI + item submit] remove browse paste from UI + fix pasteSubmit tagging 2019-03-21 11:50:53 +01:00
Terrtia 51eb951a47
fix: [UI terms] update tags endpoint 2019-03-21 11:34:21 +01:00
Terrtia c2bc72c72e
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 11:11:53 +01:00
Terrtia ce6475e96e
chg: [tags] remove/add tags by daterange + improve item loading time 2019-03-20 15:57:55 +01:00
Terrtia 8b5266706e
fix: [Tags] cast nb_max_page to int 2019-03-20 13:33:12 +01:00
Terrtia a9e86231ad
chg: [Tags] add backend, daterange selector 2019-03-20 13:25:02 +01:00
Terrtia 65e6eae00d
chg: [UI preview items] b4 migration + new template + better display + decrease item loading time + add basic animation/transition 2019-03-19 13:34:41 +01:00
Terrtia e9bac098c9
fix: [UI Tags] paste preview 2019-03-15 11:16:44 +01:00
Terrtia 23d9cb2265
chg: [UI Tags search] bootstrap 4 migration 2019-03-14 17:04:55 +01:00
Terrtia 9e4813ca4b
chg: [UI Tags] start b4 migration + add date range selector 2019-03-12 13:37:15 +01:00
Terrtia d3b3942ad7
chg: [Flask UI] refractor crawler frontend + show crawled domain 2019-03-06 15:05:58 +01:00
Terrtia 6f5f880b7d
chg: [Crawler UI] add basic tooltips 2019-03-01 11:40:43 +01:00
Terrtia 93c7db86e4
chg: [Crawler UI Flask] refractor functions, templates 2019-02-28 14:56:14 +01:00
Terrtia 460f70fee6
chg: [css] add basic toggle sidebar 2019-02-27 16:58:17 +01:00
Terrtia aaf4712877
fix: [UI crawler manual] fix min input 2019-02-26 15:39:52 +01:00
Terrtia c0d72e7d2a
chg: [Crawler UI] Crawler major refractor (end) + basic UI for manual crawler 2019-02-26 14:50:48 +01:00
Terrtia e5dca268a8
chg: [Crawler] refractor 2019-02-21 09:54:43 +01:00
Terrtia 0832784f7a
chg: [thirdparty_update] get b4 datatable 2019-02-19 11:56:08 +01:00
Terrtia da78d0552d
chg: [Crawler UI Tags] add tag by day + add crawler status + UI onion blacklist 2019-02-19 11:41:45 +01:00
Terrtia 95d63daaf4
chg: [Crawler UI] fix css + bootstrap4 migration 2019-02-15 17:00:07 +01:00
Terrtia 674a9a2591
chg: [UI] font icon v5 + navbar + sidebar 2019-02-08 17:16:58 +01:00
Terrtia c2885589cf
chg: [UI] basic navbar + sidebar + refractor 2019-02-07 17:22:44 +01:00
Terrtia 516238025f
chg: [Crawler] add bootsrap4 src + refractor crawler 2019-02-05 17:16:44 +01:00
Terrtia 423c7b1455
fix: [UI] fix flot js install 2019-02-04 14:56:54 +01:00
Terrtia 655646b7c5
fix: [hiddenServices] catch empty data 2019-01-29 16:43:56 +01:00
Terrtia c1b34bd99c
fix: [Crawler] limit max crawled pages 2019-01-29 15:38:00 +01:00
Terrtia 7a80683f13
chg: [hiddenServices] crawlers status, dynamic update 2019-01-29 14:27:50 +01:00
Terrtia b9572e0085
fix: [Crawler] typo 2019-01-29 12:19:10 +01:00
Terrtia bb301a870c
fix: [Crawler] fix onion blacklist + add crawler info 2019-01-29 12:00:14 +01:00
Terrtia c4c3810037
fix: [hiddenServices] typo 2019-01-08 15:51:39 +01:00
Terrtia 46c1105483
chg: [hiddenServices] auto update last crawled domains 2019-01-08 15:48:40 +01:00
Terrtia 77211c5496
chg: [hashDecoded] add top5 types piechart (v0.1) 2018-12-24 11:42:55 +01:00
Terrtia f023f41ae5
fix: cleaning ... 2018-12-21 15:21:08 +01:00
Terrtia e93a0b637c
chg: [hashDecoded] add option to display decoded files, fix #271 2018-12-21 15:18:07 +01:00
Terrtia 306815a31d
fix: [hiddenServices UI] fix none type 2018-12-20 09:08:14 +01:00
Terrtia 6ee4b7bf93
Merge branch 'master' into update 2018-12-19 15:23:34 +01:00
Terrtia 4e08aaa80f
chg: [UI Crawled Domains] show crawled domains by date range (options: domains tags, up domains, down domains) 
todo: Shows domain history
 2018-12-17 15:58:48 +01:00
Terrtia 31a8dfe0b3
fix: [AIL] use only relative paths 
pastes duplicates are fixed on the fly
 2018-11-21 16:45:25 +01:00
Terrtia d9b776d58a
merge master 2018-11-14 15:55:42 +01:00
Sami Mokaddem 62e46b6dc1
Merge pull request #287 from CIRCL/term_management 
Term management upgrade
 2018-11-08 14:10:25 +01:00
Terrtia 173c0a15c6
fix: [term_management] delete tags 2018-11-08 12:01:40 +01:00
Terrtia 4e906ff841
fix: [term_management] delete emails 2018-11-08 10:41:37 +01:00
Terrtia 0adb8b4624
chg: [terms_management] delete terms tags 2018-11-07 15:37:25 +01:00
Terrtia 46614c97c8
chg: [terms_management] delete email 2018-11-07 11:42:31 +01:00
Terrtia 2c46c7f2ab
fix: [tag export] limit custom tag lenght 2018-11-07 10:17:57 +01:00
Terrtia f91aba5f6f
chg: [tag export] UI, add custom tags 2018-11-07 09:41:58 +01:00
Terrtia 0ad80a22ca
fix: [update_thirdparty] upgrade github source 2018-11-06 17:04:02 +01:00
Terrtia a3fa5a4dcf
chg: [auto push tag] delete unwanted tags 2018-11-06 16:08:58 +01:00
Terrtia 979472df15
chg: [Terms] tag tracked terms 2018-11-06 13:38:37 +01:00
Terrtia af1ff6225e
fix: [Search] tags display 2018-11-05 10:36:58 +01:00
Terrtia 5c67297dc8
fix: [Search] Improve search performance 
note: search by paste name is temporary disabled
 2018-11-05 10:13:48 +01:00
Terrtia 5872cf9196
fix: [Scripts] Remove absolute path 2018-11-02 16:07:27 +01:00
Terrtia ea7fd8d54c
fix: [Duplicate] show duplicate with relative path 2018-10-24 15:47:03 +02:00
Terrtia 6328cc22b7
chg: [Crawler] add domains blacklist 2018-09-28 16:29:09 +02:00
Terrtia b3a6dc8487
fix: [Crawler] remove hardcoded url 2018-09-28 15:42:06 +02:00
Terrtia 3dd20af4d1
Merge branch 'master' into onion_crawler 2018-09-28 15:29:24 +02:00
Terrtia 82e6df4b94
chg: [Crawler] domains stats + logs + clean 2018-09-28 15:23:27 +02:00
Terrtia ecb2857151
chg: [Crawler] css + limit splash RAM 2018-09-27 16:47:48 +02:00
Terrtia ff0affc679
fix: [Flask] remove hardcoded url 2018-09-26 11:59:51 +02:00
Terrtia 3a72f1548d
fix: [Flask] remove hardcoded url 2018-09-25 16:46:06 +02:00
Terrtia b3923428e5
fix: [Flask] remove hardcoded url 2018-09-25 14:37:14 +02:00
Terrtia e4a5f66a10
Merge branch 'master' into onion_crawler 2018-09-24 16:35:04 +02:00
Terrtia 874824a589
fix: [Crawler] clean 2018-09-24 16:28:55 +02:00
Terrtia 50c81773e9
chg: [Crawler] add launcher and install 2018-09-24 16:23:14 +02:00
Terrtia 6edc1ddbeb
chg: [HiddenServices] get domain related to other domains 2018-09-21 10:34:06 +02:00
Terrtia 61b4c9e579
chg: [Flask] add prefix in config to flask routes 2018-09-20 10:56:29 +02:00
Terrtia 5eadc2755f
chg: [Flask] add prefix in config to flask routes 2018-09-20 10:38:19 +02:00
Terrtia 5732d7b134
fix: [hashDecoded] range_type_json 2018-09-19 15:36:33 +02:00
Terrtia 912f2352ab
fix: [crawled screenshot] fix img error 2018-09-18 16:58:49 +02:00
Terrtia ce63d81878
chg: [UI] pixelate crawled screenshot by default 2018-09-18 11:51:21 +02:00
Terrtia f5b648d72a
pixelate paste screenshot 2018-09-18 11:03:40 +02:00
Terrtia 094b211259
fix: [showpaste] path transversal 2018-09-17 15:42:22 +02:00
Terrtia 0c63f2f24f
chg: [Crawler] catch server response 2018-09-17 15:35:06 +02:00
Terrtia 6f0817365a
chg: [Crawler UI] display domain information 2018-09-12 09:55:49 +02:00
Terrtia ca982e13e1
chg: [Crawled Domain] show crawled pastes by domain 2018-08-27 14:34:08 +02:00
Terrtia 40772a5732
fix: merge 2018-08-27 11:30:19 +02:00
Terrtia 823c33174a
Merge branch 'master' into onion_crawler 2018-08-27 11:20:51 +02:00
Terrtia d42dd118a4
chg: [Domain crawled] add random screenshot 2018-08-27 11:02:39 +02:00
Terrtia 6c981ea5e9
fix: [HashDecoded] typo 2018-08-24 11:58:54 +02:00
Terrtia ab452841b1
fix: [HashDecoded] change template title 2018-08-24 11:51:16 +02:00
Terrtia e6b583ee7a
chg: [Hash] add Help on graph node 2018-08-24 11:40:09 +02:00
Terrtia a586548047
Merge branch 'master' into base64 2018-08-24 10:35:28 +02:00
Terrtia 7e24943537
chg: [Crawler] crawler accept all kind of domains 2018-08-24 10:13:56 +02:00
Terrtia e9580d6775
chg: [Crawler] change BDD, save i2p links 2018-08-21 15:54:53 +02:00
Terrtia ed559d9f4a
chg: [Showpaste] add screenshot + improve onion db 2018-08-16 17:24:39 +02:00
Terrtia 54cc4f3723
fix: [UI-Showpaste] show raw paste, force text/plain mimetype 2018-08-03 09:15:34 +02:00
Terrtia 911cff70da
chg: [UI] add AIL icon, fix li links 2018-08-02 10:44:47 +02:00
Terrtia deaebaa4fd
fix: [UI-Hash] pie chart json 2018-07-27 13:51:29 +02:00
Terrtia 009f87ee10
[fix: [UI-hash] fix graph node zoom 2018-07-27 11:27:41 +02:00
Terrtia b02cbee179
chg: [UI-dashboard] add logs number configuration 2018-07-26 11:35:54 +02:00
Terrtia 0a82482db4
chg: [UI-dashboard] convert time to local 2018-07-26 10:34:43 +02:00
Terrtia 5ad5939bd5
chg: display last logs 2018-07-25 16:48:44 +02:00
Terrtia 03a37af5cf
chg: [Hash] add reprocess regex order 2018-07-25 10:47:36 +02:00
Terrtia 8c97c70a3f
Merge branch 'master' into base64 2018-07-24 15:21:32 +02:00
Terrtia 4b8c26dec8
fix: [hive auto export] fix #221 2018-07-24 14:46:35 +02:00
Terrtia 3479923f96
fix: [UI-Hash] pie decoder 2018-07-23 11:43:48 +02:00