CIRCL
/
AIL-framework
mirror of https://github.com/CIRCL/AIL-framework
2
1
Fork 0
Code Issues Releases Wiki Activity
AIL-framework/var/www/update_thirdparty.sh

123 lines
5.7 KiB
Bash
Raw Normal View History

Initial import of AIL framework - Analysis Information Leak framework AIL is a modular framework to analyse potential information leak from unstructured data source like pastes from Past ebin or similar services. AIL framework is flexible and can be extended to support other functionalities to mine sen sitive information
2014-08-06 11:43:40 +02:00
#!/bin/bash
set -e
fix: [travis] Next round of travis fixes. LAUNCH.sh is the only launch script needed. chg: [installer] Be way more quiet, watching unzips is only fun during development. chg: [installer] Make the arch one +x
2019-05-01 13:49:07 +02:00
wget -q http://dygraphs.com/dygraph-combined.js -O ./static/js/dygraph-combined.js
Initial import of AIL framework - Analysis Information Leak framework AIL is a modular framework to analyse potential information leak from unstructured data source like pastes from Past ebin or similar services. AIL framework is flexible and can be extended to support other functionalities to mine sen sitive information
2014-08-06 11:43:40 +02:00
Fixed dependency fetching for the web interface
2016-09-15 21:14:55 +02:00
SBADMIN_VERSION='3.3.7'
chg: [Crawler] add bootsrap4 src + refractor crawler
2019-02-05 17:16:44 +01:00
BOOTSTRAP_VERSION='4.2.1'
chg: [UI] font icon v5 + navbar + sidebar
2019-02-08 17:16:58 +01:00
FONT_AWESOME_VERSION='5.7.1'
add d3 and daterange js
2018-06-29 15:52:13 +02:00
D3_JS_VERSION='5.5.0'
Initial import of AIL framework - Analysis Information Leak framework AIL is a modular framework to analyse potential information leak from unstructured data source like pastes from Past ebin or similar services. AIL framework is flexible and can be extended to support other functionalities to mine sen sitive information
2014-08-06 11:43:40 +02:00
rm -rf temp
mkdir temp
fix: [travis] Next round of travis fixes. LAUNCH.sh is the only launch script needed. chg: [installer] Be way more quiet, watching unzips is only fun during development. chg: [installer] Make the arch one +x
2019-05-01 13:49:07 +02:00
wget -q https://github.com/twbs/bootstrap/releases/download/v${BOOTSTRAP_VERSION}/bootstrap-${BOOTSTRAP_VERSION}-dist.zip -O temp/bootstrap${BOOTSTRAP_VERSION}.zip
wget -q https://github.com/FezVrasta/popper.js/archive/v1.14.3.zip -O temp/popper.zip
wget -q https://github.com/BlackrockDigital/startbootstrap-sb-admin/archive/v${SBADMIN_VERSION}.zip -O temp/${SBADMIN_VERSION}.zip
wget -q https://github.com/BlackrockDigital/startbootstrap-sb-admin-2/archive/v${SBADMIN_VERSION}.zip -O temp/${SBADMIN_VERSION}-2.zip
wget -q https://github.com/FortAwesome/Font-Awesome/archive/v4.7.0.zip -O temp/FONT_AWESOME_4.7.0.zip
wget -q https://github.com/FortAwesome/Font-Awesome/archive/5.7.1.zip -O temp/FONT_AWESOME_${FONT_AWESOME_VERSION}.zip
wget -q https://github.com/d3/d3/releases/download/v${D3_JS_VERSION}/d3.zip -O temp/d3_${D3_JS_VERSION}.zip
add: base64 date and type selector
2018-07-05 13:58:40 +02:00
# dateRangePicker
fix: [travis] Next round of travis fixes. LAUNCH.sh is the only launch script needed. chg: [installer] Be way more quiet, watching unzips is only fun during development. chg: [installer] Make the arch one +x
2019-05-01 13:49:07 +02:00
wget -q https://github.com/moment/moment/archive/2.22.2.zip -O temp/moment_2.22.2.zip
wget -q https://github.com/longbill/jquery-date-range-picker/archive/v0.18.0.zip -O temp/daterangepicker_v0.18.0.zip
add: base64 date and type selector
2018-07-05 13:58:40 +02:00
fix: [travis] Next round of travis fixes. LAUNCH.sh is the only launch script needed. chg: [installer] Be way more quiet, watching unzips is only fun during development. chg: [installer] Make the arch one +x
2019-05-01 13:49:07 +02:00
unzip -qq temp/bootstrap${BOOTSTRAP_VERSION}.zip -d temp/
unzip -qq temp/popper.zip -d temp/
unzip -qq temp/${SBADMIN_VERSION}.zip -d temp/
unzip -qq temp/${SBADMIN_VERSION}-2.zip -d temp/
unzip -qq temp/FONT_AWESOME_4.7.0.zip -d temp/
unzip -qq temp/FONT_AWESOME_${FONT_AWESOME_VERSION}.zip -d temp/
unzip -qq temp/d3_${D3_JS_VERSION}.zip -d temp/
add: base64 date and type selector
2018-07-05 13:58:40 +02:00
fix: [travis] Next round of travis fixes. LAUNCH.sh is the only launch script needed. chg: [installer] Be way more quiet, watching unzips is only fun during development. chg: [installer] Make the arch one +x
2019-05-01 13:49:07 +02:00
unzip -qq temp/moment_2.22.2.zip -d temp/
unzip -qq temp/daterangepicker_v0.18.0.zip -d temp/
add: base64 date and type selector
2018-07-05 13:58:40 +02:00
chg: [UI] basic navbar + sidebar + refractor
2019-02-07 17:22:44 +01:00
mv temp/bootstrap-${BOOTSTRAP_VERSION}-dist/js/bootstrap.min.js ./static/js/bootstrap4.min.js
chg: [Crawler UI] fix css + bootstrap4 migration
2019-02-15 17:00:07 +01:00
mv temp/bootstrap-${BOOTSTRAP_VERSION}-dist/js/bootstrap.min.js.map ./static/js/bootstrap.min.js.map
chg: [UI] basic navbar + sidebar + refractor
2019-02-07 17:22:44 +01:00
mv temp/bootstrap-${BOOTSTRAP_VERSION}-dist/css/bootstrap.min.css ./static/css/bootstrap4.min.css
mv temp/bootstrap-${BOOTSTRAP_VERSION}-dist/css/bootstrap.min.css.map ./static/css/bootstrap4.min.css.map
chg: [Crawler] add bootsrap4 src + refractor crawler
2019-02-05 17:16:44 +01:00
fix: change name popper.js-1.14.3 to popper-core-1.14.3
2020-01-18 12:59:40 +01:00
mv temp/popper-core-1.14.3/dist/umd/popper.min.js ./static/js/
mv temp/popper-core-1.14.3/dist/umd/popper.min.js.map ./static/js/
chg: [Crawler UI] fix css + bootstrap4 migration
2019-02-15 17:00:07 +01:00
Fixed dependency fetching for the web interface
2016-09-15 21:14:55 +02:00
mv temp/startbootstrap-sb-admin-${SBADMIN_VERSION} temp/sb-admin
mv temp/startbootstrap-sb-admin-2-${SBADMIN_VERSION} temp/sb-admin-2
chg: [UI] font icon v5 + navbar + sidebar
2019-02-08 17:16:58 +01:00
mv temp/Font-Awesome-4.7.0 temp/font-awesome
chg: [thirdparty_update] get b4 datatable
2019-02-19 11:56:08 +01:00
rm -rf ./static/webfonts/
chg: [UI] font icon v5 + navbar + sidebar
2019-02-08 17:16:58 +01:00
mv temp/Font-Awesome-${FONT_AWESOME_VERSION}/css/all.min.css ./static/css/font-awesome.min.css
mv temp/Font-Awesome-${FONT_AWESOME_VERSION}/webfonts ./static/webfonts
Update web thirdparty modules
2016-07-20 14:11:39 +02:00
rm -rf ./static/js/plugins
Fixed dependency fetching for the web interface
2016-09-15 21:14:55 +02:00
mv temp/sb-admin/js/* ./static/js/
Update web thirdparty modules
2016-07-20 14:11:39 +02:00
rm -rf ./static/fonts/ ./static/font-awesome/
Fixed dependency fetching for the web interface
2016-09-15 21:14:55 +02:00
mv temp/sb-admin/fonts/ ./static/
add taxonomies and galaxies update and install
2018-05-31 10:07:23 +02:00
mv temp/font-awesome/ ./static/
Update web thirdparty modules
2016-07-20 14:11:39 +02:00
rm -rf ./static/css/plugins/
Fixed dependency fetching for the web interface
2016-09-15 21:14:55 +02:00
mv temp/sb-admin/css/* ./static/css/
mv temp/sb-admin-2/dist/css/* ./static/css/
add: base64 date and type selector
2018-07-05 13:58:40 +02:00
mv temp/jquery-date-range-picker-0.18.0/dist/daterangepicker.min.css ./static/css/
Update web thirdparty modules
2016-07-20 14:11:39 +02:00
add d3 and daterange js
2018-06-29 15:52:13 +02:00
mv temp/d3.min.js ./static/js/
add: base64 date and type selector
2018-07-05 13:58:40 +02:00
mv temp/moment-2.22.2/min/moment.min.js ./static/js/
mv temp/jquery-date-range-picker-0.18.0/dist/jquery.daterangepicker.min.js ./static/js/
add d3 and daterange js
2018-06-29 15:52:13 +02:00
Update web thirdparty modules
2016-07-20 14:11:39 +02:00
rm -rf temp
Initial import of AIL framework - Analysis Information Leak framework AIL is a modular framework to analyse potential information leak from unstructured data source like pastes from Past ebin or similar services. AIL framework is flexible and can be extended to support other functionalities to mine sen sitive information
2014-08-06 11:43:40 +02:00
Cleanup and remove useless deps
2016-07-19 18:07:29 +02:00
JQVERSION="1.12.4"
fix: [travis] Next round of travis fixes. LAUNCH.sh is the only launch script needed. chg: [installer] Be way more quiet, watching unzips is only fun during development. chg: [installer] Make the arch one +x
2019-05-01 13:49:07 +02:00
wget -q http://code.jquery.com/jquery-${JQVERSION}.js -O ./static/js/jquery.js
Initial import of AIL framework - Analysis Information Leak framework AIL is a modular framework to analyse potential information leak from unstructured data source like pastes from Past ebin or similar services. AIL framework is flexible and can be extended to support other functionalities to mine sen sitive information
2014-08-06 11:43:40 +02:00
Added dataTable resources in update-third-party.sh
2016-07-08 09:04:19 +02:00
#Ressources for dataTable
fix: [travis] Next round of travis fixes. LAUNCH.sh is the only launch script needed. chg: [installer] Be way more quiet, watching unzips is only fun during development. chg: [installer] Make the arch one +x
2019-05-01 13:49:07 +02:00
wget -q https://cdn.datatables.net/1.10.12/js/jquery.dataTables.min.js -O ./static/js/jquery.dataTables.min.js
wget -q https://cdn.datatables.net/plug-ins/1.10.7/integration/bootstrap/3/dataTables.bootstrap.css -O ./static/css/dataTables.bootstrap.css
wget -q https://cdn.datatables.net/plug-ins/1.10.7/integration/bootstrap/3/dataTables.bootstrap.js -O ./static/js/dataTables.bootstrap.js
Added dataTable resources in update-third-party.sh
2016-07-08 09:04:19 +02:00
fix: [travis] Next round of travis fixes. LAUNCH.sh is the only launch script needed. chg: [installer] Be way more quiet, watching unzips is only fun during development. chg: [installer] Make the arch one +x
2019-05-01 13:49:07 +02:00
wget -q https://cdn.datatables.net/1.10.18/css/dataTables.bootstrap4.min.css -O ./static/css/dataTables.bootstrap.min.css
wget -q https://cdn.datatables.net/1.10.18/js/dataTables.bootstrap4.min.js -O ./static/js/dataTables.bootstrap.min.js
chg: [Crawler] add bootsrap4 src + refractor crawler
2019-02-05 17:16:44 +01:00
Added dependency for flot chart
2016-07-19 16:49:57 +02:00
#Ressource for graph
fix: [travis] Next round of travis fixes. LAUNCH.sh is the only launch script needed. chg: [installer] Be way more quiet, watching unzips is only fun during development. chg: [installer] Make the arch one +x
2019-05-01 13:49:07 +02:00
wget -q https://raw.githubusercontent.com/flot/flot/958e5fd43c6dff4bab3e1fd5cb6109df5c1e8003/jquery.flot.js -O ./static/js/jquery.flot.js
wget -q https://raw.githubusercontent.com/flot/flot/958e5fd43c6dff4bab3e1fd5cb6109df5c1e8003/jquery.flot.pie.js -O ./static/js/jquery.flot.pie.js
wget -q https://raw.githubusercontent.com/flot/flot/958e5fd43c6dff4bab3e1fd5cb6109df5c1e8003/jquery.flot.time.js -O ./static/js/jquery.flot.time.js
wget -q https://raw.githubusercontent.com/flot/flot/958e5fd43c6dff4bab3e1fd5cb6109df5c1e8003/jquery.flot.stack.js -O ./static/js/jquery.flot.stack.js
Added dependencies
2016-08-17 11:04:48 +02:00
Updated dependencies
2016-08-26 11:10:39 +02:00
#Ressources for sparkline and canvasJS and slider
fix: [travis] Next round of travis fixes. LAUNCH.sh is the only launch script needed. chg: [installer] Be way more quiet, watching unzips is only fun during development. chg: [installer] Make the arch one +x
2019-05-01 13:49:07 +02:00
wget -q http://omnipotent.net/jquery.sparkline/2.1.2/jquery.sparkline.min.js -O ./static/js/jquery.sparkline.min.js
Updated dependencies
2016-08-26 11:10:39 +02:00
mkdir temp
fix: [travis] Next round of travis fixes. LAUNCH.sh is the only launch script needed. chg: [installer] Be way more quiet, watching unzips is only fun during development. chg: [installer] Make the arch one +x
2019-05-01 13:49:07 +02:00
wget -q http://canvasjs.com/fdm/chart/ -O temp/canvasjs.zip
unzip -qq temp/canvasjs.zip -d temp/
fix: canvasjs changed its folder hierarchy
2017-12-14 11:47:11 +01:00
mv temp/jquery.canvasjs.min.js ./static/js/jquery.canvasjs.min.js
Updated dependencies
2016-08-26 11:10:39 +02:00
fix: [travis] Next round of travis fixes. LAUNCH.sh is the only launch script needed. chg: [installer] Be way more quiet, watching unzips is only fun during development. chg: [installer] Make the arch one +x
2019-05-01 13:49:07 +02:00
wget -q https://jqueryui.com/resources/download/jquery-ui-1.12.0.zip -O temp/jquery-ui.zip
unzip -qq temp/jquery-ui.zip -d temp/
Updated dependencies
2016-08-26 11:10:39 +02:00
mv temp/jquery-ui-1.12.0/jquery-ui.min.js ./static/js/jquery-ui.min.js
Update update_thirdparty.sh
2016-08-26 18:05:18 +02:00
mv temp/jquery-ui-1.12.0/jquery-ui.min.css ./static/css/jquery-ui.min.css
Added dependencies
2016-08-17 11:04:48 +02:00
rm -rf temp
Added dependency for flot chart
2016-07-19 16:49:57 +02:00
logo added and layout changed
2014-12-22 18:08:02 +01:00
mkdir -p ./static/image
Update web thirdparty modules
2016-07-20 14:11:39 +02:00
pushd static/image
fix: [travis] Next round of travis fixes. LAUNCH.sh is the only launch script needed. chg: [installer] Be way more quiet, watching unzips is only fun during development. chg: [installer] Make the arch one +x
2019-05-01 13:49:07 +02:00
wget -q https://www.circl.lu/assets/images/logos/AIL.png -O AIL.png
fix: [UI login/change_password] add missing ail-logo
2019-06-24 17:14:16 +02:00
wget -q https://www.circl.lu/assets/images/logos/AIL-logo.png -O AIL-logo.png
Update web thirdparty modules
2016-07-20 14:11:39 +02:00
popd
add taxonomies and galaxies update and install
2018-05-31 10:07:23 +02:00
fix: [update_thirdparty] detect and use virtualenv
2019-04-02 09:50:52 +02:00
if ! [[ -n "$AIL_HOME" ]]
then
#active virtualenv
source ./../../AILENV/bin/activate
fi
add taxonomies and galaxies update and install
2018-05-31 10:07:23 +02:00
#Update MISP Taxonomies and Galaxies
fix: [update_thirdparty] upgrade github source
2018-11-06 17:04:02 +01:00
python3 -m pip install git+https://github.com/MISP/PyTaxonomies --upgrade
python3 -m pip install git+https://github.com/MISP/PyMISPGalaxies --upgrade
fix hive connection + submitted dir creation
2018-06-19 11:31:30 +02:00
#Update PyMISP
fix: [MISP export] force pymisp version
2020-01-23 10:01:05 +01:00
python3 -m pip install git+https://github.com/MISP/PyMISP@v2.4.119.1 --upgrade
fix hive connection + submitted dir creation
2018-06-19 11:31:30 +02:00
#Update the Hive
fix: [update_thirdparty] upgrade github source
2018-11-06 17:04:02 +01:00
python3 -m pip install git+https://github.com/TheHive-Project/TheHive4py --upgrade