Mokaddem
3261eca836
Fixed all_index newline bug + added print of what's happening
2017-03-15 14:29:49 +01:00
Mokaddem
5b7d047622
Changed os.system by os.mkdir + fixed bug during rotation
2017-03-15 14:05:13 +01:00
Mokaddem
4005b72180
Added backward support + renamed index with timestamp
2017-03-15 11:51:35 +01:00
Mokaddem
381e72ee99
Added display of number of elements inside the index + changed variables names
2017-03-15 10:07:46 +01:00
Mokaddem
e4757f5ceb
Added possibility to choose the index in search + Updated search page with jinja2 iter0
2017-03-15 09:39:48 +01:00
Mokaddem
41132fe0bc
Added support of per_paste for term-management and plot-term
2017-02-28 15:54:39 +01:00
Mokaddem
4071bf2e91
fixed a bug in manage_term (usage of loop.index0) + fixed bug in top_set where graph was not displaying the correct per_paste value
2017-02-28 15:01:48 +01:00
Mokaddem
25adae0104
Added possibility to select in top_terms the data per_paste or not (need module testing)
2017-02-15 16:29:02 +01:00
Mokaddem
d4da3a316f
Added path of the paste in the log of Categ.py
2017-02-14 10:59:47 +01:00
Mokaddem
29241eb49f
Added a line separator between the two graphs in dashboard.
2017-01-09 14:44:14 +01:00
Mokaddem
0e39f516a9
Added sleep in helper for multiple listening interfaces (reduce useless work), Added a simple way to pre-process feed before sending it to the global feed.
2017-01-09 14:12:26 +01:00
Mokaddem
24c5621d29
BUG FIX in Flask_trendingmodule, Fixed member_set when get_top_relevant_data is None.
2016-12-26 16:33:10 +01:00
Mokaddem
1c2169d3bc
Improved interface for multiple feeds and refresh_script.
2016-12-26 16:16:44 +01:00
Mokaddem
a18c046dea
Fixed bug multiple refresh instances and harmonized interface.
2016-12-23 16:15:05 +01:00
Mokaddem
03dddbc359
Reduced refresh rate of processed_pastes, synchro graphs and adjusted max on each graphs.
2016-12-23 16:01:30 +01:00
Mokaddem
97292e0899
Updated web interface to handle new mixer module. and fixed one dependency bug.
2016-12-23 15:44:46 +01:00
Mokaddem
faa8f8302d
Removed typo in the number of remaining pastes to display in browseImportantPaste
2016-12-22 09:28:55 +01:00
Mokaddem
9df12cdae8
Added sub-flask in a directory
2016-12-22 08:57:45 +01:00
Mokaddem
d30f3ca6c7
Added missing depency datetime in dashboard
2016-12-09 13:53:57 +01:00
Mokaddem
0054be5bab
Added missing json dependency in dashboard
2016-12-09 08:50:36 +01:00
Mokaddem
8daa72789e
Splitted Flask_server into module related to website sections
2016-12-09 08:46:37 +01:00
Mokaddem
d3ed1bbf40
Merge branch 'website-improvement' into production
2016-12-08 10:05:55 +01:00
Mokaddem
1abba4dcf9
Added support of re-plotting the plotted terms
2016-12-08 08:44:10 +01:00
Mokaddem
84dcd5586f
Started plotting same data with different dates
2016-11-25 16:42:22 +01:00
Mokaddem
a3255d168c
ModuleInfo correctly handle CurveManageTopSets,
...
Changed queue coloring in dashboard,
ModuleInformation now have a history of executed command and better handle module killing.
2016-11-25 11:54:16 +01:00
Mokaddem
5d269ea1ee
Added date in Duplicate for better distinguish duplicate. Also, added a timeout for the dataTable in duplicate inside the modal.
2016-11-24 15:05:29 +01:00
Mokaddem
df8d978088
Added dynamic data loading in dataTable in search.html
2016-11-24 13:31:31 +01:00
Mokaddem
80ca49f018
Prevent browser to request reconnection for the eventStream + Added dynamic data loading in the dataTable of BrowseImportantPastes
2016-11-11 16:51:39 +01:00
Mokaddem
768fb6f2df
removed server overhead for paste preview data
2016-11-10 16:41:07 +01:00
Mokaddem
699c819387
fixed bug in show concerned pastes previex en (terms managements)
2016-11-10 16:33:05 +01:00
Mokaddem
94e3034e7d
Fixed bun in terms management, where action_button was not bind in other dataTable pages
2016-11-10 15:53:22 +01:00
Mokaddem
7763bfb4c7
Pastes dataTable now display only the latest clicked paste even if there were discarded queries
2016-11-10 15:39:45 +01:00
Mokaddem
2dd69fbb25
Fixed modal background stacking bug + button leading to saved paste bug fixed in search
2016-11-10 14:56:25 +01:00
Mokaddem
317005c2b4
tryed to fix html display problem in tooltip + fixed problem button showPaste in modal not pointing to the paste
2016-11-10 10:30:29 +01:00
Mokaddem
34221b083f
Partially solved the browser freezing problem + tootlip is also binded at a new page generation of the DataTable
2016-11-10 09:28:55 +01:00
Mokaddem
acdd1367a3
Added event source for getImportantPaste
2016-10-28 16:55:56 +02:00
Mokaddem
c95000866d
Dynamic table in search now load all the data + fixed bugs where tooltip where not shown on other than the first page displayed and
...
tooltip interpret html (not supposed to...)
2016-10-28 14:21:08 +02:00
Mokaddem
f51808d914
Added support of html formatting in search result dynamic loading table
2016-10-28 09:48:22 +02:00
Mokaddem
4be62a4e2d
Added draft of dynamic update table with search result
2016-10-28 09:28:42 +02:00
Mokaddem
340624fe1e
Fixed bug in modal show paste (show more button not showing)
2016-10-27 16:18:49 +02:00
Mokaddem
7e7e679ab6
Added dataTable for duplicate in show saved paste
2016-10-27 15:53:45 +02:00
Mokaddem
59a7000527
Bootstrap support in show saved paste
2016-10-27 12:38:39 +02:00
Mokaddem
ac254e0e63
Added support of browsing concerned paste in dashboard for all modules + Show in the page what was the concerned module
2016-10-27 11:50:24 +02:00
Mokaddem
1826b170ec
Added support of local paste view in dashboard for Mails event only
2016-10-27 11:27:26 +02:00
Mokaddem
7c8d414948
modified provider name into no data when there is no data
2016-10-14 16:47:22 +02:00
Mokaddem
91678179fd
Added msgs when queues or feed is not running/coming
2016-10-14 16:33:54 +02:00
Alexandre Dulaunoy
2781a2f0b7
Stuck not stucked
2016-09-21 08:35:20 +02:00
Jerome St-Hilaire
ea13f87c2c
Fixed dependency fetching for the web interface
2016-09-15 12:14:55 -07:00
Raphaël Vinot
acfe9c1336
Update Flask_server.py
2016-08-26 18:06:48 +02:00
Raphaël Vinot
3290b51c91
Update update_thirdparty.sh
2016-08-26 18:05:18 +02:00
Mokaddem
79be8ab934
Fixed introduced bug relative to chart in index webpage.
2016-08-26 15:59:53 +02:00
Mokaddem
0c760d763b
Added support of PID in ModuleInformation and index.html
2016-08-26 15:27:37 +02:00
Mokaddem
5c565068a6
Removed auto-reload in dashboard if window in undefined
2016-08-26 11:25:11 +02:00
Mokaddem
181c372131
Updated dependencies
2016-08-26 11:10:39 +02:00
Mokaddem
4cb3b672be
Added comments
2016-08-26 10:28:35 +02:00
Mokaddem
86b655100e
Deleted useless parsing function
2016-08-26 10:01:14 +02:00
Mokaddem
07d7559060
Added dataTable support in browse paste modal.
2016-08-26 08:30:09 +02:00
Mokaddem
813cc7031a
Changed lots of code into zrank
2016-08-25 17:48:12 +02:00
Mokaddem
991176fdfd
Suppressed metismenu import.
2016-08-25 16:40:13 +02:00
Mokaddem
fb22816236
Added module number info in index webpage
2016-08-25 16:27:32 +02:00
Mokaddem
0b5a3e0cd2
Auto generate graph div + possibility to query all sentiments data.
2016-08-25 15:06:18 +02:00
Mokaddem
21f2c43572
Individualized sentiments-graph loading
2016-08-25 13:11:16 +02:00
Mokaddem
f9bf00f022
Removed autokill feature if not specified
2016-08-25 11:09:31 +02:00
Mokaddem
611454ba82
Added color in web-index reprenting modules states.
2016-08-24 18:00:05 +02:00
Mokaddem
e3daa84196
Added icon in header
2016-08-23 16:09:34 +02:00
Mokaddem
e12244fb53
Added show/hide curve with legend in terms-top-set.
2016-08-23 15:39:13 +02:00
Mokaddem
e56187eb7e
Added position of each top term in the other sets + highligth ones not present.
2016-08-23 14:52:02 +02:00
Mokaddem
a64d447b7b
Auto hide button add_to_chart when no data plotted.
2016-08-23 12:09:41 +02:00
Mokaddem
e59b7c4e47
Added tooltip in graph for terms-plot-tool
2016-08-23 12:03:23 +02:00
Mokaddem
0eba419651
Added multiple terms plot in terms-plot-tool.
2016-08-23 11:56:32 +02:00
Mokaddem
9f2d672ec8
harmonized tooltip and popover display
2016-08-23 11:20:48 +02:00
Mokaddem
8c956c22b1
Added autohide curves in terms-top-set.
2016-08-23 11:02:36 +02:00
Mokaddem
32dfd2b181
Moved legend place in term-plot-top
2016-08-23 10:16:33 +02:00
Mokaddem
f9b27e4013
Fixed bug in curve preventing to track concerned_pastes. Now all tracked words are put in lower case.
2016-08-23 09:50:03 +02:00
Mokaddem
1766ced9e6
Fixed potential XSS problem with pastes display in 'search' and 'important_paste_by_module'.
2016-08-23 09:08:17 +02:00
Mokaddem
047331df3e
Added save of paste_baseName in set for searches. This is done in ModuleStats to not surcharge the Global module.
2016-08-23 08:52:54 +02:00
Mokaddem
6be557890c
Replaced negative hour by 24h based.
2016-08-23 07:19:51 +02:00
Mokaddem
85ab0e36ff
In sentiment analysis. if today top provider set is empty, try to take yesterday data and then takes from all_providers.
2016-08-23 07:11:03 +02:00
Mokaddem
8359a6668f
Suppressed useless comms
2016-08-22 21:36:19 +02:00
Mokaddem
2fd2c8af39
Removed commented code
2016-08-22 20:59:56 +02:00
Mokaddem
27ae577e00
Fixed stupid line remove in index.html...
2016-08-22 16:25:52 +02:00
Mokaddem
a424069c64
Fixed bug in flask with zrange (was taking the bottom of the set instead of the top leading to get only the min instead of max)
2016-08-22 16:12:20 +02:00
Mokaddem
003c72bd7c
Fixed bug with redis where the inserted key was too long, causing a crash + fixed bug taking min instead of max in terms-top-set
2016-08-22 16:01:42 +02:00
Mokaddem
2466f355ab
Fixed bug in manage-terms-top-set + added auto sorting in important-paste-by-module
2016-08-22 14:54:37 +02:00
Mokaddem
e144e8e1c6
Fixed bug in terms-management-interface (only display one paste) + removed get_language of all pastes due to the huge overhead.
2016-08-22 13:59:12 +02:00
Mokaddem
d3c0fc5f94
Added terms trending module and web interface:
...
- Curve module has been rewritten
- Added new module curve_manage_top_set
- Added all web-pages
2016-08-22 13:35:49 +02:00
Mokaddem
841e87eb16
Fixed bug in sentiment trending, if there was no data for the avg -> there was one NaN leading to no display in the gauge.
2016-08-20 18:48:24 +02:00
Mokaddem
ee8f26c7c4
In sentiment trending, if there are no providers in the today\'s set, get data from random providers
2016-08-20 18:14:19 +02:00
Mokaddem
2ed60cb9bf
Fixed typo
2016-08-20 16:44:36 +02:00
Mokaddem
3f1cf705fc
Deleted alert()
2016-08-20 16:41:49 +02:00
Mokaddem
1c96eac2e4
Enter simulate button click on input field for terms management and plot tool
2016-08-20 16:38:51 +02:00
Mokaddem
465d18fc73
Added terms-plot tool
2016-08-20 16:23:06 +02:00
Mokaddem
fb3dea6bd2
Finnished terms-plot-top-set. Also added possibility to add terms to track or blacklist.
2016-08-20 15:59:22 +02:00
Mokaddem
a5117d7cad
Added top set webpage
2016-08-20 11:46:22 +02:00
Mokaddem
0b6828fb16
Correctly handle and display add or remove a term in term-frequency + started sketch of terms-plot tool.
2016-08-19 16:53:46 +02:00
Mokaddem
8d41b109e7
Added query of the data for the new tracked word
2016-08-19 14:33:01 +02:00
Mokaddem
b78effe779
Added draft of terms_management + Added copyright in readme
2016-08-19 13:34:02 +02:00
Mokaddem
52b7124a6b
- Modified redis connection (from levelDB to redis).
...
- Added term frequency in curve.
- Modified ModuleStats and WebStats to use redis special command (incrby instead of get-set and zset) and Flask to perform the correct queries.
- Added panel color in sentiment trending
2016-08-18 15:34:19 +02:00
Mokaddem
24072ece36
Added support of pasteName in search + added header in search.html + supressed mixed indent and trailing in Flask.py
2016-08-17 14:21:31 +02:00
Mokaddem
c10f28d9df
Updated isolated launch scripts + Added switch displaying queue in index
2016-08-17 13:46:01 +02:00
Mokaddem
23b65eddca
Auto unchecked info checkbox in index
2016-08-17 11:25:05 +02:00
Mokaddem
4d09ab0f6b
Modified icon sentiment in web-header.
2016-08-17 11:13:37 +02:00
Mokaddem
44f54b7b81
Added dependencies
2016-08-17 11:04:48 +02:00
Mokaddem
f0b527167a
Added script flexgauge
2016-08-17 10:50:30 +02:00
Mokaddem
c12e67a35a
Added tooltips + slight gauge modification
2016-08-17 10:43:43 +02:00
Mokaddem
894b9efda9
Added drop of really long line in sentiment-analysis module + Added description of sentiment module. Also, fixed bug in webpage sentiement-trending concerning avg and date range.
2016-08-17 09:46:25 +02:00
Mokaddem
1084e45f1b
Added draft of filter in sentiment analysis (Discard syntaxical languages) + Added nice tooltip for sparkline. Trending displays avg in function of the number of elements processed and not for the complete week + fixed bug in gauge and canvasjs (was performing avg with only 1 graph instead of all 8).
2016-08-16 16:33:02 +02:00
Mokaddem
ecd834ffb6
Added autoreload in sentiment-trending.
2016-08-16 11:27:49 +02:00
Mokaddem
bb677b9061
Added avg text in sentiment-trending + fixed date range bug
2016-08-16 11:23:14 +02:00
Mokaddem
cdd08d7df0
Added all providers for plot_tool in moduleStats + fixed date range bug
2016-08-16 11:07:36 +02:00
Mokaddem
8fa3c2b147
Added stacked choice or not for plot-tool (sentiments)
2016-08-16 10:49:05 +02:00
Mokaddem
4baac0b994
Tool-plot for sentiment working + Splitted script and webpage
2016-08-16 10:31:18 +02:00
Mokaddem
1e7547d16c
Created draft of search for plot tool
2016-08-15 16:32:02 +02:00
Mokaddem
88ed8a239d
Linked plot button with server
2016-08-15 15:54:53 +02:00
Mokaddem
82f70e61f4
Added provider checkbox
2016-08-15 15:16:31 +02:00
Mokaddem
f90987d284
Added date on slider
2016-08-15 14:53:46 +02:00
Mokaddem
d8c84ec674
Added link to data in analysis trending + fixed tooltip bug in sparkline
2016-08-15 12:57:39 +02:00
Mokaddem
6c7f660052
Added support of week and day average.
2016-08-13 22:17:11 +02:00
Mokaddem
1a5158b081
Added sentiment analyser module (draft)
2016-08-13 15:24:57 +02:00
Mokaddem
0431ecf434
Modified webpage display and added js.
2016-08-12 10:22:24 +02:00
Mokaddem
9c3b573af2
Splited js from html + Added some ID + small display modification.
2016-08-12 07:49:24 +02:00
Mokaddem
87a86b38d1
Added page Plot-tool
2016-08-11 21:08:43 +02:00
Mokaddem
c028ca80da
Separated options from the plot funcion for sparkline.
2016-08-11 17:57:23 +02:00
Mokaddem
98c4cacb98
Finished first panel in sentiment-today.
2016-08-11 17:22:50 +02:00
Mokaddem
8682fcc29c
Added empty webpages for sentiments modules.
2016-08-11 11:34:22 +02:00
Mokaddem
5612a77af9
Separated webpage header code from all webpage
2016-08-11 10:55:51 +02:00
Mokaddem
0ba5637e06
Added bar chart hover binder in trending charts
2016-08-10 11:16:56 +02:00
Mokaddem
24318f6a86
Added the part 'other' in Trending chartscd
2016-08-10 10:42:06 +02:00
Mokaddem
1ca8cf69f6
Added trendingchart.js
2016-08-10 09:38:15 +02:00
Mokaddem
b249676fe9
Removed console log
2016-08-09 16:54:53 +02:00
Mokaddem
507c83e06d
In index webpage, reset value graph if no paste received
2016-08-09 16:48:57 +02:00
Mokaddem
943016d6ca
Fixed one of the small display bug in DUplicate_ssdeep_v2 (was displaying [tlsh, tlsh] instead of simply tlsh)
2016-08-09 15:06:55 +02:00
Mokaddem
0d16a8beb7
Fixed bug where Listener was not placed if the row was not displayed (BrowseWarningPaste)
2016-08-09 12:30:40 +02:00
Mokaddem
e2ba4060ee
restaured loading gif when new tab is shown (BrowseWarningPaste)
2016-08-09 12:07:20 +02:00
Mokaddem
a80f6ca0c2
Bug fix related with redis:
...
Fixed typo key in redis for module creditcard and sqlinjection
Modified Curve redisLvlDb server
Modified Url.py so that it forwards name of protocol from saved protocolsfile
Added Cache control in Flask
Modified key-tab name into keys-tab
2016-08-09 11:59:36 +02:00
Mokaddem
084737dd26
Fixed bug in flask not correctly displaying the number of paste/providers
2016-08-08 11:39:17 +02:00
Mokaddem
78c611fead
Added warning_paste module and created related webpages.
...
Fixed a Faup bug in credential (multiple instanciation) and added correc populate_set_out in concerned modules (creditcard, credential, ...).
Linked browse_warning_paste module and Flask function with redis (created new sets).
2016-08-08 09:17:44 +02:00
Mokaddem
3523d79a05
Started browse important paste feature. Still need to link with redis. + Fixed a bug in Flask (String to list parser)
2016-08-04 16:57:34 +02:00
Mokaddem
55ef917ef1
Added few comments
2016-08-04 12:10:56 +02:00
Mokaddem
d9316771cd
Draft: added new duplicate hash comparison - tlsh
2016-08-04 11:55:38 +02:00
Mokaddem
50d2848a40
Tryed to fix the glob_tabvar bug
2016-08-02 16:39:57 +02:00
Mokaddem
9e82ec82b7
Fixed a bug in the hover of provider graph (happened when there was an 'other' in other graphs)
2016-08-02 16:17:25 +02:00
Mokaddem
9d37ebc860
Fixed a division by 0 in Flask + Harmonized webpage item positioning
2016-08-02 16:00:31 +02:00
Mokaddem
f3cf2f853a
Fixed a bug in the hover of providers graph.
...
When we click on a part in providers graphs, we hover an item, then we click on a random part not belonging to providers graphs, and we re-hover one part of the providers graphs, there was an undefined variable (The random click overrided it).
2016-08-01 11:08:53 +02:00
Mokaddem
feb1717dc6
fixed size bug, which in some cases display the total size instead of the average + few cleanup + commented out log scale in moduleStats.js and added large number division in case of div by 0
2016-07-29 16:52:50 +02:00
Mokaddem
a827e8ca3a
Big refactoring and added lot of comments + fixed bug attaching multiple binder on barChart
2016-07-29 14:30:41 +02:00
Mokaddem
e8fae17cfd
Fixed small race condition bug in ModuleStat.py and Added highlight of bar belonging to the same serie in moduleStats.js
2016-07-29 10:36:44 +02:00
Mokaddem
c2bf2ba630
Added tooltip in moduleStat above each bar chart + Added highlight of the selected bar. (Still not working for category 'Other')
2016-07-28 16:35:30 +02:00
Mokaddem
09fdaa3e39
Added tooltip for moduleStats bar chart
2016-07-28 12:06:54 +02:00
Mokaddem
acec508f53
fixed multiple binding bug in moduleStats + Added multiple bar display for 'other pie part' + Added ModuleStats tab in all other pages
2016-07-28 09:52:07 +02:00