build(deps): bump urllib3 from 1.26.4 to 1.26.5
URL Abuse is a versatile free software for URL review, analysis and black-list reporting. URL Abuse is composed of a web interface where requests are submitted asynchronously and a back-end system to process the URLs into features modules.
- HTTP redirects analysis and follows
- Google Safe-Browsing lookup
- Phishtank lookup
- VirusTotal lookup and submission
- URL query lookup
- CIRCL Passive DNS lookup
- CIRCL Passive SSL lookup
- Universal WHOIS lookup for abuse contact
- Sphinx search interface to RT/RTIR ticketing systems. The functionality is disabled by default but can be used to display information about existing report of malicious URLs.
Please note that some of the API services will require an API key. The API keys should be located in the root of the URL Abuse directory.
- CIRCL URL Abuse is online.
If you don't want to use the online version or run your own version of URL Abuse, you can follow the install process below.
IMPORTANT: Use pipenv
NOTE: Yes, it requires python3.6+. No, it will never support anything older.
git clone https://github.com/antirez/redis.git cd redis git checkout 5.0 make make test cd ..
git clone git://github.com/stricaud/faup.git cd faup mkdir build cd build cmake .. && make sudo make install
Install & run URL Abuse
git clone https://github.com/CIRCL/url-abuse.git cd url-abuse pipenv install echo URLABUSE_HOME="'`pwd`'" > .env pipenv shell # Copy and review the configuration: cp website/config/config.ini.sample website/config/config.ini # Starts all the backend start.py # Start the web interface start_website.py
We welcome pull requests for new extensions, bug fixes.
Add a new module
Look at the existings functions/modules. The changes will have to be made in the following files:
- Add the function you want to execure in url_abuse_async.py
- Add a route in web/__init__.py. This route will do an async call to the function defined in url_abuse_async.py. The parameter of the function is sent in an POST object
- Add a directive in web/static/main.js, it will take care of passing the parameter to the backend and regularly pull for the response of the async call
Partner and Funding
URL Abuse was being developed as part of the “European Union anti-Phishing Initiative” (EU PI) project. This project was coordinated by Cert-Lexsi and co-funded by the Prevention of and Fight against Crime programme of the European Union.
URL Abuse is currently supported and funded by CIRCL ( Computer Incident Response Center Luxembourg).