{% include 'nav_bar.html' %}
{% include 'crawler/menu_sidebar.html' %}
{% include 'crawler/crawler_disabled.html' %}
Crawl a Domain
Enter a domain and choose what kind of data you want.
Crawler Type
Splash Name
{%for crawler_type in all_crawlers_types%}
{{crawler_type}}
{%endfor%}
Don't use a special splash crawler
{%for splash_name in all_splash_name%}
{{splash_name}}
{%endfor%}
Manual
Automatic
Time (seconds) between each crawling
HTML
Screenshot
HAR
Depth Limit
Max Pages
Cookiejar:
Don't use any cookiejar
{%for cookiejar in l_cookiejar%}
{{cookiejar}}
{%endfor%}
Send to Spider