With Private Crawl you can:

You determine what is indexed and how often

If you need to audit a set of domains and websites that belong to businesses, clients or customers, all you need to do is tell us what they are. Our smart crawlers will return an exhaustive information index for every domain and website on that list. You get to decide how often: every day, every month, or whenever you want.

Index fields

Your data is safe with us

Your list, your data. Because the order is given by you, the results are yours alone. By contractual obligation, nobody will have access to the data indexes built for you. We keep the data on firewall-protected private servers and it can only be accessed with your IP address. We do not mix any data so you are the only one with access to the server that contains your indexes. Some of the most prominent financial and domain companies trust us with their data.

Secure upload file

Analyze trends

The data is updated at regular intervals and you can set alerts to be notified of changes to domains – this way, analyzing trends becomes easy. With automatic data visualization and a constantly renewed directory, you can easily dissect your datasets and discover and monitor new developments.

Statistics trends


Export your dataset as a PDF report to share it with your colleagues or as a CSV file to continue working on it in different ways. Private Crawl allows you to share your data in a report that explains the data variables and automatically generates all the visualizations and graphs.

Export private report

Dataprovider.com’s Private Crawl is fast and easy to use:

  • Upload your file
  • Indexation
  • Build your data set
  • Analyze and upsell
Filter combinations
Domains worldwide
Active countries
Companies structured

Want to integrate our data into your technology stack?

We offer access to our RESTful API. Contact us for more information.

If you would like to know more about using our Dataprovider.com API.


Private Crawl features

  • Filters

    Advanced filters

    Utilize over 200 search variables in whatever way you want to create custom datasets that show you the information you need to get the job done.

  • Scores

    Data scores

    Proprietary data scores make analyzing your data a breeze. Discover a website’s Economic Footprint, Security Score, Heartbeat, and Trust Grade, among others.

  • Level

    Delta scores

    When getting a snapshot of your data is not enough, the ‘delta score’ reveals how much a particular proprietary score has changed over the course of a year.

  • Find

    Find the data that matters

    Choose the filters you want to use, highlight important variables, sort the columns, and refine the results using keywords; find the information you need, without any unnecessary clutter.

  • Pointer


    The dashboards are designed to make all data readily available. Automatically generated graphs ensure exploring the data points that make up the business profile is easy.

  • Difference

    Different views on the data

    Order your dataset in the comprehensive ‘statistics’ view, find geographic patterns through the ‘heatmap’, and use ‘trends’ to see how the data has developed over time.

  • Export

    Export data from multiple formats

    Export your dataset in CSV and PDF to share it with your colleagues or continue working on it in different ways.

Give it a try and get insight right away!

Contact us and we'll try to get back to you within 24 hours.

Request live demo