Server recommendations

This article will help give you guidance for the type of machine you will need in order to run Sitebulb Server DIY.

The machines suggested on this page could be machines that you already have available, or that you rent from one of our recommended suppliers, or that you purchase and own outright.

Recommended provider

If you wish to rent your server, we recommend Prostack. They provide enterprise grade servers, with US or UK datacenters, where all machines are fully managed with excellent support.

Click here for their dedicated list of servers pre-configured for use with Sitebulb Server.

Prostack Servers Sitebulb

Note that it can take Prostack a few days to get servers up and running.

Min spec machine

We would not recommend running Sitebulb Server on a lower spec machine than this.

Recommended for: Freelance SEOs or consultants: 1 user, no concurrent crawling, rough max of 500,000 URLs per site.

Spec:

  • 6 physical cores (12 threads)
  • 16GB RAM
  • 500GB SSD storage

Sitebulb Server will not install on systems with less than 16GM RAM, and SDD storage is strongly advised over HDD.

Small machine

Recommended for: Small agencies and solo consultants: 1-3 users, no concurrent crawling, rough max of 500,000 URLs per site.

Spec:

  • 8 physical cores (16 threads)
  • 32GB RAM
  • 500GB SSD storage

Medium machine

Recommended for: Mid-sized teams: 3-5 users, concurrent crawling, rough max of 1 million URLs per site.

Spec:

  • 8 physical cores (16 threads)
  • 64GB RAM
  • 1TB SSD storage

Large machine

Recommended for: Large agencies and in-house teams: 6-8 users, concurrent crawling, rough max of 2 million URLs per site

Spec:

  • 12 physical cores (24 threads)
  • 128GB RAM
  • 1-2TB SSD storage

Enterprise server

This is for in-house teams, specialist consultants or larger agencies who need to regularly crawl very large sites with millions of URLs - i.e. where scale is a big factor.

If this fits your description, it is probably best to have a conversation with us, so we can properly understand your requirements and come back to you with specific recommendations. It may be that you need a range of servers, or a fully managed solution.

Please fill in our kick-off survey, then we can set up a call to discuss your options.

How many servers do you need?

We recommend a maximum of 5 concurrent users per machine. This means that 5 users can be logged on and connected to the machine - at any one time - looking at audit data and reports. So 'how many users need access?' is the first question you need to ask yourself.  

The next thing you need to think about is the number of clients/websites you need to regularly audit, and the size of the websites you need to crawl - all of your websites can't be crawled at the same time.

We'd suggest you start off with a single machine and see if you are able to set up sensible schedules that allow all the websites to be crawled within the required time frame (e.g. weekly/monthly). Then you can always add additional servers to cover all your websites afterwards if you need to.

Some things to be aware of

You'll need to make some decisions about what solution fits best for your business.

We have some rules and recommendations we'd suggest you follow here:

  • You MUST use a Windows machine, as Sitebulb Server only runs on Windows 10+ or Windows Server 2016+.
  • We strongly recommend you use SDD drives instead of HDD.
  • Sitebulb Server will not run on systems with less than 16GB RAM.
  • We don't recommend you go for cloud hosting - while Sitebulb Server will run on AWS or Google Compute, it is a much more expensive solution, and therefore mostly suitable for short term testing purposes.
  • We don't recommend you go for a virtualized solution - it is better to have a dedicated server with no sharing of resources with other users.

Next steps

Once you have a server sorted, it's time to move onto the next step: 'Configuring Sitebulb Server'.