This article will help give you guidance for the type of machine you will need in order to run Sitebulb Server.
The machines suggested below could be machines that you already have available, or that you rent from one of our recommended suppliers, or that you purchase and own outright.
If you read everything below and have no idea how to proceed, please fill in this form and we'll get back to you with a recommendation.
We would not recommend running Sitebulb Server on a lower spec machine than this.
Recommended for: Solo consultants: 1 user, no concurrent crawling, rough max of 250,000 URLs per site.
Recommended for: Small agencies and solo consultants: 1-3 users, no concurrent crawling, rough max of 1 million URLs per site.
Recommended for: Agencies and in-house teams: 3-5 users, concurrent crawling, rough max of 2 million URLs per site
This is for in-house teams, specialist consultants or larger agencies who need to regularly crawl very large sites with millions of URLs - i.e. where scale is a big factor.
If this fits your description, it is probably best to have a conversation with us, so we can properly understand your requirements and come back to you with specific recommendations. It may be that you need a range of servers, or a fully managed solution.
Please reach out to us on [email protected] and we'll set up a call.
We recommend a maximum of 5 concurrent users per machine. This means that 5 users can be logged on and connected to the machine, looking at audit data and reports. So 'how many users need access?' is the first question you need to ask yourself.
The next thing you need to think about is the number of clients/websites you need to regularly audit, and the size of the websites you need to crawl - all of your websites can't be crawled at the same time.
We'd suggest you start off with a single machine and see if you are able to set up sensible schedules that allow all the websites to be crawled within the required time frame (e.g. weekly/monthly). Then you can always add additional servers to cover all your websites afterwards if you need to.
If you are not sure, please just get in touch on [email protected] and we'd be happy to advise.
You'll need to make some decisions about what solution fits best for your business.
We have some rules and recommendations we'd suggest you follow here:
We have been testing out providers, and can recommend the following:
If you'd like more information on the different server options available, we also have a 'pros and cons' guide for all the different server options you could choose.
Once you have a server sorted, it's time to move onto the next step: 'Configuring Sitebulb Server'.