Here is a detailed walk-through on using CrawlBoard to scrape your first website.

1. How to Use
CrawlBoard

2. What is CrawlBoard?
CrawlBoard is the requirement gathering
dashboard for PromptCloud’s DaaS
services where users can add new sites,
check for feasibility, manage payments
and initiate crawls.

3. Who is it for?
You can use CrawlBoard if you have a
data requirement for your business that
demands high quality structured data on
a recurring basis.

4. Getting Started
All you need to get started with
CrawlBoard is your company email
address for signing up.

5. Step 1.
Go to the Sign up page:

7. Step 2.
Enter your details like name, company
email, role, and accept the terms and
conditions (company email is required for
signing up).
Once done, click on ‘Sign up’.

9. Step 3.
Verify your email by clicking on the
verification link sent to your email
address. You will be prompted to set
a password for your login.

11. Step 4. Adding a new Sitegroup
Now that you are registered and logged
in, it’s time to add your first ‘Sitegroup’ (A
common container for sites with similar
schema).
Click on the ‘Sites’ tab on the left sidebar
pane of the dashboard.

13. Step 5. Adding a new Sitegroup
Click on the ‘Add sites/Sitegroup’ link on
the top right corner and select
‘Sitegroup’.

15. Step 6. Adding a new Sitegroup
Enter details like ‘Sitegroup name’, fields
to extract and add a few sample URLs.
(All sites within a Sitegroup should have
the same schema)
Click on the ‘Next’ button.

17. Step 8. Adding a new Sitegroup
Select your preferred data delivery format
using the radio button and choose a
frequency for crawling.

18. Step 9. Adding a new Sitegroup
Choose the delivery method that’s most
suited for you. You have the option to
choose one between PromptCloud API,
Amazon S3, Dropbox, FTP or box.

20. Step 10. Adding a new Sitegroup
You can also opt for extra services like
Image downloads, Expedited delivery,
Hosted indexing and File merging on this
page.
Click on ‘Send for final feasibility check’.

23. Step 10. Making the payment
Once you have submitted the requirements,
the feasibility report for your Sitegroup will
soon be generated.
Follow the link in the feasibility report
notification.

25. Step 11. Making the payment
If your requirement is feasible, you will be
prompted to make the payment to proceed.
Click on the ‘Proceed’ button and accept the
Terms and conditions. You will be asked to
enter the billing address after this.

28. Step 12. Crawler setup
Once the payment has been made, you are
all set.
Our team will setup the crawlers and you
will be notified via email on the first data
upload. You can use the API link in the
email to access the data.

30. Step 12. Using the API
Click on the API details tab on the left
sidebar to find detailed instructions on
using PromptCloud API to access your
data.

32. All done! You can now plug this data into
your Database or Analytics system to
get going.

33. Got Questions? Connect with us at:
www.promptcloud.com
sales@promptcloud.com