Frequently Asked Questions
Some of the most frequently asked questions are answered here. If that does not solve your curiosity bug, be sure to contact us!
Does wScraper, Inc. utilize different technologies?
What languages do you speak?
Is scraping considered to be a legal activity?
Is there a good way for me to learn about web scraping?
In what formats does wScraper, Inc. provide data?
Can you add more fields in the database than one would normally find?
How much will it cost to scrape a website?
That depends on how complicated the process is. There are a range of factors that can influence the price. These include:
- There may be restrictions on the number of page views per user, which translates into the need to use multiple IP addresses.
- Data that is badly or inconsistently structured can extend the process.
- Data that needs to be decoded can complicate scraping.
- Any data that is embedded in Flash or with images adds to the difficulty.
- If there is a huge quantity of data, the job would take more time.
Prices vary and there are discounts for clients who order the scraping of multiple websites. Small sites with data embedded cleanly in the coding and that are structured in a clear and logical manner often cost around $100.
If you would like share your budge range, please let us know about this. We’ll be glad to review your requirements and consider the maximum budge for this certain project.
Is any website able to be scraped and data extracted?
Any website can be taken through the process of scraping as long as the data is publically accessible and available. However, even if information exists publically, it may beimpractical to try to scrape it. This occurs when a site puts major restrictions on IP addresses. When this happens it can take months to complete the job.
How long does it take to scrape a website?
Usually, simple websites take a few hours to scrape, however large sites may involve weeks of work. We will give you our best estimate regarding how long your project will take.
If I hire you for a custom scrape will you resell the data – Non-disclosure Agreement (NDA)?
No, we will not resell the data we have scraped for you through a customized process. We often deal with confidential and sensitive information. We are always ready to sign the NDA.
What is the process for hiring you?
Once you are hired what is your process??
In each project, we follow a specific process designed to ensure that your job is done properly. The steps include:
- We’ll discuss your project with you and find out what data you require.
- We then crawl the website and download relevant webpages.
- Using XPath or Regular Expressions,HTML DOMs we will extract the needed informationsuch as names, addresses, contact information from every webpage.
- Document the information, placing it in an output file such as MySQL or CSV database.
- Review results with the client and make any adjustments or changes as needed and prepare for updates.
- Process final payment.
If I have a big project, can you handle it?
Does my customized scraping include a source code?
How does payment work?
If you decide to hire us after receiving a fixed quote for a custom website scrape and if you are a new customer, we’ll request a down payment of 50%. Larger projects may utilize milestones that denote what work will be completed at a specific time and how much is due once it that milestone is reached.
PayPal / Payoneer Card is our preferred method of payment, however there are other options available. If for some reason you are uncomfortable with making a down payment to a new company with which you have not worked before, we can set the job up on Elance/oDesk. This site has an escrow system that holds payments until a job is completed and approved. Due to the fact that Elance & oDesk charge a fee to freelancers, jobs that go through these sites will include that fee, which presently stands at Elance = 8.75% ‘n oDesk = 10%.
What is your policy on refunds?
Refunds are offered if for some reason wScraper, Inc. cannot complete the job or if you cancel the job before we have started to work on it. If for some reason you change job requirements after we have begun work, then we can renegotiate the fee.