Build a Large Scale Web Crawler System by UpstreamServices

Title: Build a Large Scale Web Crawler System by UpstreamServices
Source: GAF
Category: Apache Solr, Hadoop, Java, Machine Learning, Web Scraping
Posted On: Tue, 25 Oct 2016 15:23:47 -0400
Description:
Large Scale Crawler Looking for a developer (or company) to build a robust web crawler system. There are approximately 20,000+ websites that we want to crawl and extract data from. We want to be able to extract these data within 3-6 months... (Budget: $1500 - $3000 CAD, Jobs: Apache Solr, Hadoop, Java, Machine Learning, Web Scraping)
Like it? Tweet it!  
Share This Job:
Professional Scraper

Recently Posted Projects:

Project Title Share
lawrato.com like website exact copy needed  
house engineering  
fix my website  
Write an iPhone application  
Write a report on Succesfull transition to scrum - 10/08/2018 13:55 EDT  
Write a report on Succesfull transition to scrum  
Wedding photo fix  
Website Redesign  
Web development  
We will need a billing software and website developement  
Urgent website  
Unique Catchy Kogo  
US article writer  
Trial Run -- Build Properties for Urbandoor  
Tech articles required