Web Crawler Engineer with a Leading Web Ranking Company

A leading web information company is looking for an experienced software engineer to develop and manage their industry-leading web crawler technology. Their Crawl Engineering team is responsible for retrieving the highest quality content from the web, engineering scalable storage solutions for large content repositories, and building data interfaces that allow the company to make sense of the retrieved content. You will work with highly motivated engineers to design reliable, high performance systems capable of collecting and managing massive amounts of web content. This position calls for an innovative C++ programmer to apply strong analytical skills to problems such as distributed system design and performance analysis, system monitors and control interfaces, storage management for hundred-plus Terabyte data sets, and software infrastructure development.

Requirements

• 2+ years C++
• 2+ years Python or Perl
• Comfortable in a Linux/UNIX environment
• Highly motivated and capable of independent research and development
• MA/MS degree in CS, Engineering, or equivalent field
• Knowledge of distributed systems development and large scale data management a definite plus

The company is actively recruiting smart individuals who are eager to work on the most challenging problems in the internet domain. Their Crawl Engineering team routinely breaks new ground in the areas of algorithm design, schedulers, data gathering and analysis, and distributed software architectures. To augment their growing team, they are looking for engineers who thrive on these types of problems. They value aptitude, creative thinking, and a strong potential to contribute to the team's success above all else. If you think this is the right environment for you, send us your resume and join one of the most innovative companies in San Francisco.

Contact

Yoad, yoad@margaretmooreco.com

This job ad has expired. Click here for active job ads.