Web Scrapping specialist

We are looking for an experienced web scrapper and gets a kick out of hacking through the scrapping prevention techniques and pulling out public data from the most guarded systems.

You will get an opportunity to work independently to design and develop the data sourcing module of a primarily data driven application for which the database you create is of core value. You’ll be critical in delivering data that is responsible for the success of the product.

As our first data hire, you’ll collaborate closely with management to set the future vision of the data infrastructure of the product.

*Duties and Responsibilities: *

1. Develop smart scrappers for multiple sources that can bypass stringent scrapping prevention measures
   1. Develop and evolve the core data model and schema through the business growth
2. Architecting a high-dimensional data-warehouse using industry standard data warehousing principles

*Experience and Education: *

• 2+ years of data mining and web scrapping and a demostratable project
• 2+ years of experience in building out data pipelines, ETL design (both implementation and maintenance)
• Solid Object Oriented design and implementation skills
• Bonus for familiarity with the Hadoop/EMR, Hive, Presto, Spark, Pig ecosystem

This is a full-time position. In 2020, this will be a 100% remote role.

Our company is an opportunity provider.
We are commited to nurturing talent and help them grow to be able to not only fullfill their repsponsibilities but also push their own boundaries.
If you are are learner, we are looking for you.