Avatar for Spoonshot

Helping CPG companies stay ahead of food trends.

Web Scraping Engineer (Fulltime)

₹3L – ₹9L
Apply now
We are looking for an ambitious individual who never gets tired of handling large pool of unstructured data sources. Data is the most important fuel for the solutions we build at Spoonshot. Build tools and frameworks which can scrape data without much developer intervention. Our goal is to build 100K+ of stable data pipelines. This requires a high degree of automation.

Job responsibilities:
- As a Python Developer, your role is to apply your knowledge set to fetch data from multiple online sources, cleanse it and build APIs on top of it.
- Think deeply about developing large scale scraping tools including data integrity, health, politeness and monitoring systems.
- Develop a deep understanding of our vast data sources on the web and know exactly how, when, and which data to scrape, parse and store.
- Work with SQL and NoSQL databases to store raw data.
- Develop frameworks for automating and maintaining constant flow of data from multiple sources.
- Work independently with little supervision to research and test innovative solutions.
- Coordinate with other engineers.

Required skills & experience:
- Strong coding experience in Python.
- Knowledge of working with various front end technologies and how various websites are built.
- Experience with SQL and NoSQL databases.
- Experience with AWS / GCP.
- Previous experience with web crawling is a plus.

More jobs at Spoonshot

View all jobs

Tech Lead

Apply now

Data Engineer

Apply now

Data Scientist

Apply now

Data Science Internship for 6 months

Apply now