Senior Data Engineer

**Lead Data Engineer
We are looking for a Lead data Engineer to build and maintain architecture and engineering for IOT and telemetry data. The Role gives exposure to not only the latest and cutting edge solutions in Data Engineering, but also Machne learning algorithms and ML Ops.

Responsibilities:
· Responsible to Ingest data from files, streams and databases. Process the data with Python and Pyspark and its storage into time series database.
· Develop programs in Python as part of data extraction, data cleaning, transformation and processing.
· Develop and maintain scalable data pipelines.
Rest API’s development.
Mandatory Skills:
· Overall 6 -10 years of experience as Data Engineer.
· Advanced working SQL knowledge to create complex queries.
· Experience in working with Time-series Database, relational databases as well as working familiarity with a variety of databases (structured & Unstructured).

· Hands On experience on visualization tools like Grafana & Power BI.
· Experience in designing and implementing scalable architecture.
· Good experience in doing object-oriented programming in python.
· Very strong in Object Oriented Analysis and Design (OOAD).
· Strong knowledge on REST APIs.
· Experience working on Azure Cloud services IaaS, PaaS.
· Hands on Experience in working on Microsoft Azure Services like ADLS/Blob Storage solutions, Event Hubs, Service Bus, scale sets, Load Balancers, Azure Functions, Databricks.
· Hands on Experience in working on Kafka.
· Knowledge on continuous integration/continuous deployment.
· Experience of data migration and deployment from On-Prem to Cloud environment and vice-versa.
· Individual Contributor.
Nice-to-Have Skills:
· Certification on any cloud platform.
· Hands on experience on Docker Containers and micro services architecture using Kubernetes.
· Hand on experience in Golang programming.