Senior Data Engineer

Job Description

Company Description

Josh Software is relentlessly focused on discovering, developing, and delivering innovative solutions that connect our customers to the people they serve through the advanced use of technology. With our reach, range and resources, we provide our customers with a universal platform for driving their vision into their markets using consistent and reliable technology solutions. Josh Software has more than 15 years of experience and operates in key strategic geographies in the USA, Middle East (Dubai), SE Asia, and India.

Must-Have:

Experience with relational SQL Database (e.g. Postgres, MySQL), NoSQL (e.g. MongoDB) Database, and Big Data Tool (e.g. Hadoop Ecosystem, HDFS, Redshift, DRUID)
Proficient in data processing, i.e. ingestion, cleaning and wrangling. (Experience in tool like Databricks, Spark, Kafka/Events hub, PySpark, Azure ADF)
Cloud Experience in any one of Azure Excellent communication
Strong in user requirements gathering, maintenance, and support
Highly organized, self-motivated, pro-active, and able to plan
Should have experience in handling Bank domain datasets
Should have experience handle huge data size (500 GB/Day) along with different source of data and different file formats

Good to have:

Data Engineer certification
Cloud Experience in any one of AWS or GCP
Experience in working with Agile methodologies like Scrum etc.
Experience with stream processing technologies (e.g., Kinesis, Kafka).
Familiar with profiling code and performance optimizations.
Experience with Docker, Kubernetes
Experience with Microservices for APIs
Experience in CICD, test-driven development

Qualifications

B.E/B.Tech in Computer Science, Engineering, or a related field.
5 - 9 Years of Experience

Interested candidates can share their cv on: [email protected]