Avatar for Digital Commerce Intelligence

AI-powered Online Market Share Data & Competitive Intelligence for Brands in SEA

Software Developer (Data)

$54k – $72k • No equity
Apply now
At DCI (Digital Commerce Intelligence Pte Ltd), we are committed to build South East Asia’s most intelligent digital commerce intelligence platform that enables brands & retailers to better understand and effectively drive their eCommerce Performance.

What you'll be doing:

- Develop infrastructure to ingest, transform, store and manage data feeds from web scrapers, APIs or CSV /Excel files
- Containerise existing implementation using Kubernetes and Docker to make data ingestion scalable
- Debugging running data pipelines (e.g changes in APIs, file formats, scraped data) is critical
- Working with analytics teams to improve analytics dashboards and machine learning models trained from the data pipelines.

What experience you should have :

- Experience in Web Scraping
- Understanding of modern full-stack web application architecture
- Strong technical communication skills, work ethic, open to learning new skills and capable of adapting to dynamic situations.

Your technical skill set include:

- Highly skilled in Python.
- Knowledge of Linux command line & networking, especially HTTP
- Knowledge of Clojure, Java and Javascript is a plus
- Knowledge of CI/CD and DevOps practices is a plus
- Experience with Tor/ other web proxy methods would be a plus
- Experience working with containerisation tools such as Docker & Kubernetes.
- Experience in Microsoft Azure Cloud Suite a plus.