Desired Competencies (Technical/Behavioral Competency) Must-Have** (Ideally should not be more than 3-5) •
Bachelors or masters degree in computer science, Engineering, Mathematics, or related field. • 5+ years’ experience in Python development, with a strong emphasis on data engineering. • Proven experience with AWS cloud services for data engineering and analytics. • Expertise in designing algorithms and system architectures for high performance data processing. • Robust hands-on experience with ETL frameworks, data warehousing, and distributed systems (e.g., Spark, Hadoop). • Deep understanding of database technologies (SQL, NoSQL) and data modeling. • Experience with logging, monitoring, and dashboarding tools (e.g., CloudWatch, Grafana, DataDog). • Experience with big data tools and stream processing (Kafka, Flink). • Excellent problem-solving and communication skills.
Good-to-Have • Knowledge of DevOps practices in a data engineering context. • Exposure to machine learning pipelines or experience working on ML models is a plus. • Familiarity with containerization (Docker, Kubernetes) and CI/CD workflows. Role & responsibilities