Key Responsibilities

- Ownership of Data Warehouse models and curation (Snowflake, Redshift, DBT)

- Design, build, and optimize data pipelines using

PySpark and

Python for scalability and reliability

- Implement and manage workflow orchestration with

Airflow for scheduling and automation

- Manage infrastructure-as-code with

Terraform to ensure reproducibility and reliability of data environments

- Build and manage serverless and distributed data processing workflows using

AWS Glue

,

EMR

, and

Lambda

- Drive the evolution of the data environment to deliver high-quality data, speed, and availability

- Curate source-system data — including RDBMS sources — to deliver trusted, analytics-ready datasets

- Provide input and involvement on data cataloging and data management efforts

- Own production ETL/ELT performance tuning and environment-level resource consumption and management

- Drive the migration of POC pipelines to production-ready processes

- Lead technical decision-making on data architecture and mentor junior/mid-level engineers

- Collaborate with analytics, product, and business teams to ensure data solutions align with organizational needs

Qualifications





- 10+ years of experience in data engineering and data warehouse development

- Strong SQL development skills with expertise in performance tuning on RDBMS (Postgres, MySQL, or similar)

- Mandatory experience with: Terraform, Airflow, Snowflake, Redshift, DBT, Python, and PySpark

- Hands-on experience with

AWS Glue

,

EMR

, and

Lambda for building scalable, distributed data pipelines

- Bachelor's or Master's degree in Computer Science, Information Technology, or related field

- Proven experience designing and delivering enterprise-scale data warehouses and marts to support business analytics

- Experience developing data curation and integration processes, metadata management, and data quality initiatives

- Experience with streaming and real-time data processing (Spark, Databricks optional)

- Familiarity with ETL tools (

Fivetran valuable to have

)

- Experience working with broader AWS services — Step Functions, S3, CloudFormation

- Knowledge of CI/CD workflows and source control (GitHub Actions, GitLab)

- Demonstrated experience leading data engineering initiatives or mentoring teams

📌 Principal Data Architect (Hyderabad)
🏢 Evoke Technologies
📍 Hyderabad