02 Oct
|
Infosys
|
Hyderabad
Total Yrs. of Experience*
10+ Years
Relevant Yrs. of experience*
8+ Years
Detailed JD *(Roles and Responsibilities)
• 8+ years overall experience.
• Data engineers should be having good hands-on experience on below tech stack
• Tech Stack:
• AWS
• Databricks for ETL
• Airflow for orchestration
• Python, and dbt for developing ETL jobs (dbt is a mandatory and important skill)
• AWS CDK(Python)
• Gitlab (SCM and CI)
• Terraform for IaaC
• Previous Databricks ETL development experience
• Experience on Lake house architecture based on Databricks and Delta Lake
• Should have working knowledge on Multi-hop medallion architecture to divide the data lake into bronze, silver and hold layers based on the quality and reusability of the data stored there.
• Should have experience on Publishing Data product in Unity catalog
• Should be well versed with industry-standard DevOps practices: Code reviews, version control, Trunk-based development, CI/CD Testing
• Should be proficient with multiple languages: Python, SQL and DBT.
Mandatory skills*
AWS, Airflow, Databricks, Python, DBT
Desired skills*
• AWS
• Databricks for ETL
• Airflow for orchestration
• Python, and dbt for developing ETL jobs (dbt is a mandatory and significant skill)
• AWS CDK(Python)
• Gitlab (SCM and CI)
• Terraform for IaaC
📌 Data Engineers and Data Architects (Hyderabad)
🏢 Infosys
📍 Hyderabad