Technical Specialist

Experience: 5 to Not Available years

Location: Pune, India

Skills: AWS, Databricks, PySpark, SQL, Python, Apache Spark, S3, Lambda, Glue, EMR, Redshift, Step Functions, Delta Lake, MLflow, Databricks Workflows, Structured Streaming, Auto Loader, Delta Live Tables, CI/CD, DevOps, Jenkins, Git, GitLab

Job Summary
Data Platform Data bricks developer (AWS)

Key Responsibilities
Develop and monitor scalable data infrastructure on Amazon Web Services (AWS)
Build and optimize ETL/ELT pipelines using Databricks, PySpark, and SQL
Collaborate with data analysts and stakeholders to understand data requirements
Implement data governance and security using Unity Catalog and AWS Lake Formation
Troubleshoot and resolve performance issues across data workflows
Document data flows, architecture, and operational procedures
Participate in CI/CD and DevOps practices using Jenkins and Git/GitLab

Required Skills & Experience
5+ years of data engineering experience, with 3+ years on Databricks and AWS
Strong proficiency in Python, SQL, and Apache Spark
AWS services: S3, Lambda, Glue, EMR, Redshift, Step Functions




Experience with Delta Lake architecture (Bronze, Silver, Gold layers)
Knowledge of MLflow, Databricks Workflows
Exposure to Structured Streaming, Auto Loader, Delta Live Tables (DLT)
Understanding of data modeling, data warehousing, and BI integrations

Key Responsibilities
1. To architect| design and develop (through Team) solution for product/project & sustenance delivery
2. To support as an SME
3. To ensure knowledge up-gradation and work with current technologies so that the solution is current and meets quality standards and the client requirements
4. To train and develop team so as to ensure that there is an adequate supply of trained manpower in the said technology and deliver risks are mitigated
5. To gather specifications and deliver solutions to the client organization based on understanding of a domain or technology
6. To review project deliverables.
7. To recommend client value creation initiatives and implement industry best practices (on specific technology/product)
Skill Requirements
null
Other Requirements
null

📌 Technical Specialist (Pune)
🏢 HCL Technologies
📍 Pune