31 Oct
|
MyCareernet
|
Chennai
31 Oct
MyCareernet
Chennai
Company:IT Services Organization Key
Skills:
Pyspark, AWS, Databricks, Python, Ms Sql, Azure Databricks Roles and
Responsibilities:
• Design, develop, and maintain scalable batch and streaming data pipelines using AWS, PySpark, Azure Databricks, Python, and SQL.
• Build and manage data lake, data warehouse, and cloud data platform solutions for high-volume enterprise workloads.
• Develop data integrations across MS SQL Server, MySQL, and other structured data sources.
• Implement data quality, validation, error handling, and operational controls across production pipelines.
• Support containerized data services, API integrations, CI/CD automation, and production deployment processes. Skills Required:
• 6
- 10 years of experience in data engineering, cloud data platforms, or large-scale data initiatives.
• Solid hands-on experience with PySpark, Python, AWS, AWS Cloud, Azure Databricks, and SQL-based data engineering.
• Experience designing cloud data platforms, data lakes, data warehouses, and scalable pipeline architectures.
• Practical expertise with MS SQL Server, MySQL, and large-volume data processing.
• Experience with cloud services, APIs, microservices, Docker, Kubernetes, Git, and CI/CD practices. Good to Have:
• Experience with Databricks.
Education:
Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.
📌 Data Engineer (Chennai)
🏢 MyCareernet
📍 Chennai