31 Oct
|
MyCareernet
|
Chennai
31 Oct
MyCareernet
Chennai
Company:IT Services Organization
Key Skills: Pyspark, AWS, Databricks, Python, Ms Sql, Azure Databricks
Roles and Responsibilities:
- Design, develop, and maintain scalable batch and streaming data pipelines using AWS, PySpark, Azure Databricks, Python, and SQL.
- Build and manage data lake, data warehouse, and cloud data platform solutions for high-volume enterprise workloads.
- Develop data integrations across MS SQL Server, MySQL, and other structured data sources.
- Implement data quality, validation, error handling, and operational controls across production pipelines.
- Support containerized data services, API integrations, CI/CD automation, and production deployment processes.
Skills Required:
- 6 - 10 years of experience in data engineering, cloud data platforms, or large-scale data initiatives.
- Solid hands-on experience with PySpark, Python, AWS, AWS Cloud, Azure Databricks, and SQL-based data engineering.
- Experience designing cloud data platforms, data lakes, data warehouses, and scalable pipeline architectures.
- Practical expertise with MS SQL Server, MySQL, and large-volume data processing.
- Experience with cloud services, APIs, microservices, Docker, Kubernetes, Git, and CI/CD practices.
Good to Have:
- Experience with Databricks.
Education: Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.
📌 Data Engineer - AWS (Chennai)
🏢 MyCareernet
📍 Chennai