01 Nov
|
MyCareernet
|
India
Company:IT Services Organization
Key Skills: Pyspark, AWS, Databricks, Python, Ms Sql, Azure Databricks
Roles and Responsibilities:
Design, develop, and maintain scalable batch and streaming data pipelines using AWS, PySpark, Azure Databricks, Python, and SQL.
Build and manage data lake, data warehouse, and cloud data platform solutions for high-volume enterprise workloads.
Develop data integrations across MS SQL Server, MySQL, and other structured data sources.
Implement data quality, validation, error handling, and operational controls across production pipelines.
Support containerized data services, API integrations, CI/CD automation, and production deployment processes.
Skills Required:
6 - 10 years of experience in data engineering, cloud data platforms, or large-scale data initiatives.
Solid hands-on experience with PySpark, Python, AWS, AWS Cloud, Azure Databricks, and SQL-based data engineering.
Experience designing cloud data platforms, data lakes, data warehouses, and scalable pipeline architectures.
Practical expertise with MS SQL Server, MySQL, and large-volume data processing.
Experience with cloud services, APIs, microservices, Docker, Kubernetes, Git, and CI/CD practices.
Positive to Have:
Experience with Databricks.
Education: Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.
📌 Data Engineer Aws Chennai (India)
🏢 MyCareernet
📍 India