10 Aug
|
Netlink Computer
|
Pune
10 Aug
Netlink Computer
Pune
Design, develop, and maintain efficient and scalable data pipelines using Python, PySpark, and Databricks on AWS.
Work closely with data scientists, analysts, and other engineers to ensure smooth data integration and high-quality data processing.
Build and optimize complex ETL (Extract, Transform, Load) workflows to handle large datasets.
Implement data ingestion and transformation logic using PySpark on Databricks to improve data processing performance.
Ensure data quality, accuracy, and consistency across all data pipelines.
Collaborate with cross-functional teams to identify and resolve bottlenecks in data systems.
Utilize AWS cloud services (e.g., S3, Redshift, RDS, EMR) for data storage and management.
Write SQL queries to extract, manipulate, and transform data stored in relational databases.
Develop, deploy, and maintain APIs for integrating data systems and enabling data access.
Monitor and troubleshoot data pipelines, ensuring they operate smoothly with minimal downtime.
Stay up to date with the latest industry tools, technologies,
and best practices in cloud data engineering and big data processing.
Job Category: Data Services
Job Type: Full Time
Job Location: Pune Gurgaon noida
Experience: 5+ Years
Design, develop, and maintain productive and scalable data pipelines using Python, PySpark, and Databricks on AWS.
Work closely with data scientists, analysts, and other engineers to ensure smooth data integration and high-quality data processing.
Build and optimize complex ETL (Extract, Transform, Load) workflows to handle large datasets.
Implement data ingestion and transformation logic using PySpark on Databricks to improve data processing performance.
Ensure data quality, accuracy, and consistency across all data pipelines.
Collaborate with cross-functional teams to identify and resolve bottlenecks in data systems.
Utilize AWS cloud services (e.g., S3, Redshift, RDS, EMR) for data storage and management.
Write SQL queries to extract, manipulate, and tra
📌 Data Engineer (Pune)
🏢 Netlink Computer
📍 Pune