30 Oct
|
Incedo Technology Solutions
|
Gurugram
30 Oct
Incedo Technology Solutions
Gurugram
Data Engineer - AWS, Glue & PySparkJob Summary :We are looking for a skilled Data Engineer with strong experience in AWS and PySpark to design, develop, and maintain scalable data pipelines and data processing solutions. The ideal candidate should have hands-on experience in data engineering, data transformation, and cloud-based data processing. Knowledge of Apache Flink, AWS Glue, and Python will be an added advantage.Key Responsibilities :- Design, develop, and maintain scalable data pipelines using AWS and PySpark.- Build and optimize ETL/ELT processes for data ingestion, transformation, and processing.- Work with large datasets and implement efficient data processing solutions using PySpark.- Develop and maintain data workflows and ensure data quality, accuracy,
and reliability.- Leverage AWS services to build and manage cloud-based data engineering solutions.- Troubleshoot and optimize data pipelines to improve performance and scalability.- Collaborate with cross-functional teams to understand business requirements and deliver effective data solutions.- Implement best practices for data security, monitoring, and pipeline performance.Required Skills :- Solid hands-on experience in Data Engineering.- Good experience with AWS cloud services.- Strong expertise in PySpark for large-scale data processing and transformation.- Experience in developing and maintaining ETL/ELT pipelines.- Understanding of data warehousing, data modelling, and distributed data processing concepts.- Strong problem-solving and analytical skills.Experience : 6 - 8 YrsNotice : Immediate to 15 Days (ref:hirist.tech)
📌 Incedo - Data Engineer - AWS/PySpark (Gurugram)
🏢 Incedo Technology Solutions
📍 Gurugram