07 Nov
|
Nous Info Solution
|
Hyderabad
07 Nov
Nous Info Solution
Hyderabad
We are looking for an experienced Data Engineer with solid hands-on expertise in AWS, PySpark, Python, and Databricks. The ideal candidate should have experience in designing, developing, and maintaining scalable data pipelines, implementing data processing solutions, and building robust ETL/ELT workflows on cloud platforms.
Roles & Responsibilities
Design, develop, and maintain scalable data pipelines using Python, PySpark, and Databricks.
Develop and optimize ETL/ELT workflows for processing large volumes of structured and unstructured data.
Work extensively with AWS services such as S3, Glue, Lambda, EMR, Redshift, and Athena.
Develop data transformation and processing logic using PySpark and Python.
Build and manage data engineering solutions using snowflake
Work with Delta Lake, Delta Tables, and Lakehouse architecture.
Implement data ingestion, cleansing, transformation,
and aggregation processes.
Optimize Spark jobs and troubleshoot performance issues.
Implement data quality checks, error handling, and monitoring mechanisms.
Collaborate with data architects, data analysts, and business stakeholders.
Ensure data security, governance, and compliance across data pipelines.
Participate in code reviews, technical discussions, and deployment activities
Role: Data Engineer, Industry Type: Miscellaneous, Department: Engineering - Software & QA, Employment Type: Full Time, Permanent Role Category: Software Development Education UG: Any Graduate Key Skills Skills highlighted with ‘‘ are preferred keyskills snowflakePysparkData Pipeline
📌 Excellent Opportunity For Data Engineers Hyderabad
🏢 Nous Info Solution
📍 Hyderabad