16 Sep
|
Agilisium
|
Hyderabad
16 Sep
Agilisium
Hyderabad
We are looking for an experienced Data Engineer with strong expertise in PySpark, Databricks, Python, SQL, and Cloud technologies to join our data engineering team. The ideal candidate should have strong hands-on experience in building scalable data pipelines and working with cloud-based data platforms.
Job Location: Hyderabad / Chennai / Pune
Experience: 4+ Years
Work Mode: Work From Office (WFO)
Employment Type: Full-Time
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines using PySpark, Python, and Databricks.
- Develop and optimize complex SQL queries for data processing and performance.
- Build and maintain ETL/ELT pipelines for large-scale data processing.
- Work with AWS/Azure cloud services to develop and deploy data engineering solutions.
- Implement and manage workflow orchestration using Apache Airflow, AWS Step Functions, or similar tools.
- Work with data warehouses, data lakes, and up-to-date data platforms.
- Apply data modelling concepts to support analytical and reporting requirements.
- Implement best practices using Git, CI/CD, and version control.
- Troubleshoot data pipeline issues and optimize solutions for performance, scalability, and reliability.
- Collaborate effectively with cross-functional teams, architects, and business stakeholders.
Mandatory Skills:
- Strong expertise in PySpark and Databricks
- Strong hands-on experience with Python for Data Engineering
- Proficiency in SQL, including complex queries and performance tuning
- Hands-on experience with AWS or Azure
- Experience with data pipeline orchestration tools such as Airflow / AWS Step Functions
- Strong understanding of Data Modelling, Data Warehousing, and ETL/ELT
- Experience with Git and CI/CD practices
- Strong problem-solving and communication skills
📌 Data Engineer (Hyderabad)
🏢 Agilisium
📍 Hyderabad