About the Role

We are looking for a skilled and motivated Azure Data Engineer with 48 years of experience to join our growing Data & Analytics practice. The ideal candidate will have strong analytical capabilities and hands-on experience building scalable data pipelines using Azure cloud services, PySpark, and Spark SQL.

You will work closely with architects, data scientists, and business stakeholders to design and deliver modern data solutions that enable actionable insights and drive business value.

Key Responsibilities

- Design, develop, and maintain scalable data ingestion and transformation pipelines on Azure.
- Build and optimize ETL/ELT workflows using Azure Data Factory, Azure Databricks, Azure Synapse Analytics and Microsoft Fabric.
- Develop data processing logic using PySpark and Spark SQL for batch and streaming workloads.
- Implement data models and curate datasets for analytics and reporting.
- Optimize Spark jobs for performance and cost efficiency.
- Work with structured and semi-structured data sources (SQL, JSON, Parquet, etc.).
- Ensure data quality, consistency, and reliability through validation frameworks.
- Collaborate with stakeholders to understand business requirements and translate them into technical solutions.
- Participate in architectural discussions and contribute to best practices.
- Implement CI/CD pipelines for data workloads using Azure DevOps or similar tools.
- Troubleshoot production issues and provide root cause analysis.
- Document technical designs, data flows, and operational procedures.





Required Skills & Qualifications

Technical Skills

- 4-8 years of hands-on experience in Data Engineering roles.
- Strong proficiency in SQL (complex joins, window functions, performance tuning).
- Solid experience with PySpark and Spark SQL for large-scale data processing.
- Hands-on experience with:
- Azure Data Factory
- Azure Databricks
- Azure Synapse Analytics
- Azure Data Lake Storage Gen2
- Microsoft Fabric

- Experience working with modern data lake or Lakehouse architectures.
- Strong understanding of distributed data processing concepts.
- Familiarity with data modeling techniques (star/snowflake schemas).
- Experience with Git-based version control and CI/CD pipelines.
- Exposure to streaming technologies (Event Hubs/Kafka/Structured Streaming) is a plus.

Analytical & Soft Skills

- Strong analytical and problem-solving abilities.
- Ability to break down complex business problems into scalable technical solutions.
- Excellent communication skills with the ability to collaborate across teams.
- Self-driven with a continuous learning mindset.
- Ability to handle multiple priorities in a fast-paced workplace.

Preferred / Nice-to-Have

- Azure certifications such as DP-203 or DP-700.
- Exposure to AI
- Experience with Power BI or semantic modeling.
- Exposure to data governance tools (Microsoft Purview, Unity Catalog, etc.).
- Knowledge of Python best practices and performance optimization.
- Experience in Agile/Scrum environments.

📌 Azure Data Engineer (Telangana)
🏢 PRAVAL INFOTECH
📍 Telangana