- Design and implement scalable, reliable, and secure
data architectures.

- Develop best practices and frameworks for data
integration, governance, and security.

- Define and drive the roadmap for enterprise data
solutions aligned with business objectives.

- Architect, build, and optimize ETL/ELT pipelines
using Azure Data Factory (ADF), Databricks, and PySpark.

- Work with SQL and big data technologies to ensure
efficient data processing and storage.

- Design and manage data lakes, data warehouses, and
cloud-based storage solutions.

- Implement cloud-based data solutions, primarily using
Microsoft Azure (Azure Data Factory, Azure Synapse, Azure Databricks).

- Ensure cost-effective and high-performance cloud
solutions for data processing and analytics.

- Lead and mentor a team of data engineers, ensuring
adherence to best practices.

- Collaborate with stakeholders, including data
analysts, business leaders, and software engineers, to define and
implement data-driven solutions.

- Provide technical guidance and architectural
direction for complex projects.

- Ensure high availability, scalability, and
performance of data systems.





- Implement data security policies and ensure
compliance with industry standards (GDPR, HIPAA, etc.).

- Optimize data storage and retrieval for maximum
efficiency and cost savings.

Requirements

- Proven
experience in designing and implementing large-scale data solutions.

- SQL:
Advanced skills in query optimization and database management.

- PySpark:
Strong experience in data transformation and processing.

- Databricks:
Hands-on experience in big data frameworks and analytics.

- Azure
Data Factory (ADF): Expertise in orchestrating ETL/ELT pipelines.

- Cloud
Platforms: Strong experience with Azure (preferred), AWS, or GCP.

- Data
Warehousing: Deep understanding of data modeling, data lakes, and data
warehouse architectures.

- Solution
Architecture: Ability to design end-to-end data solutions for enterprises.

- Strong
leadership and team management skills.

- Excellent
problem-solving and analytical thinking.

- Effective
communication and stakeholder management.

- Ability to work in a fast-paced and energetic
environment.

📌 Lead Data Engineer (Coimbatore)
🏢 Recognized
📍 Coimbatore