- Design, develop, and maintain large-scale data pipelines using PySpark to extract insights from structured and unstructured data sources.
- Collaborate with cross-functional teams to identify business requirements and design scalable data models that meet those needs.
- Develop complex SQL queries to optimize database performance and troubleshoot issues related to data quality, integrity, and security.
- Ensure compliance with industry standards for data governance, privacy, and security by implementing robust access controls and monitoring mechanisms.
Job Requirements :
- 5.5-8.5 years of experience in a similar role as a Data Engineer or Lead Data Engineer.
- Robust expertise in Python programming language with proficiency in PySpark for big data processing.
- Experience with data modeling techniques using relational databases (e.g., PostgreSQL) or NoSQL databases (e.g., MongoDB).
- In-depth knowledge of SQL querying languages including joins, subqueries, aggregations.
📌 Lead Data Engineer (Tamil Nadu)
🏢 Eucloid Data Solutions
📍 Tamil Nadu
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.