Key Responsibilities

Data Engineering & Platform Development
- Design and implement scalable, reliable, and secure data pipelines.
- Develop ETL/ELT solutions for processing large-scale structured and unstructured datasets.
- Build data ingestion frameworks supporting batch and near real-time processing.
- Design and optimize data models for analytics, reporting, and machine learning workloads.
- Ensure high data quality, governance, observability, and reliability across data platforms.

Cloud & Data Warehouse
- Architect and maintain cloud-native data solutions on AWS or Azure or GCP.
- Develop and optimize solutions using Snowflake or equivalent cloud data warehouse technologies.
- Implement data lake and lakehouse architectures.
- Optimize storage costs, compute utilization, and query performance.

Software Engineering Excellence
- Perform code reviews and establish engineering best practices.
- Drive architectural decisions and technology selection.
- Ensure adherence to security, scalability, and reliability standards.

CI/CD & DevOps
- Automate build, test, deployment,



and monitoring processes.
- Manage Infrastructure as Code (IaC) using Terraform, CloudFormation, or similar tools.
- Improve deployment reliability and observability.

AI & Advanced Analytics
- Enable AI/ML workflows by building robust feature and training data pipelines.
- Work with AI teams to operationalize machine learning models.
- Explore Generative AI, LLM integrations, vector databases, and AI-driven automation solutions.
- Support model monitoring, governance, and deployment pipelines.

Leadership & Mentoring
- Provide technical leadership across multiple engineering teams.
- Mentor senior engineers and establish engineering standards.
- Collaborate with architects, product managers, and business stakeholders.
- Drive innovation and strategic technology initiatives.

Qualifications

10+ years of experience in Data Engineering.
- Solid expertise in Python programming.
- Advanced SQL de

📌 Principal Software Engineer (Chennai)
🏢 Nielseniq
📍 Chennai