We are looking for a Senior Analytics Engineer to drive data excellence and innovation in our organization. As a thought leader in data engineering and analytics principles , you will be responsible for designing, building, and optimizing our data infrastructure while ensuring cost efficiency, security, and scalability . You will play a crucial role in managing Databricks and AWS usage , ensuring budget adherence, and taking proactive measures to optimize costs. This role also requires expertise in ETL processes, large-scale data processing, analytics, and data-driven decision-making , along with robust analytical and leadership skills.
Responsibilities
- Act as a thought leader in data engineering and analytics , driving best practices and standards.
- Oversee cost management of Databricks and AWS , ensuring resource usage stays within allocated budgets and taking corrective actions when necessary.
- Design, implement, and optimize ETL pipelines for incremental data loading , ensuring seamless data ingestion, transformation, and performance tuning.
- Lead migration activities ,
ensuring smooth transitions while maintaining data integrity and availability.
- Handle massive data loads efficiently , optimizing storage, compute usage, and query performance.
- Adhere to Git principles for version control, ensuring best practices for collaboration and deployment.
- Implement and manage DSR (Airflow) workflows to automate and schedule data pipelines efficiently.
- Ensure data security and compliance , especially when handling PII data , aligning with regulations like GDPR and HIPAA.
- Optimize query performance and data storage strategies to improve cost efficiency and speed of analytics.
- Collaborate with data analysts and business stakeholders to enhance analytics capabilities, enabling data-driven decision-making.
- Develop and maintain dashboards, reports, and analytical models to provide actionable insights for business and engineering teams.
Required Skills & Qual
📌 Data Engineer (Bengaluru)
🏢 Hp
📍 Bengaluru