15 Nov
|
SolarSquare Energy
|
Mumbai
15 Nov
SolarSquare Energy
Mumbai
Role:Data EngineerLocation:Mumbai/Bengaluru (hybrid)About the Role:As a Data Engineer at SolarSquare, you will own the end-to-end lifecycle of our data infrastructure. You will design and build scalable, reliable data pipelines and architect a modern data platform that turns raw, messy data into clean, trusted data products for decision-making across the business.You will work closely with product managers, data analysts, data scientists, and software engineers to understand data needs and deliver high-performance solutions.What You'll Own:1. Platform & Architecture:- Design, implement, and manage our cloud-based data platform using a modern ELT approach.- Continuously monitor and tune performance and cost.2. Ingestion & Data Lake:- Build and maintain robust ingestion pipelines from operational databases (MongoDB, RDS), real-time IoT streams, and third-party APIs.- Build and run a scalable, cost-effective data lake on AWS S3, using open table formats such as Apache Iceberg or Delta Lake.3. Transformation & Orchestration:- Develop, test, and maintain complex transformation models in dbt or equivalent.- Bring a software engineering mindset: version control (Git), CI/CD,
and automated testing applied to all data logic.- Implement and manage pipeline orchestration with tools such as Dagster, Apache Airflow, or equivalent.4. Data Quality & Governance:- Set and enforce data quality standards.- Put automated testing and monitoring in place so every data asset is reliable and trustworthy.Must-haves:- 3 - 5 years of professional experience in a data engineering role.- Expert-level SQL, including writing complex, high-performance queries.- Solid Python, with proven experience building and maintaining data pipelines.- Hands-on experience building data solutions on AWS or Azure.- Experience with NoSQL databases such as MongoDB.- Deep understanding of data warehousing concepts: dimensional modeling, star/snowflake schemas.- Hands-on experience with dbt.- Familiarity with orchestration tools such as Apache Airflow, Dagster, or Prefect.- Proficiency with Git and experience with CI/CD pipelines.Nice to have:- Experience with real-time streaming technologies (AWS Kinesis or Azure Event Hubs).- Experience with data cataloging and governance tools.- Knowledge of infrastructure-as-code tools such as Terraform or CloudFormation.- Experience with containerization (Docker, Kubernetes). (ref:hirist.tech)
📌 SolarSquare Energy - Data Engineer (Mumbai)
🏢 SolarSquare Energy
📍 Mumbai