14 Nov
|
SolarSquare
|
Mumbai
14 Nov
SolarSquare
Mumbai
Role Data (hybrid)
About The Role
As a Data Engineer at SolarSquare, you will own the end-to-end lifecycle of our data infrastructure. You will design and build scalable, reliable data pipelines and architect a modern data platform that turns raw, messy data into clean, trusted data products for decision-making across the business. You will work closely with product managers, data analysts, data scientists, and software engineers to understand data needs and deliver high-performance solutions. What You'll Own
• Platform & Architecture:
• Design, implement, and manage our cloud-based data platform using a up-to-date ELT approach.
• Continuously monitor and tune performance and cost.
• Ingestion & Data Lake:
• Build and maintain robust ingestion pipelines from operational databases (MongoDB, RDS), real-time IoT streams, and third-party APIs.
• Build and run a scalable, cost-effective data lake on AWS S3, using open table formats such as Apache Iceberg or Delta Lake.
• Transformation & Orchestration:
• Develop, test, and maintain complex transformation models in dbt or equivalent.
• Bring a software engineering mindset: version control (Git), CI/CD, and automated testing applied to all data logic.
• Implement and manage pipeline orchestration with tools such as Dagster, Apache Airflow, or equivalent.
• Data Quality & Governance:
• Set and enforce data quality standards.
• Put automated testing and monitoring in place so every data asset is reliable and 3
- 5 years of professional experience in a data engineering role.
• Expert-level SQL, including writing complex, high-performance queries.
• Strong Python, with proven experience building and maintaining data pipelines.
• Hands-on experience building data solutions on AWS or Azure.
• Experience with NoSQL databases such as MongoDB.
• Deep understanding of data warehousing concepts: dimensional modeling, star/snowflake schemas.
• Hands-on experience with dbt.
• Familiarity with orchestration tools such as Apache Airflow, Dagster, or Prefect.
• Proficiency with Git and experience with CI/CD pipelines. Nice To Have
• Experience with real-time streaming technologies (AWS Kinesis or Azure Event Hubs).
• Experience with data cataloging and governance tools.
• Knowledge of infrastructure-as-code tools such as Terraform or CloudFormation.
• Experience with containerization (Docker, Kubernetes). (ref:hirist.tech)
📌 SolarSquare Energy (Mumbai)
🏢 SolarSquare
📍 Mumbai