15 Nov
|
SolarSquare
|
India
Role
Data (hybrid)
About The Role
As a Data Engineer at SolarSquare, you will own the end-to-end lifecycle of our data infrastructure. You will design and build scalable, reliable data pipelines and architect a contemporary data platform that turns raw, messy data into clean, trusted data products for decision-making across the business.
You will work closely with product managers, data analysts, data scientists, and software engineers to understand data needs and deliver high-performance solutions.
What You'll Own
Platform & Architecture:
Design, implement, and manage our cloud-based data platform using a contemporary ELT approach.
Continuously monitor and tune performance and cost.
Ingestion & Data Lake:
Build and maintain robust ingestion pipelines from operational databases (MongoDB, RDS), real-time IoT streams, and third-party APIs.
Build and run a scalable, cost-effective data lake on AWS S3, using open table formats such as Apache Iceberg or Delta Lake.
Transformation & Orchestration:
Develop, test, and maintain complex transformation models in dbt or equivalent.
Bring a software engineering mindset: version control (Git), CI/CD, and automated testing applied to all data logic.
Implement and manage pipeline orchestration with tools such as Dagster, Apache Airflow, or equivalent.
Data Quality & Governance:
Set and enforce data quality standards.
Put automated testing and monitoring in place so every data asset is reliable and 3 - 5 years of qualified experience in a data engineering role.
Expert-level SQL, including writing complex, high-performance queries.
Solid Python, with proven experience building and maintaining data pipelines.
Hands-on experience building data solutions on AWS or Azure.
Experience with NoSQL databases such as MongoDB.
Deep understanding of data warehousing concepts: dimensional modeling, star/snowflake schemas.
Hands-on experience with dbt.
Familiarity with orchestration tools such as Apache Airflow, Dagster, or Prefect.
Proficiency with Git and experience with CI/CD pipelines.
Nice To Have
Experience with real-time streaming technologies (AWS Kinesis or Azure Event Hubs).
Experience with data cataloging and governance tools.
Knowledge of infrastructure-as-code tools such as Terraform or CloudFormation.
Experience with containerization (Docker, Kubernetes).
(ref:hirist.tech)
📌 Solarsquare Energy Data Engineer Mumbai (India)
🏢 SolarSquare
📍 India