18 Nov
|
L&T Technology Services
|
Bengaluru
18 Nov
L&T Technology Services
Bengaluru
Job Role : Senior Geospatial Data Engineer
Job Description : Senior Geospatial Data Engineer, Data Engineer - Azure Databricks and Data pipelines
No. Of Positions : 2
Role Overview
We're looking for a Senior Data Engineer - 1 number and Data Engineer - 1 number with geospatial specialization to join TotalEnergies Data Team in India and help build our global geospatial data solutions.
You'll work with Azure Databricks, Python and PySpark to transform raw geospatial data from different providers into reliable, ready-to-use data products. You'll be responsible for the full data lifecycle: data ingestion, quality checks, transformation, orchestration, optimization, pushing data to the Golden Data layer.
It's a hands-on role focused on building and maintaining geospatial data pipelines, working with diverse global datasets, and making geospatial data easier to access, trust and use across TotalEnergies.
The data products you develop will be consumed by thousands of users across the organisation, helping specialists and decision-makers assess opportunities, evaluate project feasibility, identify potential risks and optimise investment and operational decisions. You will be part of an international Data Team contributing to the development of scalable cloud-based data solutions and the continuous improvement of TotalEnergies global data ecosystem.
Required Qualifications
Master's degree in Computer Science, Data Engeneering, Geoinformatics, Geospatial Engineering from IIT, NIT, BITS, VIT, abroad
Experience (No. of Position)
- For Senior DE - 5+ years of experience in Data Engineering, including the development and maintenance of production data pipelines.
- For DE - 3 to 4 Years experience in Data Engineering, including the development and maintenance of production data pipelines.
Responsibilities
- Design, build, integrate, and maintain robust geospatial data pipelines (collection, preparation, transformation, storage, and dissemination of data) using Python, PySpark and Azure Databricks
- Produce clean,
high-quality, testable code.
- Ensure data quality, reliability, and scalability for the product.
- Implement data quality checks, deduplication, error handling and validation mechanisms.
- Implement monitoring, automated testing, and best practices for data flow reliability.
- Manage code repositories using GitHub, including cloning, branching, committing, pushing and maintaining code.
- Work with Azure Data Factory and related Azure services for data orchestration and integration.
- Expose geospatial data and analytics through APIs and services (e.g. OGC standards) for all branches applications and stakeholders,
- Process and integrate large-scale vector, raster, and imagery datasets (satellite, DEM, land use, environmental, infrastructure, constraints),
- Handle various geospatial data formats.
Day-to-Day Elements include:
- Data Engineering & Pipeline Development
- Data Quality & Reliability
- Collaboration & Agile Delivery
Preferred Skills
- Proven experience with Azure Databricks.
- Robust hands-on experience with Python and SQL, PySpark for data processing.
- Solid understanding of ETL/ELT concepts, data modelling, data transformation and data quality management.
- Understanding of importance of CRS (Coordinate reference system) and methods of it transformations.
- Experience with Git-based version control and collaborative software development workflows.
- Understanding of production deployment, pipeline monitoring, troubleshooting and performance optimisation.
- Strong analytical and problem-solving skills.
- Autonomous approach to troubleshooting and resolving complex technical issues
- Agile
Tools/software
- Python, Spark / Databricks, SQL, ETL, BatchAccount, GDAL, FME, Azure Data Factory, GitHub and version control (Git), Parquet, GeoJSON, QGIS
- Repository management and CI/CD practices.
- Knowledge in data modeling.
- Experience with a Cloud platform
- Ability to work in agile, cross-functional teams.
- Strong collaboration and communication skills.
- Interest in coaching others and driving technical excellence.
📌 Geospatial Engineer (Bengaluru)
🏢 L&T Technology Services
📍 Bengaluru