02 Sep
|
Hinduja Tech
|
Surat
02 Sep
Hinduja Tech
Surat
Job DescriptionData Engineer (8+ Years Experience) – Heavy Data Analytics Project
NTech Stack: Spark, PySpark, Scala, Python, SQL, Databricks, Data Lake, Data Warehouse, Snowflake, Azure (ADF/Synapse/ADLS)
NExpected Skill set as percustomer– Azure Databricks, Spark, Python, Delta Table, Snowflake basics, and prior experience on data ingestion/transformation.
NAbout the Role
nWeare hiring a Data Engineer with strong hands-on experience in building high‑performance data pipelines for a heavy data analytics project. The candidate must be excellent at writing complex aggregations, understanding business processes and analytical requirements, and designing scalable data lake and data warehouse solutions. Experience across multiple data platforms (Databricks, Snowflake, Azure Data Factory, Synapse, etc.) is a robust advantage.
NKey Responsibilities
n1. Data Pipeline & ETL/ELT Development
N
- Develop, optimize, and productionize Spark (PySpark/Scala) pipelines.
N
- Ingest, transform, cleanse, and aggregate large datasets from varied sources.
N
- Implement scalable ETL/ELT logic for batch and near-real-time pipelines.
N
- Apply best practices inpartitioning, caching, Delta Lake optimization, and performance tuning.
N2. Heavy Data Analytics &Business; Understanding
N
- Write complex aggregation logic (window functions, rollups, grouping sets, analytical functions).
N
- Understand business KPIs, metrics, and analytical use cases.
N
- Translate business needs into technical transformations and data models.
N
- Validate data outputs against business logic and analytics expectations.
N
- Collaborate with analysts on calculations: weekly/monthly aggregates, trend lines, performance metrics, dimensional rollups.
N
- Ensure accuracy, consistency, and traceability of business-critical metrics.
N3. Data Lake Engineering
N
- Build and maintain multi-layer Data Lake architectures (Bronze/Silver/Gold).
N
- Work with Parquet, Delta Lake, ORC, and colu
📌 Opportunity For Data Engineer (Surat)
🏢 Hinduja Tech
📍 Surat