21 Aug
|
solve IT consultant
|
India
21 Aug
solve IT consultant
India
Role: Data Engineer with SAP Migration Experience
Location: Remote
Joiner Status: Immediate Joiner (or candidates with a notice period of 15 days or less)
Mandatory Skills: PySpark, Advanced SQL, Databricks, SAP Migration
Role Overview
We are seeking a highly experienced and motivated
Data Engineer
to join our agile data platform team. The successful candidate will be a critical player in designing, building, and optimizing our next-generation data architecture and pipelines.
This role requires expert-level proficiency in PySpark and SQL, alongside a proven track record of architecting scalable, high-performance ETL/ELT processes. You will transform vast amounts of raw data into high-quality, actionable insights for analytics, reporting, and Machine Learning. Given the seniority of this role, we are looking for a seasoned leader and immediate joiner who can hit the ground running and contribute significantly from day one.
Key ResponsibilitiesData Pipeline Development & Optimization
- Design and Build:
Architect, develop, and maintain robust, scalable,
and fault-tolerant ETL/ELT pipelines for ingesting data from diverse sources (e.g., databases, APIs, streaming sources) into our data lake and data warehouse.
- PySpark Expertise:
Write and optimize complex data transformation jobs using PySpark and the Spark DataFrame API to process petabytes of structured and unstructured data efficiently.
- SQL Mastery:
Utilize Advanced SQL for complex querying, data manipulation, stored procedures, performance tuning, and optimizing database schema design in relational and analytical databases.
- Data Quality & Governance:
Implement data validation, cleansing, and monitoring routines to ensure high data quality, integrity, and adherence to security and governance standards.
Architecture and Infrastructure
- Data Modeling:
Design and implement optimal data models (e.g., Dimensional Modeling, Data Vault, Snowflake Schema) for our data warehouse to support business intellige
📌 Data Engineer with SAP migration experience (India)
🏢 solve IT consultant
📍 India