12 Sep
|
ShimentoX Technologies
|
Bengaluru
12 Sep
ShimentoX Technologies
Bengaluru
Job DescriptionHiring: Senior Data Engineer | 6+ Years
NLocation: Bangalore
NExperience: 6+ Years
NRole: Senior Data Engineer
NWe are looking for a highly skilled Senior Data Engineer with solid expertise in Data Architecture, System Design, Python, and SQL to design, build, and own end-to-end production data pipelines powering analytics and business decision-making.
NThe ideal candidate should have strong experience in transaction-level data modeling, data quality, auditability, data lineage, and production pipeline ownership, preferably within finance, risk, or compliance data domains.
NKey Responsibilities
n
N
- Own data architecture and system design decisions for data pipelines and data models.
N
- Design and build scalable, production-grade data pipelines end-to-end.
N
- Design transaction-level fact tables and standard fact/dimension models.
N
- Implement Bronze/Silver/Gold (Medallion) architecture.
N
- Build pipelines for finance, risk, or compliance use cases where accuracy and auditability are critical.
N
- Implement data quality controls, reconciliation, anomaly detection, and audit trails.
N
- Write complex SQL usingCTEs, window functions, CASE logic, COALESCE, NULLIF, and date/timestamp handling.
N
- Build idempotent data reload patterns and handle late-arriving or corrected records without double-counting.
N
- Develop and maintain Airflow-style DAGs and cross-pipeline dependencies.
N
- Build Python-based ETL tooling using Pandas, SQLAlchemy, and database drivers.
N
- Work with YAML-driven configurations and integrate with APIs where required.
N
- Own CI/CD processes using Git workflows.
N
- Document data models, pipeline logic, data lineage, and operational processes.
N
nMust-Have Skills
N6+ years of experience inData Engineering
NStrong Python + SQL expertise
NStrong Data Architecture and System Design skills
NEnd-to-end production pipeline ownership
NExpert SQL including Window Functions, CTEs, CASE logic
NStrong experience with MySQL / PostgreSQL
NExperience designing Transaction / Fact Tables
NStrong data quality, reconciliation, auditability, and lineage practices
NExperience with Airflow or similar orchestration tools
NStrong data modeling knowledge — Fact/Dimension, Normalization, Medallion Architecture
NGood to Have
n
n
- Finance, Risk, or Compliance data experience
N
- Spark / Hive / Hadoop experience
N
- YAML-based pipeline configuration
N
- CI/CD and Git workflows
N
- API integrations
n
- Experience with large-scale production data platforms
N
📌 Hiring: Senior Data Engineer | 6+ Years (Bengaluru)
🏢 ShimentoX Technologies
📍 Bengaluru