Senior Data Engineer (Bengaluru)

Senior Data Engineer (Bengaluru)

15 Nov
|
CBA Cross Border Associates
|
Bengaluru

15 Nov

CBA Cross Border Associates

Bengaluru

### Job Summary Job Title: Senior Data Engineer

Location:
Bangalore
- Manyata Tech Park Business Team: Retail Tech ### Responsibilities
- Contribute to the full development life cycle, including requirement analysis, functional design, technical design, programming, testing, documentation, implementation and ongoing technical support for agile projects.
- Contribute to projects/CRs utilising Snowflake, DBT, Python, PySpark, AWS cloud technologies, Ab-Initio or any ETL tools, Teradata and Oracle.
- Understand our customers core business objectives and build end-to-end data-centric solutions to address them.
- Lead or participate in the definition, execution and communication of ETL strategy and technical solution.
- Develop complex data transformations, data cleansing and data aggregation logic using Ab-Initio or any other ETL tools, DBT, PySpark and SQL.
- Ensure high-quality code by performing thorough testing, code reviews and debugging pipelines, internal framework and components, dbt models and PySpark jobs.
- Cooperate with business and operational users, other data management staff and infrastructure teams to ensure adherence to client and company guidelines, restrictions and requirements as well as industry standards.
- Improve team development related processes that accelerate delivery, drive innovation, lower cost and improve quality.
- Adhere to the Code of Conduct. The Code of Conduct sets the standards of behaviour, actions and decisions we expect from our people. ### Must Have Skills
- Snowflake: Hands-on experience designing and building data solutions on Snowflake, including virtual warehouses, streams, tasks, Snowpipe, time travel and performance optimisation.
- dbt: Strong experience building modular, tested and documented data transformation models using dbt, including incremental models and CI/CD-driven workflows.
- AWS: Hands-on experience building cloud data solutions on AWS, including S3, Glue, EMR / EMR Serverless, Lambda, Step Functions / MWAA (Airflow),



EventBridge, SQS, Kinesis, MSK/Kafka, Redshift, Athena, Iceberg and IAM. AWS certification (e.g. AWS Certified Data Engineer) preferred.
- PySpark: Proven experience developing scalable, distributed data processing pipelines using PySpark.
- SQL: Advanced proficiency in writing complex, performant SQL for data transformation, analysis and pipeline development.
- Teradata: Solid experience with Teradata data warehousing, including utilities, query performance tuning and data modelling.
- ETL tools: Preferably extensive hands-on for enterprise ETL development (Ab-Initio, DataStage and etc.). ### Essential Skills
- 8+ years of experience in design or development in Analytics and Data Warehousing projects.
- Experience using AI tools such as Claude/Roo/Cline
- Experience in designing, building, and delivering enterprise-wide data ingestion, data integration and data pipeline solutions using Big Data and Data Warehouse platforms (e.g. Teradata, Snowflake). Preferably with at least 8 years of hands-on experience in a Data Engineering role.
- Extensive experience in ETL tools like GDE, Express-IT, Control centre, Mhub, Conduct-IT and Meta programming.
- Performance Optimisation: Optimising across environments, systems and resources.
- Root Cause Analysis: Debugging complex data issues across systems.
- Data Quality Frameworks: Implementing validation, cleansing, and reconciliation logic.
- Experience in building data solutions using AWS Cloud technology (EMR, Glue, Iceberg, Kinesis, MSK/Kafka, Redshift, S3, etc.). Preferably with 3+ years of hands-on experience and an AWS Certified Data Engineer certification.
- Robust Unix/Linux Shell scripting and programming skills.
- Proficient in SQL scripting, writing complex SQLs for building data pipelines on Teradata, Snowflake. Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Senior Data Engineer (Bengaluru)
🏢 CBA Cross Border Associates
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: senior data engineer (bengaluru) / bengaluru

Subscribe to this job alert:

Get the latest job offers by email for: senior data engineer (bengaluru) / bengaluru