20 Nov
|
ALTIMETRIK
|
Bengaluru
20 Nov
ALTIMETRIK
Bengaluru
Experience: 8–10 years each
Location: Bengaluru, India | Employment Type: Full time
About the Role
As a Staff Engineer in Data and AI at Client, you will set the technical standard for data pipeline and AI platform engineering — driving architecture decisions, mentoring engineers, and delivering complex platform capabilities during a period of active platform transition.
Client Data Workplace
SQL Server CDC → Confluent/RedPanda → Redshift (Bronze/Silver/Gold) via DBT. EC2, DynamoDB, AWS Bedrock. Snowflake retiring. ~90% internal data.
Key Responsibilities
Design and deliver complex data pipelines across Redshift, MSK/RedPanda, DBT, and S3
Define engineering standards and best practices for the Data and AI platform team
Lead technical design for AI/ML infrastructure — including AWS Bedrock integrations and Claude-based workflows
Drive ingestion standardisation and canonical ID resolution as a platform-wide initiative
Collaborate with ML Engineers on data infrastructure for model training and inference pipelines
Implement data quality controls and observability across pipelines (Coralogix, Grafana)
Contribute to PCI DSS-compliant data handling: PAN masking, PII controls, TonicAI integration
Mentor Lead and Senior Engineers within the team
Required Skills & Experience
8–10 years in data engineering or AI platform engineering
Expert-level experience with AWS data services: EKS, ECS, Lambda, S3, EC2
Strong hands-on experience with Redshift and medallion/Bronze-Silver-Gold architecture
Proficiency with DBT for data transformation at scale
Experience with SQL Server CDC-based ingestion pipelines
Familiarity with event streaming platforms: Confluent, RedPanda, or Kafka
Experience building ML-ready data pipelines and feature engineering infrastructure
Familiarity with AWS Bedrock and GenAI pipeline patterns
Robust understanding of PCI DSS data handling requirements
Demonstrated ability to set technical direction and mentor engineers
Data Engineer, AWS, MS SQL, Communication
📌 Staff Engineer Bengaluru
🏢 ALTIMETRIK
📍 Bengaluru