01 Sep
|
Brillio
|
Bengaluru
Job Description
nAbout the Company
n
n
nWe're looking for a Senior Data Engineer to design, build, and support scalable cloud-native data platforms on AWS — someone equally comfortable in the weeds of a pipeline and thinking through system-level architecture. You'll own production-grade batch and streaming pipelines, modern lakehouse architectures, and reliable ETL/ELT solutions, working closely with engineering, analytics, and infrastructure teams to ship secure, scalable, high-performing data solutions.
n
n
nAbout the Role
n
n
nKey Responsibilities
n
n
n
- n
- Design, develop, and maintain batch and streaming data pipelines on AWS, with a strong eye toward end-to-end system design and reliability.n
- Build scalable ETL/ELT workflows using AWS Glue, PySpark, and SQL.n
- Develop event-driven ingestion solutions using Lambda, SQS, API Gateway, or EventBridge.n
- Design and optimize lakehouse architectures using Amazon S3 and modern table formats (e.g., Apache Iceberg).n
- Implement secure data access using IAM, Lake Formation, and AWS best practices.n
- Build reliable data processing with monitoring, logging, retry mechanisms, and data quality checks.n
- Build and support streaming solutions using Kafka, Amazon MSK, Kinesis, or similar.n
- Collaborate cross-functionally to deliver scalable, well-architected data platforms — occasionally partnering on infra (Terraform/CloudFormation, containers) where pipelines meet platform.n
n
n
nQualifications
n
n
n
- n
- Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent experience).n
- Proven experience designing, building, and supporting production data pipelines.n
- Solid analytical, problem-solving, and communication skills.n
n
n
nRequired Skills
n
n
n
- n
- 5+ years in Data Engineering with strong AWS expertise and solid system design fundamentals.n
- Hands-on with Glue, Lambda, S3, Athena, IAM, SQS, DynamoDB, CloudWatch, EMR, and ECR
📌 AWS Data Engineer (Bengaluru)
🏢 Brillio
📍 Bengaluru