13 Aug
|
Aptus Data LAbs
|
Bengaluru
13 Aug
Aptus Data LAbs
Bengaluru
Job Title: Senior Data Engineer
Location: Remote
Experience: 5â8 Years
Employment Type: Full-Time
About the Role
Aptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. Youâll work on modern data lake architectures and high-performance pipelines in AWS, enabling real-time insights and scalable analytics.
This role reports to the Head â Data Platform and AI Lead, offering a unique prospect to be part of a cross-functional team shaping the future of data-driven innovation.
Key Responsibilities
Data Engineering & Pipeline Development
- Design and develop reliable, reusable ETL/ELT pipelines using AWS Glue, Python, and Spark.
- Process structured and semi-structured data (e.g., JSON, Parquet, CSV) efficiently for analytics and AI workloads.
- Build automation and orchestration workflows using Airflow or AWS Step Functions.
Data Lake Architecture & Integration
- Implement AWS-native data lake/lakehouse architectures using S3, Redshift, Glue Catalog, and Lake Formation.
- Consolidate data from APIs, on-prem systems, and third-party sources into a centralized platform.
- Optimize data models and partitioning strategies for high-performance queries.
Security, IAM & Governance Support
- Ensure secure data architecture practices across AWS components using encryption, access control, and policy enforcement.
- Implement and manage AWS IAM roles and policies to control data access across services and users.
- Collaborate with platform and security teams to maintain compliance and audit readiness (e.g., HIPAA, GxP).
- Apply best practices in data security, privacy, and identity management in cloud environments.
DevOps & Observability
- Automate deployment of data infrastructure using CI/CD pipelines (GitHub Actions, Jenkins, or AWS CodePipeline).
- Create Docker-based containers and manage workloads using ECS or EKS.
- Monitor pipeline health, failures, and performance using
📌 Sr Data Engineer (Bengaluru)
🏢 Aptus Data LAbs
📍 Bengaluru