What awaits you/ Job Profile
- Provide estimates for requirements, analyses and develop as per the requirement.
- Developing and maintaining data pipelines and ETL (Extract, Transform, Load) processes to extract data efficiently and reliably from various sources, transform it into a usable format, and load it into the appropriate data repositories.
- Creating and maintaining logical and physical data models that align with the organization//'s data architecture and business needs. This includes defining data schemas, tables, relationships, and indexing strategies for optimal data retrieval and analysis.
- Collaborating with cross-functional teams and stakeholders to ensure data security, privacy, and compliance with regulations.
- Collaborate with downstream application to understand their needs and build the data storage and optimize as per their need.
- Working closely with other stakeholders and Business to understand data requirements and translate them into technical solutions.




- Familiar with Agile methodologies and have prior experience working with Agile teams using Scrum/Kanban
- Lead Technical discussions with customers to find the best possible solutions.
- Proactively identify and implement opportunities to automate tasks and develop reusable frameworks.
- Optimizing data pipelines to improve performance and cost, while ensuring a high quality of data within the data lake.
- Monitoring services and jobs for cost and performance, ensuring continual operations of data pipelines, and fixing of defects.
- Constantly looking for opportunities to optimize data pipelines to improve performance

What should you bring along

Must Have:
- Hand on Expertise of 6- 8 years in AWS services like S3, Lambda, Glue, Athena, RDS, Step functions, SNS, SQS, API Gateway, Security, Access and Role permissions, Logging and monitoring Services.
- Positive hands on knowledge on Python, Spark, AWS CLI
- Hands on experience in Snowflake DBT
- Prior experience in working with streaming

📌 Data Engineer (Chennai)
🏢 VEGA Intellisoft Private
📍 Chennai