02 Oct
|
ValueLabs
|
Hyderabad
02 Oct
ValueLabs
Hyderabad
Job DescriptionRole: AWS Data Engineer
NExperience: 8+ Years
NWork location: Hyderabad
NTechnical Skills:
NProven experience as a Data Engineer or in a similar role.
NStrong proficiency in SQL scripting.
NProficiency in Pythonfor data manipulation and automation
NExperience with Apache Airflow for workflow orchestration
NHands-on experience with AWS Cloud services, including Lambda, DMS, and Glue.
NSolid understanding of data warehousing concepts, with practical experience using Snowflake. Enhance Operational Efficiency: Reduce Job Monitoring Time, Decrease Manual Operations.
NStrengthen Data and Infrastructure: Improve Data Quality, Accelerate Cloud Migration .
NDeepen Architectural and Cross-Functional Understanding: Enhance System Architecture Knowledge, Map Cross-Functional Dependencies
NJob Description:
N
n
Design, develop, and maintain ETL/ELT data pipelines to ingest data from various sources, including databases and flat files, into our data warehouse. N
Utilize AWS services such as AWS Lambda, AWS DMS, and AWS Glue for data ingestion and transformation processes. N
Develop and optimize Snowflake stored procedures to implement complex business logic and data transformations. N
Manage and monitor scheduled data workflows using Apache Airflow. N
Work closely with stakeholders to understand project requirements and translate them into technical solutions, ensuring seamless integration with existing data pipelines. N
Implement and maintain robust data quality checks to ensure accuracy and reliability of all delivered datasets and reports. N
Adhere to the full project delivery lifecycle, including requirements gathering, design, implementation, documentation, and obtaining user acceptance testing (UAT) approvals. N
Deliver data sets to other AWS accounts and support the creation of Power BI reports. N
📌 Hiring: Senior Data Engineer Hyderabad
🏢 ValueLabs
📍 Hyderabad