Proven experience as a Data Engineer or in a similar role. -
/n
Robust proficiency in SQL scripting.
/n
Proficiency in Python for data manipulation and automation
/n
Experience with Apache Airflow for workflow orchestration
/n
Hands-on experience with AWS Cloud services, including Lambda, DMS, and Glue.
/n
Solid understanding of data warehousing concepts, with practical experience using Snowflake. Enhance Operational Efficiency: Reduce Job Monitoring Time, Decrease Manual Operations.
/n
Strengthen Data and Infrastructure: Improve Data Quality, Accelerate Cloud Migration .
/n
Deepen Architectural and Cross-Functional Understanding: Enhance System Architecture Knowledge, Map Cross-Functional Dependencies
/n
Job Description:
/n
/n
Design, develop, and maintain ETL/ELT data pipelines to ingest data from various sources, including databases and flat files,
into our data warehouse.
/n
Utilize AWS services such as AWS Lambda, AWS DMS, and AWS Glue for data ingestion and transformation processes.
/n
Develop and optimize Snowflake stored procedures to implement complex business logic and data transformations.
/n
Manage and monitor scheduled data workflows using Apache Airflow.
/n
Work closely with stakeholders to understand project requirements and translate them into technical solutions, ensuring seamless integration with existing data pipelines.
/n
Implement and maintain robust data quality checks to ensure accuracy and reliability of all delivered datasets and reports.
/n
Adhere to the full project delivery lifecycle, including requirements gathering, design, implementation, documentation, and obtaining user acceptance testing (UAT) approvals.
/n
Deliver data sets to other AWS accounts and support the creation of Power BI reports.
/n
📌 Senior Data Engineer Hyderabad
🏢 ValueLabs
📍 Hyderabad
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.