Role Description
Data Engineer
- : Key Responsibilities
- Design, build, and measure ELT jobs to process disparate data sources and form a high integrity, high quality, clean data asset.
- Work closely with tech lead and senior engineers to implement and deliver enterprise data solutions including data strategy, feasibility and longevity of solutions, hands-on solution implementation and BAU support.
- Involve in stakeholders conversations to define multi-market data requirements and implement data and BI solutions
- Create and maintain data pipelines, integrations, and transformations to ensure productive data processing, storage, and retrieval. Ensure data infrastructure is scalable, efficient, and aligned with best practices in data management
- Extract, organize, and manage data to ensure accessibility for authorized users across the organization
- Perform data profiling, validation, and cleansing to maintain data integrity and accuracy.
- Perform unit test and conduct reviews with other team members to ensure code is rigorously designed, elegantly coded, and effectively tuned for performance.
- Implement internal process improvements with coordination, automate manual processes, debug inefficient pipelines for optimal performance and scalability.
- Understand and follow the best practices and proactively seek opportunities to automate and construct tools that streamline operations and enhance overall reliability.
- Collaborate with business analysts to understand requirements and use cases, translating them into technical stories and tasks.
Qualifications Experience
- 3-5 years of experience in Data Warehousing and Business Intelligence roles.
- Proficiency in Airflow Orchestration Pipelines, relational database design, data modelling, and data warehousing principles.
- Excellent programming skills in SQL, Python etc.
- Proficient in Shell scripting and building spark jobs.
- Knowledge on AWS services like S3, lambda, EMR, Cloud watch, Step functions.
- Knowledge of cloud services, relational database design principles, data warehousing, performance tuning, and optimization techniques.
- Experience in performance analysis and tuning to ensure optimal database performance
- Ability to analyze the business requirements
- Excellent communication skills with the ability to collaborate effectively with technical teams and business stakeholders to gather and refine requirements.
- Delivery-focused with a can-do attitude in challenging environments.
Other Key Competencies
- Considerable knowledge and experience of data warehousing strategies and techniques
- Experience in Vertica will be a plus
- Familiarity with agile development techniques and objectives
Skills SQL, Cloud Data Warehousing, Data Modeling, Python, ETL, Data Validation, AWS Lambda, Amazon S3, Apache Airflow, AWS Step Functions, Amazon EMR
📌 Associate III - Data Engineering (Hyderabad)
🏢 UST
📍 Hyderabad