- Be a part of a growing team, We are looking for a Platform Engineer I candidate to join our IT Development team in Hyderabad,
- Create automated processes to measure data quality, failures, and errors
- Analyze existing systems and data pipes to identify areas for improvement or opportunities to enhance
- Continue to help evolve and improve the data quality processes and templates
- Profile data sources to understand existing quality issues in the ETL processes
- Collaborate on data modeling tasks including recommending and evaluating designs based on Kimball dimensional data modeling practices
- Aggregate and combine raw information from different data sources
- Explore ways to enhance data quality and reliability including helping with the development of support and remediation processes
- Identify opportunities for data acquisition
- Develop analytical tools and processes to measure and report data quality
- Help adjust and tune existing CI/CD framework and processes (Azure Dev Ops) as needed to improve data quality
Skills
- Proficient in SQL, Python, and Spark
- Data Engineer Stack: Data Pipelines implementation, SQL, Snowflake/Iceberg
- Bachelors Degree or higher in a technical field such as Engineering, Computer Science, etc.
- Minimum 3+ years of experience designing, building, and supporting data pipes