17 Nov
|
Emerge
|
Hyderabad
Our client is growing their team to improve the data infrastructure and accelerate delivery.
The Senior Data
Engineer will be a subject matter expert of our data infrastructure to support reporting, analytics, and data science. The right candidate will have strong data architecture, ETL, Python, Spark and SQL skills, and a proven track record partnering with both the business and data team colleagues to construct a framework which delivers on all our needs. The candidate will also have strong operational skills to drive efficiency and speed, expertise in building repeatable data engineering processes, robust project management skills, and a vision for how to deliver data products. The candidate will responsibly leverage AI to accelerate development, maintaining full ownership of all outputs while mastering the codebase to ensure clean architecture and prevent software bloat.
Position Responsibilities
- Lead the design, development, and orchestration of complex, mission critical data pipelines in a state-of-the-art AWS environment (Redshift, EC2, EMR, S3, Lambda, AWS Glue, S3 Tables, Zero-ETL, CDK, Terraform, git, etc.)
- Promote and implement a consistent vision for improving and automating manual processes, optimizing data delivery, re-designing infrastructure for scalability, etc.
- Responsible of promoting and maintaining a consistent and highest quality code base for reliability and maximum performance
- Develop and implement data security and privacy protocols
- Rapidly develop and maintain a clear understanding of the business and how our work relates
- Self-sufficient, able to pace work and determine urgency
- Mentor and coach junior engineers in all these aspects
What You Bring
- Bachelor's degree or higher in a quantitative/technical field (e.g., Computer Science, Statistics, Engineering) or equivalent experience
- 8+ years of relevant experience in Data engineering
- 8+ years of SQL knowledge for various reporting and transformation needs (Redshift, Spark, MySQL, PostgreSQL, Athena, Snowflake, Databricks)
- 8+ years of experience in Python (experience building reusable classes preferred)
- 8+ years of experience with schema design and dimensional data modeling
- You develop an understanding of the business and its strategy, and how our work contributes to meeting business goals
- Experience with building flexible and scalable Data Lake architectures, and with combining structured and unstructured data into unified representations.
- Analytical mindset with the ability to structure and process qualitative data and draw insightful conclusions.
- Data science and machine learning experience
- GIS experience a plus
- Data visualization experience with tools like Tableau a plus
- Experience with JIRA preferred
- Must be an intellectually curious self-starter and motivated to continually learn.
Emerge seeks, in all its operations, to employ individuals for available positions based on their qualifications, working knowledge, and competency. Emerge has a continuing commitment to ensure that fair and equal employment opportunities are extended to all qualified persons without regard to race, color, religion, sex, gender, sexual orientation, national origin, ethnicity, alienage, citizenship or immigration status, age, mental or physical disability, medical condition, pregnancy, military/veteran status, predisposing genetic characteristics, familial status, marital status, domestic violence victim status, or based on their relationship or association with members of a protected class or any other protected classification, in accordance with applicable federal, state and local laws. Emerge is committed to diversity in its most inclusive sense. By completing an application with us, you seek to join a team of hardworking professionals dedicated to consistently deliver outstanding service to our customers and contribute to the financial success of the organization, its clients and its employees. Equal access to programs, services and employment is available to all qualified persons. Those applicants requiring accommodation to complete the application and/or interview process should contact our Emerge Recruitment Office.
📌 Sr. Data Engineer (Hyderabad)
🏢 Emerge
📍 Hyderabad