Job Title: AI Data Engineer
Location - Remote
Type - Contract
Roles and Responsibilities:
- Own the initial data activation process by extracting customer data from various sources including credit bureaus and internal systems
- Apply business requirements and exclusions such as fraud, bankruptcy, and litigation filters to refine customer populations.
- Build and maintain robust data models and configurations that translate complex business rules into scalable data structures.
- Stage and prepare both structured and unstructured data sets, applying business logic to ensure data readiness for AI and analytics use cases.
- Document the population waterfall process, detailing each exclusion and transformation step to maintain full traceability.
- Conduct rigorous regression testing and data validation to ensure the integrity and accuracy of the final data sets.
- Utilize reverse-engineering techniques to verify that excluded customers are correctly omitted from final populations.
- Leverage AI tools to enhance data engineering workflows, including training and guiding AI solutions to automate and optimize repeatable tasks.
- Work closely with the Adobe team and other stakeholders to deliver high-quality, actionable data outputs.
- Continuously improve data processes by integrating AI capabilities such as Snowflake Cortex and Databricks AI functionalities.
Qualifications:
- Bachelor’s degree in Computer Science, Information Technology, Data Science, or related field.
- 4+ years of professional experience in Data Engineering or related roles.
- Strong expertise in data modeling, data configuration, and working with large-scale structured and unstructured data sets.
- Proven experience with Snowflake and Databricks platforms.
- Hands-on experience with SQL, data transformation, data staging, and data validation techniques.
- Demonstrated ability to apply business requirements to data structures and ensure data quality through regression testing.
- Practical knowledge of AI integration within data engineering workflows, including experience with AI-assisted code generation and optimization.
- Familiarity with Snowflake Cortex or similar AI-enabled data capabilities is highly desirable.
- Robust analytical, problem-solving, and communication skills with a keen attention to detail.
Tools and Technologies:
- Databricks (execution and data transformation platform)
- Snowflake (cloud data platform with AI capabilities including Snowflake Cortex)
- SQL and relational databases
- Data modeling and data configuration tools
- AI tools for code generation and workflow automation
- Data validation and regression testing frameworks
📌 AI Data Engineer (India)
🏢 Hyqoo
📍 India