BetaEdge Solutions is a trusted technology partner delivering scalable IT and ERP solutions for growing businesses across the UAE and beyond. The company specializes in managed IT services, Odoo ERP implementation, cloud and network solutions, cybersecurity, custom software development, IT consulting, and digital marketing support. With a remote-first team and operations in Dubai and Abu Dhabi,
Role Description The Senior Data Architect & AI Data Engineer is a full-time remote role responsible for designing and implementing robust data architectures that support advanced analytics and AI-driven solutions. This position involves defining data models, building and maintaining data pipelines, and optimizing data warehousing environments to ensure high performance, reliability, and scalability. The role includes establishing data governance standards, managing data quality, and collaborating with cross-functional teams to align data structures with business and ERP requirements.
Day-to-day tasks include architecting ETL workflows, integrating data from multiple systems, enabling secure access to data assets, and supporting the deployment of AI and machine learning use cases on production-ready data platforms. The individual will also contribute to technical documentation, mentor team members, and recommend best practices for data strategy and architecture.
Qualifications
- Strong foundation in data architecture and data modeling, with experience designing scalable, secure, and maintainable data solutions.
- Hands-on expertise in data warehousing concepts and platforms,
including dimensional modeling, performance tuning, and analytics-ready structures.
- Proficiency in Extract Transform Load (ETL) processes and tools, including building, orchestrating, and monitoring data pipelines across cloud and on-prem environments.
- Experience establishing and managing data governance, including data quality, metadata management, access controls, and compliance with relevant regulations.
- Solid background in AI and machine learning data engineering, including feature engineering, model data preparation, and integration with AI platforms.
- Build sophisticated entity resolution, matching and deduplication logic.
- Identify duplicate owners, properties, buildings and contacts across multiple data sources.
- Develop data-quality rules, validation frameworks and exception handling.
- Design source-to-target mappings for Excel, CSV, APIs and other datasets.
- Maintain complete data lineage and auditability.
- Design historical data and change-tracking strategies.
- Build efficient ETL/ELT and data transformation pipelines.
- Optimize PostgreSQL queries, indexes and database performance.
- Work with large datasets using Python-based data-processing technologies.
- Design analytics-ready and AI-ready datasets.
- Implement vector-based data structures and semantic-search capabilities where appropriate.
- Support AI agents and intelligent automation with trusted structured data.
- Define metadata, data dictionaries, naming standards and governance rules.
- Collaborate with backend, frontend, DevOps and AI engineers.
- Review existing data models and continuously improve architecture, performance and reliability.
- Experience with cloud data platforms, including storage, compute, and orchestration tools.
- Bachelor’s or master’s degree in Computer Science, Information Systems, Data Engineering, or a related field, or equivalent practical experience.
- Strong communication and collaboration skills, with the ability to work effectively in a remote, cross-functional team environment.
Required Technical Skills
- PostgreSQL
- Advanced SQL
- Python
- Data Architecture
- Data Modeling
- Relational Database Design
- ETL / ELT
- Data Cleansing
- Data Quality
- Entity Resolution / Record Matching
- Deduplication
- Master Data Management
- LLM integrations
- AI/ML data pipelines
- AI/ML data pipelines
- Geospatial data
We are hiring immediately and will fast-track solid candidates. Immediate joiners and candidates with short notice periods are strongly preferred. Apply directly through LinkedIn or send your CV to:
[email protected] Email subject: Senior Data Architect & AI Data Engineer Immediate Joiners Preferred.
📌 Senior Data Architect & AI Data Engineer (Kerala)
🏢 BetaEdge Solutions
📍 Kerala