Hiring for a next-generation technology company building sovereign, secure, and scalable digital platforms across AI, Web3.0, cloud, and health-tech.
Hands-on Senior Data Engineer to build and maintain scalable data pipelines, lake house architecture, and analytics infrastructure. Work with up-to-date open-source technologies to enable data-driven insights and GenAI-powered analytics capabilities
Key Responsibilities
Data Ingestion & ETL
Build and maintain data pipelines using Airbyte from multiple sources
Configure connectors for databases (PostgreSQL, MySQL, MongoDB), APIs, SaaS applications
Implement CDC for real-time data replication or using kafka streaming
Design incremental and full-load sync strategies
Ensure data validation and quality checks
Workflow Orchestration
Develop and maintain Airflow DAGs for ETL workflows
Implement error handling, retry logic,
and monitoring
Schedule complex multi-step data pipelines
Integrate with databases, APIs, and external systems
Data Warehouse & Analytics
Design and optimize ClickHouse schemas for OLAP
Write advanced SQL queries and optimize performance
Implement materialized views and aggregations
Manage data partitioning and retention policies
Build data marts for analytics use cases
Lake House Architecture
Implement data lake house on object storage (Cloudian)
Design data partitioning strategies (by date, region)
Work with Parquet/ORC file formats
Implement access control and data governance
BI & Dashboards
Support Apache Superset and Power BI dashboard development
📌 Senior Data Engineer Noida
🏢 Hire Right Search Partners
📍 Noida
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.