13 Oct
|
GoAudits
|
India
Company Description GoAudits is a mobile app and end-to-end solution for audits and inspections that helps organizations improve quality, safety, standards, and compliance. The platform replaces paper forms and spreadsheets with custom digital checklists, photo and note capture, and offline functionality on iOS and Android devices. Customers use GoAudits to run faster inspections, gain real-time visibility into operational performance, and continuously enhance their business standards.
The solution is tailored for a wide range of use cases, including internal audits, health and safety checks, facilities and equipment inspections, and quality assurance. It is adopted across multiple industries such as retail, hospitality, manufacturing, construction, transport, healthcare, and more, with dashboards, automated reports, and follow-up actions to support data-driven decision-making.
Role OverviewThe Data Engineer will be responsible for designing and implementing high-performance data architectures focused on ClickHouse. This role involves building robust data warehouses and marts, managing sophisticated ETL/ELT pipelines, and ensuring the scalability and performance of our analytical platforms.
Key Responsibilities
- Design, and implement high-performance data warehouses and data marts using ClickHouse.
- Develop and manage end-to-end data pipelines for real-time and batch processing using Airflow and Kafka.
- Optimize ClickHouse clusters for large-scale analytical queries and storage efficiency.
- Collaborate with engineering teams to define data architecture and integration strategies.
- Implement monitoring and logging for pipeline health and database performance.
- Ensure high availability, disaster recovery, and data security across the entire data stack.
- Establish best practices for data governance, schema versioning, and migration workflows.
Skills and Qualifications
- Expertise in ClickHouse architecture, including MergeTree engines, material views, and distributed tables.
- Proven experience in pipeline management using tools like Apache Airflow, dbt, or similar.
- Solid understanding of columnar storage, data compression, and OLAP optimization.
- Experience with message brokers such as Apache Kafka or RabbitMQ for streaming data.
- Advanced knowledge of data modeling (Star/Snowflake schema) and data mart design.
- Proficiency in SQL and scripting languages (Python/Go) for data automation.
- Hands-on experience with cloud infrastructure (AWS) and containerization (Docker/Kubernetes).
AI/ML Skillset
- Experience with AI/ML integration into end-to-end data pipelines for automated insights.
- Proficiency in developing predictive modeling workflows within analytical platforms.
- Hands-on implementation of LLMs and vector databases integrated with ClickHouse analytics.
Preferred Qualifications
- Knowledge of NoSQL databases (e.g., MongoDB, Cassandra).
- Experience with database migration and replication techniques.
📌 Data Engineer (India)
🏢 GoAudits
📍 India