31 Jul
|
Acura Solution
|
India
31 Jul
Acura Solution
India
Job Description:
Key Responsibilities :
-
Design, develop, and maintain scalable data pipelines and ETL processes to support various business needs.
-
Build and manage data workflows using the Databricks, GCP stack, including BigQuery, Cloud Dataflow, Cloud Storage, Pub/Sub, Cloud Composer, and other GCP services.
-
Implement data models and transformations using DBT (Data Build Tool) to support analytical requirements.
-
Collaborate with data analysts and scientists to understand and translate data needs into technical specifications.
-
Ensure data quality, integrity, and governance by implementing monitoring and alerting mechanisms, along with automated data validation processes.
-
Optimize and troubleshoot complex SQL queries and ETLjobs for performance and reliability.
-
Develop and maintain comprehensive documentation for data pipelines, ETL processes, and data models.
-
Stay up-to-date with the latest trends and technologies in data engineering, cloud computing, and analytics
Key Skills:
-
Extensive experience with the GCP stack, including BigQuery, Cloud Dataflow, Cloud Storage, Pub/Sub, Cloud Composer, and other GCP services.
-
Proficiency in using DBT (Data Build Tool) for data transformation and modeling.
-
Strong SQL skills, with the ability to write complex queries and optimize them for performance.
-
Experience with data integration tools and frameworks (e.g., Apache Airflow, QIik, GCP)
-
Experience working with real-time data streaming and processing (e.g., Apache Kafka, Pub/Sub).
-
Certification in GCP (e.g., Google Qualified Data Engineer) is a plus.
-
Experience in Agile/Scrum methodologies
📌 Sr. GCP Data Engineer (India)
🏢 Acura Solution
📍 India