18 Nov
|
Weekday (YC W21)
|
India
18 Nov
Weekday (YC W21)
India
This role is for one of our clients
Industry: Artificial Intelligence
Company Name: Brillio
Seniority level: Mid-Senior Level
Min Experience: 5+ years
Location: Bengaluru, Pune, Maharashtra, India, Hyderabad, Telangana, India, Chennai, Tamil Nadu, India
JobType: full time
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
Roles & Responsibilities:
Develop and maintain scalable, cloud-native data processing pipelines on GCP
Work extensively on BigQuery, DataFlow, Pub/Sub, Cloud Storage, and Airflow for orchestration
Automate infrastructure using Terraform and follow agile development practices
Implement data solutions for enterprise-scale data lakes and data warehouses
Write clean, effective,
and production-ready code using Python and SQL
Handle data quality issues including data duplication and debugging code failures
Collaborate with cross-functional teams to build resilient and reliable data platforms
Additional Screening Points:
Hands-on experience with debugging/analyzing production issues
Exposure to identifying and resolving data duplication or consistency issues
Should have worked on end-to-end data pipeline creation and monitoring
Experience in the data engineering field is preferred
Hands-on experience in GCP cloud data implementation suite such as Bl Query, Pub Sub, Data Flow/Apache Beam Airflow/Composer, Cloud Storage
Solid experience and understanding of very large-scale data architecture, solutioning, and operationalization of data warehouses, data lakes, and analytics platforms
Hands On Strong Experience In The Below Technology
GBQ Query
Python
Apache Airflow
SQL (BigQuery preferred)
Extensive hands-on experience working with data using SQL and Python
📌 Gcp Big Query + Sql Data Engineer Chennai (India)
🏢 Weekday (YC W21)
📍 India