17 Nov
|
Weekday (YC W21)
|
Pune
17 Nov
Weekday (YC W21)
Pune
This role is for one of our clients Industry: Artificial Intelligence
Company Name: Brillio
Seniority level: Mid-Senior Level
Min Experience: 5+ years
Location: Bengaluru, Pune, Maharashtra, India, Hyderabad, Telangana, India, Chennai, Tamil Nadu, India
JobType: full-time
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
Roles & Responsibilities:
- Develop and maintain scalable, cloud-native data processing pipelines on GCP
- Work extensively on BigQuery, DataFlow, Pub/Sub, Cloud Storage, and Airflow for orchestration
- Automate infrastructure using Terraform and follow agile development practices
- Implement data solutions for enterprise-scale data lakes and data warehouses
- Write clean, effective,
and production-ready code using Python and SQL
- Handle data quality issues including data duplication and debugging code failures
- Collaborate with cross-functional teams to build resilient and reliable data platforms
Additional Screening Points:
- Hands-on experience with debugging/analyzing production issues
- Exposure to identifying and resolving data duplication or consistency issues
- Should have worked on end-to-end data pipeline creation and monitoring
- Experience in the data engineering field is preferred
- Hands-on experience in GCP cloud data implementation suite such as Bl Query, Pub Sub, Data Flow/Apache Beam Airflow/Composer, Cloud Storage
- Strong experience and understanding of very large-scale data architecture, solutioning, and operationalization of data warehouses, data lakes, and analytics platforms
Hands On Strong Experience In The Below Technology
- GBQ Query
- Python
- Apache Airflow
- SQL (BigQuery preferred)
- Extensive hands-on experience working with data using SQL and Python
📌 GCP(Big query + SQL) Data Engineer (Pune)
🏢 Weekday (YC W21)
📍 Pune