20 Aug
|
Tech Vedika Software
|
Hyderabad
20 Aug
Tech Vedika Software
Hyderabad
Data Engineers lead is responsible for leading a team in offshore (Viet Nam, India) to developing and operationalizing data pipelines to make data available for consumption (reports and advanced analytics).
This includes data ingestion, data transformation, data validation/quality, data pipeline optimization,
orchestration; and engaging with DevOps Engineer during CI/CD.
The role requires leading skills and grounding in programming and SQL, followed by expertise in data storage, modeling, cloud, data warehousing, and data lakes, ETL tools. The Data Engineer Lead will work closely with customer Data Architects, Data Scientists and BI Engineers to design and maintain scalable data models and pipelines.
Data engineer lead will transfer requirements to the offshore team, lead the team to ensure the project delivers high quality products to customers.
The Data Engineer Lead also spends time developing data pipelines and/or data integrations stack.
Job Duties/Essential Functions
Leads DE team with one offshore member but can ramp-up sooner. This includes providing guidelines for team members, reviewing output, and the quality of team members.
Work as bridge between customer and offshore team. Present solution to customer, get feedback work with team to update accordingly, as well as transfer requirement, feedback from customer in a clear manner.
Lead technical design activity from project team, ensure the output, quality meet, exceed customer s expectation.
Build data models and develop data pipelines to store data in defined data models and structures.
Identifies ways to improve data reliability, efficiency and quality of data management.
Assesses the integrity of data from multiple sources.
Works in tandem with Data Architects,
Data Stewards and Data Quality Engineers to design data pipelines and recommends ongoing optimization of data storage, data ingestion, data quality and orchestration.
Designs, develops, implements ETL/ELT processes using Dbt (Data build tool), Informatica
Intelligent Cloud Services (IICS).
Uses Google Cloud Google cloud services such as Google Cloud Storage, Cloud Pub/Sub, Cloud
Data Fusion, Dataflow, Dataproc to improve and speed up delivery of data products and services.
Experience, Skills, Education Licenses/Certifications
Required
5+ years experience engineering and operationalizing data pipelines with large and complex datasets.
5+ years hands-on experience with DBT and IICS.
4+ years experience working with Cloud technologies such as Data flow, Data Fusion, Pub/Sub,
Dataform, dbt, Bigquery, Cloud SQL
Advanced SQL skills required. Solid understanding of relational databases and business data; ability to write complex SQL queries against a variety of data sources.
4+ years experience with Data Modeling, ETL, and Data Warehousing.
Robust understanding of database storage concepts (data lake, relational databases, NoSQL, Graph,
data warehousing).
Azure experience is a plus.
Qualifications
Recommendation
Google data cloud certifications.
Experience with Git/Azure DevOps.
Experience delivering data solutions through agile software development methodologies.
Exposure to the retail industry.
Excellent verbal and written communication skills.
Proficient in Google Workspace applications, including Sheets, Docs, Slides, and Gmail
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 Google Data Engineer (Hyderabad)
🏢 Tech Vedika Software
📍 Hyderabad