20 Oct
|
Tata Consultancy Services
|
India
20 Oct
Tata Consultancy Services
India
Role- Data Engineer (GCP, Python, SQL)
Desired Experience Range- 6-10years
Location- Bangalore
Must-Have
At least 5+ years work experience including hands-on asData engineer on Google Cloud Platform (GCP)
Experience in GCP tools Dataflow and Bigquery
Experience in Data Build Tool (DBT)
Experience in different data formats (Avro, Parquet)
Experience in data query languages (SQL or similar)
Experience in data centric programming using one of more programming languages Python, Java /or Scala.
Good understanding of different data modelling techniques and trade-off
Knowledge of NoSQL and RDBMS databases
Have a cooperative and co-creative mindset with excellent communication skills
Motivated to work in an setting that allows you to work and take decisions independently
Experience in working with data visualization tools
Fluent in English both written and verbal
Good to have
GCP services (Big query, Pub/sub. data flow, cloud functions), DBT, Terraform. SQL), BQ, DBT, CICD
Experience in GCP tools Dataflow, Dataproc and Bigquery
Experience in data processing framework Beam, Spark, Hive, Flink
Business understanding of retail industry
Role & Responsibilities-
Take end-to-end responsibility to build, optimize and support of existing and new data products towards the defined target vision
Be a champion of DevOps mindset and principles and able to manage CI/CD pipelines and terraform as well as Cloud infrastructure, in our context, it is GCP (Google Cloud Platform).
Ensure that our built data products work as independent units of deployment and non-functional aspects of the data products follow the defined standards for security, scalability, observability, and performance.
Work close to the Product Owner and other stakeholders around vision for existing data products and identifying current data products to support our customer needs
Work with product teams within and outside our domain around topics that relate to the data mesh concept.
Evaluate and drive continuous improvement and reducing technical debt in the teams
Maintain expertise in latest data/analytics and cloud technologies.
📌 Data Engineer Gcp, Python, Sql Bengaluru (India)
🏢 Tata Consultancy Services
📍 India