Tech stack: BigQuery , any ETL tool (Informatica, Talend, DataStage), Dataflow, Dataproc • 3-5 years Experience in Data warehouse and Data lake implementation • 1-2 years of experience in Google Cloud Platform (especially Big Query).
• 1-2 years of working experience in converting ETL jobs( in Informatica/Talend,/DataStage) into Dataflow or Dataproc and migrated in CICD pipeline • Design, develop and deliver data integration/data extraction solutions using IBM DataStage or other ETL tools and Data Warehouse platforms like Teradata, BigQuery.
• Proficiency in Linux/Unix shell scripting and SQL.
• Knowledge of data Modelling, database design, and the data warehousing ecosystem.
• Ability to troubleshoot and solve complex technical problems.
• Excellent analytical and problem-solving skills.
• Knowledge of working in Agile environments. Requirement 2: GCP Project Manager
Experience : 6+ Years
GCP Project Manager • 8-10 years project management experience in Data warehouse and Data lake implementation • 2 years of experience in Google Cloud Platform project management (especially Big Query). • Provide thought leadership for the development, structure, technology, and tools used • Manage delivery milestones and expectations, as well as highlighting Requirement 3: GCP Data Engineer ( with out ETL tools)
Experience : 3+ Years
- Mandatory: Person should be strong in Big Query a. Not just in migration experience but transforming data within Big Query workplace (2+ Yrs) b. Should be able to write complex SQL queries in a performance effective way 2. Mandatory: Python: a. Not just Python scripting. Development experience in Python(1+ Yr) b. Able to write Python programming to process data using any of the Python packages such as Pandas, NumPy, etc., Note: candidate has to work from Chennai Ford office [atleast for a week/month] 3. Good to have: Data Flow or Data Plex or Data Fusion or any GCP components: a. Working experience in any of the above 4. Good to have: a. Working experience on Airflow , Composer , Any scheduler 5. Nice to have: a. Knowledge of GCP Eco system.