Title: AWS Glue & Databricks Location: Bangalore Exp: 6 Years Job Description: Lead end-to-end SAP Fieldglass implementations including requirement gathering solution design configuration testing deployment and hypercare support. Conduct workshops with business stakeholders to understand contingent workforce Statement of Work (SOW) and external workforce management requirements. Configure SAP Fieldglass modules and workflows based on business and regulatory requirements. Design and implement workflows approval processes user roles permissions rate structures business rules notifications and master data. Develop functional specifications and coordinate with technical teams for integrations with SAP ERP/S4HANA SAP SuccessFactors HR systems procurement systems identity management and third-party applications. Support integration design using appropriate SAP Fieldglass integration capabilities including APIs and file-based interfaces. Lead data migration activities including data mapping cleansing validation and reconciliation. Prepare and execute SIT UAT regression testing and deployment activities. Responsibilities: Design and implement the data modeling data ingestion and data processing for various datasets Design develop and maintain ETL Framework for various new data source Develop data ingestion using AWS Glue/ EMR data pipeline using PySpark Python and Databricks. Build orchestration workflow using Airflow & databricks Job workflow Develop and execute adhoc data ingestion to support business analytics.
Proactively interact with vendors for any questions and report the status accordingly Explore and evaluate the tools/service to support business requirement Ability to learn to create a data-driven culture and impactful data strategies. Aptitude towards learning new technologies and solving complex problem. Qualifications: Minimum of bachelors degree. Preferably in Computer Science Information system Information technology. Minimum 5 years of experience on cloud platforms such as AWS Azure GCP. Minimum 5 year of experience in Amazon Web Services like VPC S3 EC2 Redshift RDS EMR Athena IAM Glue DMS Data pipeline & API Lambda etc. Minimum of 5 years of experience in ETL and data engineering using Python AWS Glue AWS EMR /PySpark and Airflow for orchestration. Minimum 2 years of experience in Databricks including unity catalog data engineering Job workflow orchestration and dashboard generation based on business requirements Minimum 5 years of experience in SQL Python and source control such as Bitbucket CICD for code deployment. Experience in PostgreSQL SQL Server MySQL & Oracle databases. Experience in MPP such as AWS Redshift AWS EMR Databricks SQL warehouse & compute cluster. Experience in distributed programming with Python Unix Scripting MPP RDBMS databases for data integration Experience building distributed high-performance systems using Spark/PySpark AWS Glue and developing applications for loading/streaming data into Databricks SQL warehouse & Redshift. Experience in Agile methodology Proven skills to write technical specifications for data extraction and valuable quality code. Experience with big data processing techniques using Sqoop Spark hive is additional plus Experience in data visualization tools including PowerBI Tableau. Nice to have experience in UI using Python Flask framework and /or React/Angular JS.