We deliver the world s most complex projects Work as part of a collaborative and inclusive team Enjoy a varied challenging role Building on our past Ready for the future Worley is a global qualified services company of energy chemicals and resources experts headquartered in Australia Right now we re bridging two worlds as we accelerate to more sustainable energy sources while helping our customers provide the energy chemicals and resources that society needs now We partner with our customers to deliver projects and create value over the life of their portfolio of assets We solve complex problems by finding integrated data-centric solutions from the first stages of consulting and engineering to installation and commissioning to the last stages of decommissioning and remediation Join us and help drive innovation and sustainability in our projects The Role As a Principal Digital Solutions Consultant with Worley you will work closely with our existing team to deliver projects for our clients while continuing to develop your skills and experience etc As part of the Data Solutions team this role exists to design develop and support any data integration solutions across various projects and reengineer integration solutions in BAU leveraging AWS stack Create and maintain optimal data pipeline architecture by designing and implementing data ingestion solutions on AWS using AWS native services Design and Optimize data models on AWS Cloud using AWS data stores such as Redshift DynamoDB RDS S3 etc Design Operations architecture and conduct performance engineering for large scale data lake in production environment Participate in Client design workshops and provide tradeoffs and recommendations towards building solutions Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platform Develop and maintain ETL jobs using AWS Glue services to process and transform data at scale Optimize and troubleshoot AWS Glue jobs for performance and reliability Utilize Python and PySpark to efficiently handle large volumes of data during the ingestion process Collaborate with data architects to design and implement data models that support business requirements Create and maintain ETL processes using Airflow Python and PySpark to move and transform data between different systems Implement monitoring solutions to track data pipeline performance and proactively identify and address issues Manage and optimize databases both SQL and NoSQL to support data storage and retrieval needs Familiarity with Infrastructure as Code IaC tools like Terraform AWS CDK and others Proficiency in event-driven integrations batch-based and API-led data integrations Proficiency in CICD pipelines such as Azure DevOps AWS pipelines or Github Actions About You To be considered for this role it is envisaged you will possess the following attributes Technical and Industry Experience Independent Integration Developer with over years of experience in developing and delivering integration projects in an agile or waterfall-based project environment Proficiency in Python PySpark and SQL programming language for data manipulation and pipeline development Hands-on experience with AWS Glue Airflow Dynamo DB Redshift S3 buckets Event-Grid and other AWS services Experience implementing CI CD pipelines including data testing practices Proficient in Swagger JSON XML SOAP and REST based web service development Behaviors Required Driven by our values and purpose in everything we do Visible active hands on approach to help teams be successful Strong proactive planning ability Optimistic energetic problem solver ability to see long term business outcomes Collaborative ability to listen compromise to make progress Stronger together mindset with a focus on innovation creation of tangible realized value Challenge status quo Education - Qualifications Accreditation Training Required Degree in Computer Science and or related fields AWS Data Engineering certifications desirable Moving forward together We want our people to be energized and empowered to drive sustainable impact So our focus is on a values-inspired culture that unlocks brilliance through belonging connection and innovation We re building a diverse inclusive and respectful workplace Creating a space where everyone feels they belong can be themselves and are heard And we re not just talking about it we re doing it We re reskilling our people leveraging transferable skills and supporting the transition of our workforce to become experts in today s low carbon energy infrastructure and technology Whatever your ambition there s a path for you here And there s no barrier to your potential career success Join us to broaden your horizons explore diverse opportunities and be part of delivering sustainable change Worley takes personal data protection seriously and respects EU and local data protection laws You can read our full Recruitment Privacy Notice Here Please note If you are being represented by a recruitment agency you will not be considered to be considered you will need to apply directly to Worley Technical and Industry Experience Degree in Computer Science and or related fields Experience implementing CI CD pipelines including data testing practices Hands-on experience with AWS Glue Airflow Dynamo DB Redshift S3 buckets Event-Grid and other AWS services Independent Integration Developer with over years of experience in developing and delivering integration projects in an agile or waterfall-based project environment

📌 Principal Digital Solutions Consultant (Karnataka)
🏢 Worley
📍 Karnataka