6+ years Hands-on expertise in building and managing data pipelines on the AWS platform, with EMR and Apache NiFi as core, essential skills.
- Design and implement complex data ingestion workflows from diverse data sources into the AWS workplace utilizing the full capabilities of Apache NiFi
- Develop, optimize, and troubleshoot sophisticated data processing jobs on Amazon EMR using frameworks such as Spark, Hive, and potentially others
- Solid understanding of core AWS data services, including S3, Glue, and Kinesis.
- A thorough understanding of data security and governance best practices in cloud environments.
- Exceptional problem-solving and analytical skills, with a proven ability to troubleshoot complex data pipeline issues.
- Excellent communication and collaboration skills, with the ability to articulate technical concepts clearly.
- Provide clear, concise, and organized documentation to establish and maintain standards and procedures.
", Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.