23 Mar
|
ThreatXIntel
|
Nellore
23 Mar
ThreatXIntel
Nellore
Apply on Kit Job: kitjob.in/job/42tupl
Company Description
n
ThreatXIntel is a growing Cybersecurity, IT Staffing, and Consulting company delivering end-to-end technology and security solutions. Our services include cloud security, web and mobile application security testing, DevSecOps, vulnerability assessments, IT consulting, and qualified staffing services .
n
We support global corporate clients by hiring and deploying skilled professionals across IT and cybersecurity domains while helping organizations strengthen security, optimize operations, and scale efficiently. ThreatXIntel is committed to enabling business growth through secure, reliable, and high-quality technology solutions.
n
Role Overview
n
We are looking for a Freelance Data Engineer with solid expertise in building and optimizing scalable ETL/ELT pipelines for batch and real-time data processing.
n
Key Responsibilities:
n
Design, develop, and maintain ETL/ELT data pipelines
Build batch and real-time ingestion,
transformation, and loading workflows
Work with Spark (PySpark/Scala) and streaming technologies like Kafka/Flink
Develop and optimize scalable data architectures including data lakes , data warehouses , and streaming platforms
Improve performance of Spark jobs, SQL queries, and data workflows for speed, efficiency, and cost optimization
Implement data quality checks, monitoring, and alerting systems
n
Required Skills:
n
Solid proficiency in Python and SQL
Experience with Apache Spark (Spark SQL, DataFrames, Streaming)
Hands-on experience with Kafka or Pub/Sub
Familiarity with GCP and/or Azure data services
Knowledge of BigQuery , Snowflake , Redshift , and NoSQL databases
Experience with Airflow, Databricks, Docker, and Kubernetes is a plus
Apply on Kit Job: kitjob.in/job/42tupl
📌 Freelance Data Engineer,spark, Kafka, Bigquery, Gcp/azure Nellore
🏢 ThreatXIntel
📍 Nellore