18 Nov
|
cirruslabs
|
Bengaluru
18 Nov
cirruslabs
Bengaluru
Location : All over India
Notice Period : Immediate Joiner
Role & responsibilities
Key Responsibilities Design, develop, and optimize scalable ETL/ELT pipelines using AWS Glue, PySpark, Python, and SQL. Build automated data ingestion, transformation, validation, and orchestration workflows across multiple cloud and SaaS platforms. Develop and maintain data models for cloud cost, usage, billing, and consumption analytics.
Work with FinOps and AI FinOps datasets, including AWS, Azure, GCP, and AI service consumption. Process and analyze AI token consumption, tokenomics, model-level usage, and cost allocation across AI providers. Implement data quality checks, monitoring, error handling, and performance optimization.
Must-Have Skills AWS Glue: Strong hands-on experience with Glue ETL jobs, PySpark, and workflow automation. ETL & Data Engineering: Python, SQL, data transformation, orchestration, and pipeline optimization.
Data Modeling: Experience designing normalized, dimensional, and analytical data models.
FinOps:
Understanding of cloud billing, cost allocation, consumption, and usage analytics. AI FinOps & Tokenomics: Understanding of LLM token usage (input/output/cached tokens), model pricing, API consumption, and AI cost analytics.
Automation: Ability to build reliable, scalable, and production-ready data pipelines.
Good to Have Experience with AWS CUR, Azure Cost Management exports, or GCP billing datasets. Exposure to Amazon Bedrock, Azure OpenAI, OpenAI, Anthropic, or Google Vertex AI consumption data.
Experience with MongoDB, Amazon Redshift, or other analytical databases. Familiarity with FOCUS (FinOps Open Cost and Usage Specification).
Ideal Candidate: A hands-on Data Engineer with solid AWS Glue and ETL automation expertise, capable of working with complex cloud billing and AI consumption datasets to build scalable FinOps and AI FinOps analytics solutions.
📌 Aws Data Engineer + FinOps (Bengaluru)
🏢 cirruslabs
📍 Bengaluru