Das ist der Job
Cost & Performance Optimization: Optimize BigQuery slot usage, autoscaling, and query performance.
Darum lohnt es sich
Our Tech Stack Data & Processing: BigQuery, Airflow Infrastructure: Kubernetes, GCP (Eventarc, Pub/Sub, Cloud Run) Programming: Python for API integrations, automation, and pipeline development Security & Cost Optimization: IAM, Policy Tags, encryption, BigQuery slot reservation management Your profile Several years of experience in data engineering, working with Google Cloud Platform (GCP) and modern data stack tools (GCP experience is a must-have) Strong Python skills for API integrations, automation, and data pipeline development Proven experience with BigQuery cost optimization and performance tuning Famil Your mission API-based Data Flows: Automate and manage REST API imports/exports for BigQuery, including both streaming and batch ingestion.
Airflow & Pipeline Orchestration: Maintain and optimize our Kubernetes-deployed Airflow environment, ensuring efficient DAG execution. Event-Driven Processing: Manage GCP’s resources as Eventarc and PubSub for event-driven workflows and integration with various services.
Reliability & Security: Implement monitoring, logging, and access controls to ensure data reliability and security.
