Das ist der Job
Ingest and process raw data using Spark and Amazon EMR for scalable, distributed computation.
Darum lohnt es sich
Requirements At least 5 years of experience as an Elasticsearch Data Engineer - ELK (Elasticsearch, Logstash, and Kibana) stack Expert knowledge) Java Spring Boot IBM ACE Programming BS in Computer Science, Data Engineering (Big Data, AWS certification), Data Modeling or similar Full English Fluency Strong understanding of data modeling, governance, and best practices in modern data architectures.
Role Summary Design, build, and manage end-to-end data pipelines across the medallion architecture—specifically the bronze, silver (base vault with DBT and orchestration tools, business vault), and gold layers. Develop and automate data transformations for the base vault using DBT (Data Build Tool) to standardize and model data efficiently.
Excellent analytical, problem-solving, and communication skills. Deep experience with Spark, Python and ETLs and Amazon EMR Hands-on experience with DBT for data transformation and modeling. Expert knowledge of Amazon S3 and Apache Iceberg for data storage and management. Experience with Kubernetes for container orchestration.
Experience with Dremio, Looker, or equivalent business view/semantic layer technologies AWS Cloud – Intermediate, AWS Lambda, Step Functions, IAM, SNS, API Gateway, VPC, Transit Gateway, Intermediate JSON - Intermediate Jenkins – Data Pipeline Intermediate CloudWatch - Intermediate ATS Optimization Keywords Hard Skills data pipelines Spark Amazon EMR DBT Java Spring Boot IBM ACE Programming data modeling ETL Python Kubernetes Soft Skills analytical skills problem-solving skills communication skills Certifications & Qualifications AWS certification Industry Keywords data governance data architecture medallion architecture data transformation business vault base vault gold layer silver layer bronze layer semantic layer Tools & Technologies Elasticsearch Logstash Kibana Amazon S3 Apache Iceberg Dremio Looker AWS Lambda Jenkins CloudWatch #J-18808-Ljbffr
