1 to 25 of 65 Permanent Flink Jobs

Python and/or other modern programming languages. Experience developing and orchestrating data pipelines using technologies such as DBT, Apache Spark, Airflow, Dagster, Kafka, Flink, or equivalent tooling. Solid understanding of data lakehouse, warehouse, and medallion architecture patterns. Experience applying DevOps and DataOps best practices including CI/ ...

Hands-on experience building, scaling, and shipping large-scale data platforms in production. Deep practical experience with distributed data processing frameworks (e.g., Apache Spark, Flink, Hadoop). Strong expertise in message brokers and event streaming platforms (e.g., Apache Kafka, Kinesis). End-to-end exposure to data pipeline lifecycle ...

Proven experience designing and building scalable data pipelines (ETL/ELT) for batch and streaming use cases using modern technologies (e.g., Python, SQL, Spark, Flink, Airflow) and advanced knowledge on the workings of these. Hands-on experience in building and operating workloads Databricks. Hands-on experience creating data visualizations ...

cloud strategy — contributing to cloud adoption initiatives, deploying Citi APIs on AWS and Azure Working with event streaming and messaging systems including Kafka, Flink, and Solace at enterprise scale This is a rare opportunity in financial services — a stable, well‐funded platform with the freedom to keep building ...

managing real-time data pipelines across a track record of multiple initiatives. Expertise in developing data backbones using distributed streaming platforms (Kafka, Spark Streaming, Flink, etc.). Experience working with cloud platforms such as AWS, GCP, or Azure for real-time data ingestion and storage. Programming skills in Python ...

Python programming. AWS, Azure, or GCP; Redshift, AWS Glue, Azure Synapse, Azure Data Factory, BigQuery, Dataflow, Databricks, or Snowflake. Apache Kafka, Amazon Kinesis, Apache Flink, or Spark Structured Streaming. Data modeling, data vault, lakehouse, and data mesh architecture. Data quality, catalogs, lineage, API design, data contracts, and event-driven ...

Spring components, including Spring Data JPA. Experience with containerisation technologies such as Docker and Kubernetes. Experience with stream processing frameworks such as Apache Flink is a plus but not required. Familiarity with SSO mechanisms including OpenID is a plus but not required. A basic understanding of core microservice components ...

Worked with one or more cloud platforms and services (AWS, Azure, GCP) Extensive hands‐on experience with modern data technologies, ETL tools (e.g. Kafka, Flink, DBT etc.), data storage (e.g. Snowflake, Redshift, etc.) and also IaC (e.g. Terraform, CloudFormation) Software development experience with one or more languages (e.g. Python ...

modelling: designing schemas and storage for relational databases, warehouses or lakehouses, and understanding when each fits. Distributed processing: working with systems such as Spark, Flink or Beam, including how partitioning, parallelism, skew, memory, failures and ordering affect results. Platform experience Cloud and infrastructure as code: building infrastructure with tools ...

consumer or marketplace environment. Deep understanding of distributed systems and modern data ecosystems — including extensive experience with Databricks, Apache Spark, Apache Kafka, Apache Flink, Apache Beam and DBT. Demonstrated success in designing, building, and operating data platforms at scale, encompassing both batch processing and real-time streaming architectures. Expertise ...

development. Proficiency in SQL and programming languages such as Python, Java, or Scala. Hands‐on experience with big data frameworks (e.g., Spark, Hadoop, Flink) and cloud platforms (AWS, GCP, or Azure). Familiarity with data warehouse technologies (e.g., Snowflake, Redshift, BigQuery) and workflow orchestration tools (e.g., Airflow, Luigi). ...

OpenTelemetry Strong problem‐solving skills and a systematic approach to diagnosing and resolving issues Highly Desirable Skills Experience with streaming frameworks such as Flink, Kafka Streams and Kafka Connect Knowledge of modern data lake technologies including Delta Lake, Iceberg and Glue Data Catalog Exposure to DataOps practices and collaboration ...

containerization (Docker/K8s), and CI/CD pipelines. Excellent communication skills Technical Areas Where Depth Matters (one or more) Data Engineering: Spark, Kafka, Flink, BigQuery, streaming pipelines, ETL at scale. Distributed Systems: High-volume scaling, fault tolerance, eventual consistency. AI/ML: LLMs in production, RAG, embeddings, fine ...

with proficiency in SQL Experience building data platforms on cloud services like Databricks on Azure or GCP BigQuery and big data technologies like Spark, Flink etc., Solid grasp of Kubernetes, CI/CD and Terraform Working knowledge of ETL and ELT frameworks and orchestration tools like Airflow ...

production Worked with one or more cloud platforms and services (AWS, Azure, GCP) Hands-on experience with modern data technologies and tools (e.g. Kafka, Flink, DBT etc.), data storage (e.g. Snowflake, Redshift, etc.) and also IaC (e.g. Terraform, CloudFormation) Pragmatic approach to solving problems Nice to haves Keen interest ...

design sessions Confidence communicating with technical and non-technical stakeholders, and challenging constructively Desirable: SQL Server or on-prem to cloud migration, Apache Flink, regulated industry experience If you'd rather shape a platform than inherit a finished one, and want a seat at the table while ...

design sessions Confidence communicating with technical and non-technical stakeholders, and challenging constructively Desirable: SQL Server or on-prem to cloud migration, Apache Flink, regulated industry experience If you'd rather shape a platform than inherit a finished one, and want a seat at the table while ...

containerisation and orchestration technologies including Kubernetes, Docker, ECS, EKS, and AKS . Experience working with distributed event-streaming technologies such as Kafka and Apache Flink . Strong troubleshooting skills with the ability to resolve complex technical and operational issues. Proven ability to lead, mentor, and develop engineers within Agile ...

complete data platforms rather than solely delivering individual components. Youll need experience across: Batch data processing, ELT and orchestration. Modern streaming technologies such as Flink or comparable platforms. AWS data services, including S3, Lambda, Glue, Athena, Kinesis and RDS. Infrastructure as code using Terraform. CI/CD and automated ...

programming languages like Python or Java along with proficiency in SQL Experience working with cloud platforms (e.g., Azure) and big data technologies like Spark, Flink etc., Solid grasp of Kubernetes, CI/CD and Terraform Working knowledge of ETL and ELT frameworks and orchestration tools like Airflow Hiring, developing ...

Scala or Go) Extensive experience working with operational data stores, data warehouse, large‐scale data technologies and data lakes Experience using distributed frameworks (Spark, Flink, Beam, Hadoop) Good knowledge of containers (Docker, Kubernetes etc) and experience with cloud platforms such as GCP, Azure or AWS Strong experience working with ...

where people feel safe to challenge ideas, learn, and grow. Nice to have Hands-on familiarity with the modern data stack — for example, Spark, Flink, Kafka, Debezium, Airflow, dbt, or similar — and with cloud platforms (AWS/GCP or equivalent) and modern DevOps practices. Experience leading teams that built ...

. Build and maintain platform capabilities supporting batch and real-time data workloads . Develop and operate distributed data services using Kafka, Kinesis, Spark, Flink or equivalent technologies . Build and maintain cloud-native data platform capabilities using AWS and/or Azure . Support data ingestion, processing, storage … experience with real-time streaming and event-driven architectures , including Kafka, Kinesis or equivalent. Experience with distributed data processing technologies such as Spark, Flink, Kafka Streams or equivalent. Strong experience with AWS and/or Azure cloud environments. Experience with cloud services such as S3, Glue, Lambda, RDS, Athena ...

SMTs), and converter settings. Administer Schema Registry (compatibility levels, subject naming strategies, serializers/deserializers, schema size & references). Operate ksqlDB and/or Flink for streaming SQL; enforce resource limits and multi tenant governance. Engineer low latency and secure connectivity across data centers/VPCs/VNETs; manage ...

when existing technology should be evolved or replaced. Your experience should include: Batch processing, data warehousing, ELT and orchestration. Modern streaming technologies such as Flink or comparable platforms. Production AWS data engineering. AWS services including S3, Lambda, Glue, Athena, Kinesis, RDS, IAM and CloudWatch. Lakehouse architectures and open table ...