1 to 25 of 85 Permanent Flink Jobs

Engineering Strong commercial experience designing and implementing real‐time streaming data platforms. Hands‐on experience with technologies such as Apache Kafka, AWS Kinesis, Apache Flink, Spark Streaming, Apache Pulsar, or similar event‐driven technologies. Experience building high‐volume, low‐latency, resilient data pipelines in production environments. Strong understanding ...

issues. Strong commercial experience designing and implementing real‐time streaming data platforms. Hands‐on experience with technologies such as Apache Kafka, AWS Kinesis, Apache Flink, Spark Streaming, Apache Pulsar, or similar event‐driven technologies. Experience building high‐volume, low‐latency, resilient data pipelines in production environments. Strong understanding ...

Python and/or other modern programming languages. Experience developing and orchestrating data pipelines using technologies such as DBT, Apache Spark, Airflow, Dagster, Kafka, Flink, or equivalent tooling. Solid understanding of data lakehouse, warehouse, and medallion architecture patterns. Experience applying DevOps and DataOps best practices including CI/ ...

Experience with additional languages such as TypeScript, Go, Java or Rust. Experience with big data and real-time processing technologies, such as Apache Spark, Flink or Kafka Streams. Relevant cloud certifications, such as AWS Certified Solutions Architect – Professional, Azure Solutions Architect Expert or Google Cloud Professional Cloud Architect. Experience ...

Hands-on experience building, scaling, and shipping large-scale data platforms in production. Deep practical experience with distributed data processing frameworks (e.g., Apache Spark, Flink, Hadoop). Strong expertise in message brokers and event streaming platforms (e.g., Apache Kafka, Kinesis). End-to-end exposure to data pipeline lifecycle ...

following would be beneficial but not essential: Data Warehousing (Snowflake, Redshift, Synapse, BigQuery, etc.) Relational, NoSQL, graph and vector databases Streaming technologies (Kafka, Kinesis, Flink, etc.) Containers and related services (Docker, Kubernetes, container Registries, etc) Data modelling approaches (Kimball, Imnon) Orchestration tools - Apache Airflow, Prefect or cloud-native tools ...

offer visa sponsorship for this role at present Desirable (Nice to Have) Experience with streaming and big‐data tooling – Apache Kafka, Spark, or Flink Experience with MLOps platforms – MLflow, Kubeflow, Vertex AI, SageMaker, or Weights & Biases Experience evaluating and optimising RAG systems at scale (retrieval quality, chunking, re‐ranking ...

Proven experience designing and building scalable data pipelines (ETL/ELT) for batch and streaming use cases using modern technologies (e.g., Python, SQL, Spark, Flink, Airflow) and advanced knowledge on the workings of these. Hands-on experience in building and operating workloads Databricks. Hands-on experience creating data visualizations ...

that power intelligent decision-making. Key Responsibilities Data Pipeline Development Build, optimize, and maintain scalable data pipelines using Java (primary), plus exposure to Python, Flink, Kafka, or Spark. Develop and support real-time streaming pipelines and event-driven integrations. Integrate data from multiple sources (streaming, batch, APIs) using … junior engineers where needed. Core Data Engineering Strong programming proficiency in Java (preferred) or Python. Hands-on experience with at least one of: Kafka, Flink, Spark (Flink/Kafka preferred for streaming). Solid understanding of stream processing concepts (e.g., event time, state, backpressure). Understanding of software ...

cloud strategy — contributing to cloud adoption initiatives, deploying Citi APIs on AWS and Azure Working with event streaming and messaging systems including Kafka, Flink, and Solace at enterprise scale This is a rare opportunity in financial services — a stable, well‐funded platform with the freedom to keep building ...

managing real-time data pipelines across a track record of multiple initiatives. Expertise in developing data backbones using distributed streaming platforms (Kafka, Spark Streaming, Flink, etc.). Experience working with cloud platforms such as AWS, GCP, or Azure for real-time data ingestion and storage. Programming skills in Python ...

Python programming. AWS, Azure, or GCP; Redshift, AWS Glue, Azure Synapse, Azure Data Factory, BigQuery, Dataflow, Databricks, or Snowflake. Apache Kafka, Amazon Kinesis, Apache Flink, or Spark Structured Streaming. Data modeling, data vault, lakehouse, and data mesh architecture. Data quality, catalogs, lineage, API design, data contracts, and event-driven ...

Spring components, including Spring Data JPA. Experience with containerisation technologies such as Docker and Kubernetes. Experience with stream processing frameworks such as Apache Flink is a plus but not required. Familiarity with SSO mechanisms including OpenID is a plus but not required. A basic understanding of core microservice components ...

Worked with one or more cloud platforms and services (AWS, Azure, GCP) Extensive hands‐on experience with modern data technologies, ETL tools (e.g. Kafka, Flink, DBT etc.), data storage (e.g. Snowflake, Redshift, etc.) and also IaC (e.g. Terraform, CloudFormation) Software development experience with one or more languages (e.g. Python ...

modelling: designing schemas and storage for relational databases, warehouses or lakehouses, and understanding when each fits. Distributed processing: working with systems such as Spark, Flink or Beam, including how partitioning, parallelism, skew, memory, failures and ordering affect results. Platform experience Cloud and infrastructure as code: building infrastructure with tools ...

consumer or marketplace environment. Deep understanding of distributed systems and modern data ecosystems — including extensive experience with Databricks, Apache Spark, Apache Kafka, Apache Flink, Apache Beam and DBT. Demonstrated success in designing, building, and operating data platforms at scale, encompassing both batch processing and real-time streaming architectures. Expertise ...

development. Proficiency in SQL and programming languages such as Python, Java, or Scala. Hands‐on experience with big data frameworks (e.g., Spark, Hadoop, Flink) and cloud platforms (AWS, GCP, or Azure). Familiarity with data warehouse technologies (e.g., Snowflake, Redshift, BigQuery) and workflow orchestration tools (e.g., Airflow, Luigi). ...

OpenTelemetry Strong problem‐solving skills and a systematic approach to diagnosing and resolving issues Highly Desirable Skills Experience with streaming frameworks such as Flink, Kafka Streams and Kafka Connect Knowledge of modern data lake technologies including Delta Lake, Iceberg and Glue Data Catalog Exposure to DataOps practices and collaboration ...

containerization (Docker/K8s), and CI/CD pipelines. Excellent communication skills Technical Areas Where Depth Matters (one or more) Data Engineering: Spark, Kafka, Flink, BigQuery, streaming pipelines, ETL at scale. Distributed Systems: High-volume scaling, fault tolerance, eventual consistency. AI/ML: LLMs in production, RAG, embeddings, fine ...

with proficiency in SQL Experience building data platforms on cloud services like Databricks on Azure or GCP BigQuery and big data technologies like Spark, Flink etc., Solid grasp of Kubernetes, CI/CD and Terraform Working knowledge of ETL and ELT frameworks and orchestration tools like Airflow ...

production Worked with one or more cloud platforms and services (AWS, Azure, GCP) Hands-on experience with modern data technologies and tools (e.g. Kafka, Flink, DBT etc.), data storage (e.g. Snowflake, Redshift, etc.) and also IaC (e.g. Terraform, CloudFormation) Pragmatic approach to solving problems Nice to haves Keen interest ...

modelling: designing schemas and storage for relational databases, warehouses or lakehouses, and understanding when each fits. Distributed processing: working with systems such as Spark, Flink or Beam, including how partitioning, parallelism, skew, memory, failures and ordering affect results. Platform experience Cloud and infrastructure as code: building infrastructure with tools ...

design sessions Confidence communicating with technical and non-technical stakeholders, and challenging constructively Desirable: SQL Server or on-prem to cloud migration, Apache Flink, regulated industry experience If you'd rather shape a platform than inherit a finished one, and want a seat at the table while ...

design sessions Confidence communicating with technical and non-technical stakeholders, and challenging constructively Desirable: SQL Server or on-prem to cloud migration, Apache Flink, regulated industry experience If you'd rather shape a platform than inherit a finished one, and want a seat at the table while ...

Databricks, Snowflake, Microsoft Fabric, Azure Synapse, Google BigQuery, Amazon Redshift Data engineering and orchestration: Spark, dbt, Airflow, Azure Data Factory, AWS Glue, Dataflow, Kafka, Flink Governance, catalogue and lineage: Microsoft Purview, Collibra, Informatica, Alation, Atlan, OpenLineage Graph, ontology and semantic technologies: Neo4j, Amazon Neptune, Stardog, GraphDB, RDF, OWL, SPARQL ...