1 to 25 of 42 Permanent Flink Jobs

data processing and performance tuning Hands-on experience with modern data warehousing/lakehouse technologies (e.g., Redshift, BigQuery, Snowflake; and engines such as Spark, Flink, or Trino; and table formats such as Iceberg, Hudi, or similar) Strong SQL skills and experience with SQL-based transformation tooling (e.g., dbt) Experience ...

developing ETL processes, maintaining Spark pipelines, and productizing AI/ML models. • Proficient in popular technologies and cloud services, such as Kafka, Redis, Flink, TensorFlow, Triton, AWS services, and containerized environments (Docker, K8s). • Skilled in Unix/Shell or Python scripting, using scheduling tools like Airflow and Control ...

that power intelligent decision making. Key Responsibilities Data Pipeline Development Build, optimize, and maintain scalable data pipelines using Java (primary), plus exposure to Python, Flink, Kafka, or Spark. Develop and support real time streaming pipelines and event driven integrations. Integrate data from multiple sources (streaming, batch, APIs) using … engineers where needed. Qualification Core Data Engineering Strong programming proficiency in Java (preferred) or Python. Hands-on experience with at least one of: Kafka, Flink, Spark (Flink/Kafka preferred for streaming). Solid understanding of stream processing concepts (e.g., event time, state, backpressure). Understanding of software ...

pipelines and machine learning models. • Experience developing ETL processes, maintaining Spark pipelines, and productizing AI/ML models. • Proficient in technologies like Kafka, Redis, Flink, TensorFlow, Triton, and AWS services. • Skilled in Unix/Shell or Python scripting and scheduling tools like Airflow and Control-M. • Familiarity with Agile ...

contribute to engineering best practices Skills & Experience * 3+ years' commercial experience in Data Engineering * Strong Java or Python development skills * Experience with Kafka, Flink or Spark * Experience building ETL/ELT or streaming data pipelines * Knowledge of AWS (Azure or GCP also considered) * Experience with Docker, Kubernetes ...

based architectures that power intelligent decision making. Data Pipeline Development Build, optimize, and maintain scalable data pipelines using Java (primary), plus exposure to Python, Flink, Kafka, or Spark. Integrate data from multiple sources (streaming, batch, APIs) using AWS managed services (e.g., Data Architecture & Standards Contribute to data modelling, data ...

/Studio, ERwin, or Sparx EA (preferred). Experience reverse engineering models from existing databases. Proficiency in distributed data processing frameworks (e.g., Spark, Flink, Hadoop). Experience with API management and gateway tools and services. Experience of RESTful APIs for ingesting and exposing data. Proven track record with data ...

/Studio, ERwin, or Sparx EA (preferred). Experience reverse engineering models from existing databases. Proficiency in distributed data processing frameworks (e.g., Spark, Flink, Hadoop). Experience with API management and gateway tools and services. Experience of RESTful APIs for ingesting and exposing data. Proven track record with data ...

/Studio, ERwin, or Sparx EA (preferred). Experience reverse engineering models from existing databases. Proficiency in distributed data processing frameworks (e.g., Spark, Flink, Hadoop). Experience with API management and gateway tools and services. Experience of RESTful APIs for ingesting and exposing data. Proven track record with data ...

teams and contribute to engineering best practicesSkills & Experience* 3+ years' commercial experience in Data Engineering* Strong Java or Python development skills* Experience with Kafka, Flink or Spark* Experience building ETL/ELT or streaming data pipelines* Knowledge of AWS (Azure or GCP also considered)* Experience with Docker, Kubernetes ...

exposure to AI productivity tooling is advantageous Desirable Experience: Vector databases and embedding-based pipelines Real-time data streaming technologies (e.g. Kafka, Flink) RPA tools such as UiPath or Power Automate Data transformation tools such as dbt Exposure to modern AI tooling and frameworks (e.g. Claude-based developer tools ...

pipelines and source control (GitHub, GitLab, Atlassian) Container platforms including Kubernetes, Docker, EKS or AKS Modern data or event-driven systems (e.g. Kafka, Flink) This is a role suited to someone who enjoys working on complex, security-focused systems and wants to combine hands-on engineering with team leadership ...

Python. Proven experience designing and building distributed systems and APIs at scale. Hands‐on experience with real‐time data processing frameworks (e.g. Kafka, Flink, Spark Streaming, Pulsar). Experience working with cloud platforms (AWS, GCP, or Azure) and containerisation/orchestration (Docker, Kubernetes). Strong understanding of data modelling ...

Ansible) Test Driven Development with relevant tools/frameworks Containerisation and orchestration (Kubernetes, Docker, ECS/EKS, AKS) Knowledge of event streaming technologies (Kafka, Flink) Reasonable Adjustments: Respect and equality are core values to us. We are proud of the diverse and inclusive community we have built ...

Experience with Apache Kafka and Apache Flink. Experience helping customers build distributed systems or streaming solutions that use Kafka alongside technologies such as Spark, Flink, Hadoop, Cassandra, etc. Other Relevant Job Details For additional information about location requirements, please discuss with the recruiter following submission of your application. Some ...

batch and stream data processing systems. Experience with Datadog, SQL, Terraform, Docker, AWS (ECS, Kinesis, SQS, CloudWatch), GCP (BigQuery). Knowledge of Airflow, Kafka, Flink, dbt, Kubernetes is highly beneficial. Good understanding of AI platforms, experience building infrastructure for LLM orchestration (e.g., vector databases, RAG pipelines, GPU scaling ...

development background with hands‐on experience in platform, infrastructure, or data‐centric environments Deep expertise in event‐driven architectures, streaming technologies (e.g. Apache Kafka, Flink, and/or Pulsar) Proficiency across full stack technologies (Java, .Net, React) with the ability to guide technical decisions Knowledge of hybrid/cloud ...

Opentelemetry/Service Meshes etc.) Experience with configuration management tools (Ansible/Puppet/Kapitan/Terraform) Experience with distributed data platforms (Kafka/Flink/Airflow) Comfortable using cloud native and containerisation technologies (Kubernetes/Docker) Good Linux systems knowledge (experience with RHEL desirable) Broad knowledge across network ...

power analytics and AI-driven decision making. What youll be doing Building and optimising scalable data pipelines using Java (primary) and technologies like Kafka, Flink, or Spark Developing real-time streaming solutions and event-driven architectures using AWS services (Kinesis, MSK, Lambda, Glue) Contributing to data architecture, modelling … experience in data engineering or large-scale data platforms (3+ years) Proficiency in Java or Python Hands-on experience with streaming technologies (Kafka/Flink preferred) Good understanding of distributed systems and cloud platforms (AWS ideally) Experience with CI/CD, Docker, Kubernetes, and modern DevOps practices Why consider ...

analytics and AI-driven decision making. What you'll be doing Building and optimising scalable data pipelines using Java (primary) and technologies like Kafka, Flink, or Spark Developing real-time streaming solutions and event-driven architectures using AWS services (Kinesis, MSK, Lambda, Glue) Contributing to data architecture, modelling … experience in data engineering or large-scale data platforms (3+ years) • Proficiency in Java or Python • Hands-on experience with streaming technologies (Kafka/Flink preferred) • Good understanding of distributed systems and cloud platforms (AWS ideally) • Experience with CI/CD, Docker, Kubernetes, and modern DevOps practices Why consider ...

with pipeline development, architecture and deployment. Key Responsibilities Data Pipeline Development Build, optimize, and maintain scalable data pipelines using Java, plus exposure to Python, Flink, Kafka, or Spark click apply for full job details ...

deep understanding of core Java, data structures and concurrency, not just framework knowledge Hands-on experience with Kafka and event-streaming frameworks such as Flink, Kafka Streams or Spark Practical Kubernetes experience, including troubleshooting production issues Experience tuning JVM performance - garbage collection, CPU hotspots and heap dump analysis ...

deep understanding of core Java, data structures and concurrency, not just framework knowledge Hands-on experience with Kafka and event-streaming frameworks such as Flink, Kafka Streams or Spark Practical Kubernetes experience, including troubleshooting production issues Experience tuning JVM performance - garbage collection, CPU hotspots and heap dump analysis ...

specifically related to building large-scale data storage, streaming, and warehousing systems. Experience in various database technologies (MongoDB, Postgres), streaming/processing solutions (Kinesis, Flink, Spark), indexing/caching (ElasticSearch, Redis), and various data query engines (Trino, Presto, Snowflake, etc.). Show a track record of mentoring and leading ...

implementing solutions for low-latency, distributed services using open standard technologies. • Experience with Big Data and analytics in general leveraging technologies like Hadoop, Spark, Flink and MapReduce • Experience with distributed caching technologies like Redis • Experience developing proper metrics instrumentation in software components, to help facilitate real-time and remote ...