1 to 25 of 82 Permanent Flink Jobs

pipelines and machine learning models. • Experience developing ETL processes, maintaining Spark pipelines, and productizing AI/ML models. • Proficient in technologies like Kafka, Redis, Flink, TensorFlow, Triton, and AWS services. • Skilled in Unix/Shell or Python scripting and scheduling tools like Airflow and Control-M. • Familiarity with Agile ...

developing ETL processes, maintaining Spark pipelines, and productizing AI/ML models. • Proficient in popular technologies and cloud services, such as Kafka, Redis, Flink, TensorFlow, Triton, AWS services, and containerized environments (Docker, K8s). • Skilled in Unix/Shell or Python scripting, using scheduling tools like Airflow and Control ...

contribute to engineering best practices Skills & Experience * 3+ years' commercial experience in Data Engineering * Strong Java or Python development skills * Experience with Kafka, Flink or Spark * Experience building ETL/ELT or streaming data pipelines * Knowledge of AWS (Azure or GCP also considered) * Experience with Docker, Kubernetes ...

consumer or marketplace environment. Deep understanding of distributed systems and modern data ecosystems — including extensive experience with Databricks, Apache Spark, Apache Kafka, Apache Flink, Apache Beam and DBT. Demonstrated success in designing, building, and operating data platforms at scale, encompassing both batch processing and real-time streaming architectures. Expertise ...

robust, end-to-end SDLC practices. Required Education, Experience/Skills/Training: Required Qualifications Languages: Scala, Python, SQL, JavaScript Data Processing: Apache Spark, Flink, Airflow Platforms & Tools: Databricks, Hive, Presto, Snowflake Cloud: AWS (S3, EMR, Glue, Lambda) Minimum of 8 years of relevant software engineering, data engineering ...

robust, end-to-end SDLC practices. Required Education, Experience/Skills/Training: Required Qualifications Languages: Scala, Python, SQL, JavaScript Data Processing: Apache Spark, Flink, Airflow Platforms & Tools: Databricks, Hive, Presto, Snowflake Cloud: AWS (S3, EMR, Glue, Lambda) Minimum of 8 years of relevant software engineering, data engineering ...

/Studio, ERwin, or Sparx EA (preferred). Experience reverse engineering models from existing databases. Proficiency in distributed data processing frameworks (e.g., Spark, Flink, Hadoop). Experience with API management and gateway tools and services. Experience of RESTful APIs for ingesting and exposing data. Proven track record with data ...

philosophy around automated test coverage Knowledge of financial products equity, swaps, futures & fx Experience working with NoSQL database Mongo DB Experience working with Apache Flink #J-18808-Ljbffr ...

exposure to AI productivity tooling is advantageous Desirable Experience: Vector databases and embedding-based pipelines Real-time data streaming technologies (e.g. Kafka, Flink) RPA tools such as UiPath or Power Automate Data transformation tools such as dbt Exposure to modern AI tooling and frameworks (e.g. Claude-based developer tools ...

Confluent Platform Deep knowledge of Kafka internals & KRaft architecture Experience with Confluent Cloud, stream governance, RBAC, and data lineage Expertise in stream processing (Apache Flink, Kafka Streams, ksqlDB) Strong Java, Python, or Scala skills Hands-on experience with AWS/GCP/Azure & Kubernetes CI/CD & infrastructure automation ...

Python. Proven experience designing and building distributed systems and APIs at scale. Hands‐on experience with real‐time data processing frameworks (e.g. Kafka, Flink, Spark Streaming, Pulsar). Experience working with cloud platforms (AWS, GCP, or Azure) and containerisation/orchestration (Docker, Kubernetes). Strong understanding of data modelling ...

that underpin the rest of Kplers products. They drive the development of large-scale, distributed, real-time pipelines for geospatial data using tools like Flink and Iceberg. As a Staff engineer you will be part of the engineering leadership within Kpler, responsible for aligning priorities and ensuring the delivery ...

engineering stack – from ingestion and streaming through to warehousing, serving, and cost optimisation You have deep experience with streaming architectures – Kinesis, Kafka/MSK, Flink, or Spark Streaming – and know when each is the right choice You can model the cost implications of architecture decisions and advise clients ...

engineering stack – from ingestion and streaming through to warehousing, serving, and cost optimisation You have deep experience with streaming architectures – Kinesis, Kafka/MSK, Flink, or Spark Streaming – and know when each is the right choice You can model the cost implications of architecture decisions and advise clients ...

pipelines NoSQL database experience ( MongoDB and/or Cassandra is preferred) Hands-on experience with event-driven architectures and complex event processing frameworks (e.g. Flink, Kafka Streams, Esper) to derive insights from continuous event streams Good knowledge of design patterns and experience in implementing them in object-oriented fashion ...

commercial experience in data engineering and modern data platforms. Advanced programming skills in Java or Python. Expertise working with technologies such as Kafka, Spark, Flink or similar distributed data frameworks. Experience delivering solutions within AWS or other major cloud platforms. Strong understanding of data architecture, scalability and performance optimisation. ...

Ansible) Test Driven Development with relevant tools/frameworks Containerisation and orchestration (Kubernetes, Docker, ECS/EKS, AKS) Knowledge of event streaming technologies (Kafka, Flink) Reasonable Adjustments: Respect and equality are core values to us. We are proud of the diverse and inclusive community we have built ...

production-grade code Distributed Data Processing Experience building and operating: batch processing systems distributed data systems near real-time streaming pipelines Familiarity with: Kafka Flink Spark Databricks experience is a strong plus Databases & Data Warehousing Comfortable working with: RDBMS data warehousing solutions Strong understanding of data modelling aligned with ...

practical knowledge of AWS data services including Redshift, Glue, EMR, Kinesis and S3 Experience with modern data engineering tools such as dbt, Spark or Flink Proven experience with SQL and NoSQL databases including PostgreSQL, MySQL and DynamoDB Knowledge of data governance frameworks and tools including metadata management and data ...

production Python systems Strong experience with microservices, databases, and production infrastructure Experience with streaming systems, real-time data pipelines, or event-driven architectures (Kafka, Flink, Redis etc.) Quantitative background - maths, physics, engineering or finance - you can read a model and reason about correctness Experience with testing, monitoring, and debugging ...

Experience with Apache Kafka and Apache Flink. Experience helping customers build distributed systems or streaming solutions that use Kafka alongside technologies such as Spark, Flink, Hadoop, Cassandra, etc. Other Relevant Job Details For additional information about location requirements, please discuss with the recruiter following submission of your application. Some ...

services such as Pub/Sub and BigQuery Experience with streaming technologies such as Kafka and real time processing engines such as Spark or Flink Strong understanding of performance optimisation, including indexing, partitioning, caching and query tuning Experience working across multi cloud and hybrid cloud environments, including cost optimisation ...

telecom digital twin platforms.* Experience with vector databases, embeddings, semantic search, or RAG.* Experience with streaming data platforms such as Kafka, Pub/Sub, Flink, or Spark Streaming.* Experience supporting closed-loop automation, predictive assurance, or self-healing network use cases.* Experience working with OSS systems, inventory platforms, assurance ...

functional programming patterns and their application in data processing. Hands-on experience with messaging technologies (e.g., Kinesis, SQS) Experience with stream processing frameworks like Flink or Spark Familiarity with CDN technologies. Interest in video streaming and internet networking. The hiring range for this position in New York ...

stage, are encouraged to talk about it Experience in financial services,insuranceor another regulated sector Experience deploying real‐time or streaming ML models (e.g.Kafka, Flink, Spark Structured Streaming) Passion for automation, tooling, and building reusable systems Interest in responsible AI and ML model governance Why Compare the Market ...