1 to 25 of 27 Batch Processing Jobs

cost-effective manner. Your expertise in cloud infrastructure will be crucial in ensuring the reliability and availability of the company's software products. Data Processing Pipelines : You'll design and implement data processing pipelines using technologies like Kafka, Hadoop, Hive, Storm, or Zookeeper, enabling real-time and batch processing of data from the blockchain. Hands-on Team Leadership : As a hands-on leader, you'll lead by example, actively contributing to the development efforts while also mentoring and coaching the team members. Your leadership will help foster a culture of excellence and continuous improvement within the more »

deadlines. Your main responsibilities will be: Designing and implementing highly performant data ingestion & transformation pipelines from multiple sources using Databricks and Spark Streaming and Batch processes in Databricks SPARK performance\tuning\optimisation Providing technical guidance for complex geospatial problems and spark dataframes Developing scalable and re-usable frameworks for more »

deadlines. Your main responsibilities will be: Designing and implementing highly performant data ingestion & transformation pipelines from multiple sources using Databricks and Spark Streaming and Batch processes in Databricks SPARK performance\tuning\optimisation Providing technical guidance for complex geospatial problems and spark dataframes Developing scalable and re-usable frameworks for more »

deadlines. Your main responsibilities will be: Designing and implementing highly performant data ingestion & transformation pipelines from multiple sources using Databricks and Spark Streaming and Batch processes in Databricks SPARK performance\tuning\optimisation Providing technical guidance for complex geospatial problems and spark dataframes Developing scalable and re-usable frameworks for more »

deadlines. Your main responsibilities will be: Designing and implementing highly performant data ingestion & transformation pipelines from multiple sources using Databricks and Spark Streaming and Batch processes in Databricks SPARK performance\tuning\optimisation Providing technical guidance for complex geospatial problems and spark dataframes Developing scalable and re-usable frameworks for more »

deployment (e.g., promoting ML Pipelines to Production), leveraging MLOps practices and technologies. Experience & Skills Required Skilled in EDW and big data storage, data provisioning, processing, and pipeline orchestration. Comprehensive understanding of data modeling, possessing expertise and experience in data architecture. Proficient coding abilities in Python, SQL, following best software … development practices such as code versioning, code reviews, unit testing, documentation, and use of collaboration tools. Extensive experience in scripting, batch processing, and stream processing. Experience with or at least an interest in Machine Learning and widely used technologies, such as NumPy, Pandas, Matplotlib, Scikit-learn, TensorFlow, and more »

Experience with Apache Spark and/or Databricks. Familiarity with BI visualization tools like Power BI Experience in managing end-to-end analytics pipelines (batch and streaming) Proficiency in root cause analysis and post-incident reporting in a production environment Excellent interpersonal skills Strong report writing, presentation, and record … Computer Science, Engineering, or related field Certifications such as Azure Data Engineer Associate are desirable. Knowledge of data ingestion methods for real-time and batch processing Proficiency in PySpark and debugging Apache Spark workloads. What’s in it for you? Annual bonus scheme – up to 10% Excellent pension more »

communicating to the relevant stakeholders on technical matters Capable of Integrating Machine Learning models into production systems and deploy them for real-time or batch processing Senior Data Scientist/Data Scientist/Machine Learning Engineer/Exeter/Torquay/Weymouth/Python/C#/Unity more »

services, such as Data Factory, Databricks, Azure SQL and Synapse Analytics, among others, to build scalable and secure data solutions that support complex onward processing by both operational and analytical teams. What will this role look like? - Develop and maintain scalable, efficient, and robust data architectures. This involves creating … 3NF and dimensional data models, designing and developing robust batch processing pipelines, and working with the operational and analytical teams to solve complex business problems. - Monitor system performance, identify bottlenecks, and implement changes to improve data processing and pipeline/systems performance. - Work closely with Data Scientists more »

Lead Data Platform Engineer, you'll be helping the team handle vast amounts of data which constantly pours in. You'll be joining the batch processing team where you'll play a pivotal role in developing products utilized in-house by both Data Engineers and Software Engineers. For more »

Lead Data Platform Engineer, you'll be helping the team handle vast amounts of data which constantly pours in. You'll be joining the batch processing team where you'll play a pivotal role in developing products utilized in-house by both Data Engineers and Software Engineers. For more »

Azure Stream Analytics, and Azure Synapse Analytics. A solid foundation in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Designing and deploying production data pipelines, utilizing languages such as Java, Python, Scala, Spark, and SQL. Handling substantial volumes of structured and unstructured more »

Troubleshoot and fix intricate technical problems, providing first and second-line support and escalating when necessary. Operational Excellence: Work to ensure seamless operation of batch processes which underpin the business functions. Bridge technology and finance: Collaborate with traders, actuaries, technologists, and more. Prior finance experience is a requirement Efficiency more »

and Java.Familiarity with streaming/event-driven architecture, including tools like Kafka and Kinesis/Firehose.Expertise in data ingestion techniques, encompassing both stream and batch processing.Proficiency using tools like Terraform for Infrastructure-as-Code and AWS infrastructure management.What's in it for you?Free Membership and 20% off productsAll more »

Familiarity with streaming/event-driven architecture, including tools like Kafka and Kinesis/Firehose. Expertise in data ingestion techniques, encompassing both stream and batch processing. Proficiency using tools like Terraform for Infrastructure-as-Code and AWS infrastructure management. What's in it for you? Free Membership and more »

to work in a major project across the company. In the engineering function the newer SQL Servers will include certification process, installation, testing, and batch processes, where this person will help this process across the bank. This role will sit at the Project support/Operations level 3, so more »

to some essential tools and a high level of financial knowledge. Good exposure to AWS technologies is essential, Airflow would be desirable. Experience with batch processing is required. Experience working with a Linux environment. Scripting exposure within either Python, Bash or Shell scripting. Experience with MSSQL, Oracle or more »

the Enterprise Warehouse and the database backend of the accounting platform. This platform handles large volumes of rapidly processed data and is transitioning from batch processing to real-time operations. Key Responsibilities Collaborate with a team of offshore developers and QA professionals, alongside the London Technical Lead Develop more »

application database including backend of the private client business accounting platform. This platform handles large volumes of rapidly processed data and is transitioning from batch processing to real-time operations. You will have the opportunity to ultimately take over complete ownership of the platform and management of the more »

ETL assessments to identify potential gaps impacting IBS Impact Tolerance thresholds. Track record of developing strategies for Operational Resilience. Experience leading definition of critical batch processes. Ability to contribute insights to group policies and procedures. Confidence in communicating with stakeholders across different levels. Technical background: 10+ years' experience in … Infrastructure administration, Middleware & integration. Experience of event streaming and batch processing, including point-to-point data transfer Proficient in Cryptographic key management and encryption deployments. Knowledge of Operating Systems (Windows, Linux, zOS, F5) and network protocols Familiar with analytic platforms and databases such as MSSQL, Kafka, S3, etc more »

Health and Safety and Company Policies. What skills will you need? Essential qualifications/requirements: High volume manufacturing experience to include continuous processes and batch processes Significant experience of working with a maintenance background Experience in electrical and mechanical fault finding Planned maintenance systems and procedures development experience Proven more »

CHO/HEK cell lines. Develop stable CHO cell lines to scale up antibody production to multi-gram quantities. Optimise antibody production using fed-batch processes in bioreactors, ensuring high titer and quality. Innovate within the protein expression domain , staying abreast of and implementing cutting-edge technologies. Candidate Expectations more »

least 2 years experience of Nice Actimize. - Analyzing current installation of Actimize WLF solution at a client side - Recommend improvements on data ingestion and batch process performance - Recommend optimal Threshold setting and Scoring configuration which adhere to the client requirements - Improve detection and alert generation Must Have: - Minimum more »

ownership for projects which are delivered by a highly technical team that supports a complex environment which includes:  Workforce Management and People Systems Solutions  Batch processes, Payroll, Time, and Attendance applications  Data design  Integration design  Experience of various design techniques  Familiar with Service Design and Introduction • Negotiate with key more »

technologies for ETL, data warehouse, and data lake design. Hands-on experience with AWS services like EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. Capable of processing large volumes of structured and unstructured data on AWS. Familiarity with AWS best practices in data engineering, data science, and product development. Knowledgeable in … both stream and batch processing. Comfortable designing and building for AWS cloud, including Platform-as-a-Service, server-less, and container technologies. Diverse skills in ETL, data warehouse, and Data Lake design. Familiarity with various tools, cloud technologies, and approaches. Expertise in AWS or equivalent open-source tools. Proficient more »