1 to 25 of 381 Data Pipeline Jobs in the UK

Data Platform Manager Location: dmg::media Headquarters – London Position: Permanent Package Description Our benefits package increases the longer you’ve been with us. Here’s what to expect: 25 days’ holiday (increasing by 1 per year up to a total of 30) Upon joining you will be automatically … many other benefits…. Job Introduction DMG:Media own some of the world’s biggest news brands, and as such processes billions of data points every month in order to provide insights and targeting criteria for teams and stakeholders as part of our ambition to be the world … s leading Publisher when it comes to the sophisticated application of data – to power relentless growth. DMG:Media is seeking an experienced and talented Data Platform Manager to evolve its Big Data Platform and advance its overall data proposition. The successful candidate more »

troubleshooting of the SOC's technology stack (hardware and software). The engineer will also assist with the continued development and maintenance of data pipelines and signature updates and the professional development of the system engineering team. Tasks: * Perform system administration on specific cyber defence applications and systems more »

troubleshooting of the SOC's technology stack (hardware and software). The engineer will also assist with the continued development and maintenance of data pipelines and signature updates and the professional development of the system engineering team. Tasks: Perform system administration on specific cyber defence applications and systems more »

risk analysis and ongoing risk research while supporting and refining the existing processes. You will collaborate with other risk engineering teams providing risk data, analytics and visualisation primitives.This is a highly collaborative role, requiring linking together data & analytics from varied sources into a uniform, actionable, high … role will be varied, including overseeing the implementation and rollout of new risk models, optimising, and maintaining analysis and reporting from 100s TiB data, architecting and implementing new datamarts and providing thought leadership and strategic direction for the future architecture of the Man Risk Platform. You will be … an emphasis on Python and the Python scientific stack: numpy, scipy, pandas, scikit-learn, etc. We implement the systems that require the highest data throughput in Java. We implement most of our long running services and analytics in C#.We use Airflow for workflow management, Kafka for data more »

Data Engineer Location: London – Hybrid Employment: Full Time All applicants must hold a DV (Developed Vetting) clearance to apply. The Opportunity: For the Ministry of Defence (MOD), maintaining National Security is a 24-hour-a-day, 365-day-a-year mission. For this reason, it partners with this … Big 4 Firm to support its multidisciplinary AI & Cloud Data Engineering Capabilities. The Role: As an AI & Cloud Data Engineering practitioner, you’ll build large-scale data pipelines and infrastructure, utilising data integration tools to optimise complex data solutions. Collaborating … with high-performing Data Science and ML Engineering teams to drive innovation and insight through AI and Data across the Defence & Security sector. Required Skills/Experience: British Passport Holder with active DV (Developed Vetting Clearance) End-to-end development with data pipelines, ETL more »

Amazon well architected frameworks, serverless solutions and improving existing platforms using AWS technologies with Agile delivery methods Demonstrable experience of Python 3, Python data management/… manipulation libraries and usage of Python with AWS components Demonstrable experience working in the Data domain, covering the full data pipeline from ingestion, mastering, management and consumption/distribution of large datasets Financial Services expertise preferred working with Equity and Fixed Income asset classes and … a working knowledge of Indices Experience with No-SQL and Relational databases and data analysis using SQL. Enter key behaviours and skills required to be successful in the role: Education & Work experience: 7+ years of AWS and Python development engineer experience within the Financial Services and Data more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help … build data platforms to enable predictive government services that make a positive impact on the people in the UK. So, if you are looking to be part of this mission, we would love to hear from you. Support in applying If you need this job description in another … interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by more »

A highly prestigious Investment Management firm are looking to hire a Senior Cloud Data Engineer with strong Python and Snowflake experience to join their new Data & AI team in a permanent position. The Cloud Data Engineer will join alongside Data Scientists and … Data Modellers to manage and improve the cloud-based Data Warehouse (Azure, Snowflake), and guide the organisation through an unprecedented period of data change. Your Key responsibilities will be: Engineering scalable and secure cloud data solutions for high-performance Data Science workloads and Generative AI applications Enhancing and managing the cloud-based Data Warehouse (Azure, Snowflake) Designing, building and deploying data pipelines to support advanced analytics and the development of Machine Learning algorithms and Generative AI (GenAi) applications Providing technology thought leadership and supporting more »

Software Engineer - London - Exciting Fin-Tech Scale-Up 🚀 📢 Permanent + Fun Social Team + Share options Are you a 2024 graduate passionate about Data Engineering and working with MLOps? Are you looking for a fantastic environment to start your career in? Here’s your chance to be a … FinTech scale-up and take the first big step in your career! This firm is looking for a Software Engineer to join their Data team and work with developing new data pipelines, helping to deploy new features to their stack, and help build and run their … Degree from top Russell Group universities in a related field (i.e. Maths, Physics, Computer Science, etc.) Experience using Python and SQL Experience with data engineering, data cleaning, data pipelines A passion for pushing boundaries in technology Great problem-solving abilities Excellent time management and more »

Senior Data Engineer Financial Services London (Hybrid) £90K plus bonuses and benefits Harrington Starr has partnered with leading data and analytics firm on the forefront of capital markets innovation as they seek to hire an experienced Data Engineer. Our client extends its services to … global exchange groups, banks, brokers, asset managers, and hedge funds. They are seeking to hire a dynamic and highly motivated data engineer for its London team. This individual should have an entrepreneurial mindset and the adaptability to thrive in an extremely fast paced environment. Within this role, you … will be responsible for building data pipelines for a cloud-based warehouse using Azure and Snowflake, enhancing data capabilities for analytics and science. What you need: 3+ years of hands-on experience as a Data Engineer, building ETL pipelines and managing data more »

Development Engineer to come and join our team on a permanent basis! Our EMIS X Analytics team have worked hard to build a data platform to help the NHS manage one of the richest healthcare datasets in the world, which currently houses 1 Petabyte of data and able to query 1.5 billion rows of data every second. Joining a talented and passionate team, you will play a pivotal role in building a world class platform that is transforming the health and lives of those around us. You will get to work with … data at scale utilising the best breed of Cloud services and technologies. So, what tools and technologies will you be using? AWS Python Databricks/Spark Trino Airflow Docker CloudFormation/Terraform SQL/NoSQL We provide you with the opportunity to think freely and work creatively and more »

Azure Data Engineer (SC Cleared) Location: Bristol Salary: £50,000 - £60,000 We're seeking Azure Data Engineer with active SC Clearance. This is a fantastic opportunity to join one of the most reputable digital solution provider's in the United Kingdom providing exposure to the … biggest and most ambitious programmes undertaken to keep our country safe. The SC Cleared Azure Data Engineer will be joining the Defence & Security arena, where you will help digitise defence with new thinking on technology capabilities and adoption processes, so we need someone who is sensitively able to … combine the latest thinking with traditional military functions. *Must have Active SC Clearance* Role requirements Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including more »

Job Title: Data Engineer Job Type: Full Time, Permanent Working location: London, Hybrid Role Purpose At Travelex we are developing modern data services, which will be at the heart of our relationship with our customers. Our data architecture is becoming more service-oriented and … for you to solve. Our work is fast-paced although our team remains collaborative and flexible even when delivering fast. Your role as data engineer has a wide remit: working with product owners, subject matter experts and managers across the company, to design and deliver new components of … to the traditional data engineering type! Significant hands-on experience with AWS, especially AWS services focused on data flow, pipelines, data transformation, storage and streaming. Excellent data engineering skills, for example with SQL, Python, DBT and Airflow. Good understanding of service-oriented more »

Azure Data Engineer An Azure Data Engineer is required by Whitehall Resources for our client based in the south of England. This is a permanent role and can be done from the comfort of the successful candidate’s home with travel into the office one to … two times a month. The successful candidate will come from a Data Engineering background and have experience with the latest Microsoft technologies. Strong knowledge of MS SQL Server on Azure with proficiency in SQL will also be needed. Do you have? Azure Data Engineering experience? Strong … knowledge of MS SQL Server on Azure? A background in the design, build, and maintenance of ADF data pipelines to extract, transform, and load (ETL) data from various sources into Data Warehouses? Exposure to Azure Synapse Analytics? Excellent communication skills? Would you like? Work more »

Cloud Architect/Data Architect Google Cloud/GCP, Machine Learning/Generative AI Remote-based or Hybrid should you prefer (London) £100k-£140k basic salary + bonus Benefits: 25 days holiday + bank holidays Private Healthcare Discounted Gym Membership (Nuffield + Hussle) Life Insurance, Income Protection, Employee … Assistance Program Pension Scheme (max 10%) We are working with an AI/Data Consultancy with core clients within the Retail, Financial Services, Gaming, SaaS sectors. The successful Cloud Architect will work with an array of technologies with clients from several industries & sectors meaning you will find your … devising innovative solutions to address their needs, defining project parameters, and supervising the execution of these projects. Role of the Cloud Architect/Data Architect: Utilising advanced data processing and cloud technologies effectively to stimulate innovation. Engaging with clients to create top-notch solutions tailored to more »

are looking for an BI Analyst position for a large business based in Liverpool. The Business Intelligence Analyst is responsible for maintaining the data architecture and data pipelines that support business intelligence systems. This includes ensuring that the data architecture is scalable, secure, and … optimized for performance. They also work closely with other teams to ensure that data is properly integrated and available for analysis. The Business Intelligence Analyst will work closely with the analysts for reporting requirements and ensuring the correct data structure is in place for implementing newly … awarded contracts. The role will be responsible for designing processes and controls to ensure all data presented is tested, and accurate. Good communication skills is crucial for this role as you will need to present key information to managers across the business. It is essential you have strong more »

Engineer to spearhead their Data Engineering team in London! Interesting and varied role where you can work across the whole pipeline on a breadth of impactful projects! Great scope for career progression & you’ll be leading and managing a small team of Data … from the Data Engineering work to contribute towards the Data Science/Analytics. Work across the whole Data pipeline (Data Engineering, Data Warehousing, Analytics) Help shape the strategy and roadmap for whole Data function and contribute towards … Engineering pipeline. Preferably someone who is capable of ‘wearing many hats’ and getting hands on in other areas across the Data Engineering pipeline if necessary! Experience leading team of Data Engineers/Scientists. Min. Bachelors’ degree in STEM subject (ideally from UK university). THE more »

secure operation of AI and ML systems. Develop and own robust enterprise security architecture for AI/ML systems, CI/CD and data pipelines. Participate in enterprise-wide architecture initiatives for AI/ML. This is a hybrid role with multiple UK locations Salary up to more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help … build data platforms to enable predictive government services that make a positive impact on the people in the UK. So, if you are looking to be part of this mission, we would love to hear from you. Support in applying If you need this job description in another … interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by more »

Senior Data Engineer - Rapidly growing highstreet brand - Hybrid - up to £100,000 Burns Sheehan is partnered with a rapidly growing high-street chain who have seen great success recently and are in the process of expanding further in the UK and abroad. This will be s a great … opportunity to have a real impact on the strategy and roadmap for data across the business. Working closely with the wider tech teams on a super greenfield project, this is the perfect opportunity to have a real impact on a scaling business. You will be working very closely … Integration: Gather data from various departments and tools, integrating it into a central data lake or warehouse. Data Pipeline Development: Design and construct data pipelines to automate data flow, involving ETL processes as needed. Modern tech stack - Python, AWS more »

Azure Data Engineer | Cheltenham | £50,000-£70,000 Locke & McCloud are working with a leading Cyber Security Consultancy that is home to over 4000 specialists who support clients across manufacturing, defence and security, energy and utilities, financial services and many other industries. They have offices globally and are … recognised for the impressive high standard of work they conduct. They are looking for an Azure Data Engineer, you will play a pivotal role in this journey, leveraging your expertise to architect, design, and implement scalable data solutions on the Azure platform. You will collaborate closely … with stakeholders to understand business requirements, design data solutions, and deliver value-added insights. You will be responsible for architecting data pipelines, optimizing data storage and retrieval, and ensuring the integrity and security of our data ecosystem. Additionally, you will have the more »

Java Data Engineer - 6 Month FT Contract About us Amber Labs was born out of the recognition that many organisations require support on their data maturity journey. Our team is passionate and experienced in delivering cutting-edge data capability. Amber Labs was established with … a vision to provide specialist services, automation, accelerators competitively to organisations across EMEA. The Project The Java Data Engineer needs to be able to programme in Java as the project uses Java to ingest the data into the platform. The Consultant would be helping to build … out the Data Lake and Lakehouse on Databricks, working with AWS. Skill Priority: AWS, Java (to support ingestion), Databricks - experience in PowerBi would also be useful. You will be a Engineer with past experience with java, data, and infrastructure (devOps). Java, Python, PySpark Mechanisms: MongoDB more »

be working with a London-based B2B SaaS startup who are looking to expand the engineering team by bringing in a business-savvy data engineer to be the third member of the data team. The role: This role primarily covers building out the core product by … create a scalable SaaS product. Once this has achieved a certain level of product maturity, this role will also involve building their own data platform. We they offer: • Senior mentorship • Competitive compensation package, incl. stock options • Flexible hours and hybrid working, typically 3 days a week in the … a net-zero CO2 company and donate 1% of their revenues to social impact causes. Requirements: • A proven level of commercial experience in data engineering • Experience at seed to series A/B stage companies or an excitement to experience first-hand the joys and pains the come more »

be essential for achieving project success. Key Responsibilities: Software Development: Write high-quality, maintainable code using languages such as Python and SQL Establish data tools like Snowflake and Azure Data Lake Services (ADLS) Gen 2 Utilize PowerBI, Tableau, or similar tools to design and create interactive … PoCs to validate new technologies, frameworks, or solutions. Drive the development of MVPs, ensuring timely delivery and alignment with business goals. Azure and Data Engineering: Leverage your Azure expertise to design and implement cloud-based solutions. Collaborate with data engineers to build robust data pipelines and ensure data quality. FAME (Financial Analysis Made Easy): Familiarity with financial systems, including FAME , will be advantageous. Use your knowledge to enhance banking processes and systems. Agile Methodologies: Apply agile practices such as DevOps (including CI/CD), Test-Driven Development, and Infrastructure as more »

QD will focus on quantitative trading infrastructure development and maintenance. This will include back-testing, signal and risk monitoring, building and maintaining robust data pipelines and databases that connect with other quantitative trading infrastructures, Optimising system performance and scalability, Identifying and resolving technical problems that might arise within … What we’re looking for/Skills that will help you in the role programming skills using Python and experience of utilising large data sets (if you have proven additional skills using C++/C# will be seen as advantageous). knowledge of data structures, database … and data pipelines for efficient data management. experience of successful working in a trading environment; utilities, producers or trading houses is preferred but open to other relevant industry backgrounds. work experience in small, high-performance team a distinct advantage. strong numerical and analytical skills. thinking, practical more »