1 to 25 of 272 Big Data Jobs in the UK

Data Platform Manager Location: dmg::media Headquarters – London Position: Permanent Package Description Our benefits package increases the longer you’ve been with us. Here’s what to expect: 25 days’ holiday (increasing by 1 per year up to a total of 30) Upon joining you will be automatically enrolled … Plus many other benefits…. Job Introduction DMG:Media own some of the world’s biggest news brands, and as such processes billions of data points every month in order to provide insights and targeting criteria for teams and stakeholders as part of our ambition to be the world … s leading Publisher when it comes to the sophisticated application of data – to power relentless growth. DMG:Media is seeking an experienced and talented Data Platform Manager to evolve its Big Data Platform and advance its overall data proposition. The successful candidate will work closely more »

Director Data Architect – Digital & Emerging Technologies – Technology Consulting – BelfastAt EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and … of opportunity to spread your wings and develop your skill set to keep up with the ever-growing demands of the digital landscape. Our Data Services Group team helps apply cutting edge technology and techniques to bring solutions to our clients. As part of that, you'll sit side … with significant client-side experience or individuals who have gained project and technology delivery experience within large recognised organisations. Your key responsibilities • As a Data Architect, you will support our clients in defining and implementing a data journey aligned with their strategic objectives. • Create solution designs and estimates more »

not afraid to speak our minds to help steer our customers towards understanding and achieving their key goals. We are looking for a Lead Data Consultant to help us grow and on our journey of taking OC to the next level. Your experience as a data focused technologist … strategise, and deal with the ingestion, processing, integration and ability to get insights out of their data. What you’ll spend your time on: Data Strategy & Architecture: Help customers make sense of, and understand their data in the context of what their business is trying to achieve. Create … data models and articulate the tradeoffs around different data approaches. Design and Architect complex data platforms and solutions across a variety of different scenarios. Leadership & Consulting: Provide technical leadership and guidance for our customers and your fellow team-mates in the area of data and data more »

Details Title: Data Architect Employment Type: Full-Time Location: UK - Remote Salary: £75,000 - £85,000 pa Overview We are looking for a Data Architect with expertise working with modern Data Architecture, Data Governance, Big Data and Data Engineering to join us at … Vault Data. The ideal candidate will be someone passionate about creating a robust, scalable and secure data strategy to drive innovation within the business. Job Description As a Data Architect, you will establish and govern the data architecture, data strategy, data management and road-map … with key milestones and deliverables to deliver our product vision. You will lead on Data Governance and Compliance and collaborate with our Developers, ML, AI, QA and Security Engineers to integrate into the broader product life-cycle. As a leading member of the Data Team, you are expected more »

For this role, you will be responsible for providing the framework that appropriately replicates the Big Data needs of a company utilizing data. Essential requirements: More than 3 years of presales experience in the design of Big Data and Data analytics solutions according to customer … definition, effort and cost estimation, Past experience in dealing with partners, tools vendors, etc. Business Domain Knowledge More than 5 years of experience in Big Data implementation projects Experience in the definition of Big Data architecture with different tools and environments: Cloud (AWS, Azure and GCP … Cloudera, No-sql databases (Cassandra, Mongo DB), ELK, Kafka, Snowflake, etc. Past experience in Data Engineering and data quality tools (Informatica, Talend, etc.) Previous involvement in working in a Multilanguage and multicultural environment Proactive, tech passionate and highly motivated Desirable requirements: Experience in Data analysis and visualization more »

GCP Data Engineer - Insight & Data Services - Permanent - Hybrid ( Cardiff HQ ) Salary guideline: £85,000 - £95,000 pa Base Location: Cardiff required in once or twice a month The Client: Our client is a global leader in Systems Integration and IT Consultancy. They have built out a super advanced … and respected industry-wide Insights & Data Practice. The Data Engineering, Architecture and Platform practice is part of global Insights & Data group. The Focus of the Role: Build and deliver GCP data engineering solutions as part of a larger project: Use Google Data Products tools (e.g. … BigQuery, Dataflow, DataProc, AI Building Blocks, Looker, Cloud Data Fusion, Data prep, etc.) to build solutions for our customers Experience in Spark (Scala/Python/Java) and Kafka. Experience in MDM, Metadata Management, Data Quality and Data Lineage tools. E2E Data Engineering and Lifecycle more »

GCP Data Engineer - Insight & Data Services - Permanent Salary guideline: £85,000 - £95,000 pa (D.O.E) + 5-10% Bonus, Pension up to 6% contributory, Health Insurance, Life Assurance etc. Base Location: Closest office to your home location/Hybrid working/Part Remote/UK wide The Client … Our client is a global leader in Systems Integration and IT Consultancy. They have built out a super advanced and respected industry-wide Insights & Data Practice. The Data Engineering, Architecture and Platform practice is part of global Insights & Data group. The Focus of the Role: Build and … deliver GCP data engineering solutions as part of a larger project: Use Google Data Products tools (e.g. BigQuery, Dataflow, DataProc, AI Building Blocks, Looker, Cloud Data Fusion, Data prep, etc.) to build solutions for our customers Experience in Spark (Scala/Python/Java) and Kafka. more »

Senior Developer (Data & Analytics) £450-£550 Inside IR35 12 months Hybrid Working - 2 full days a week working in London Talent are seeking a highly skilled Senior Developer with extensive experience in ETL/ELT processes, data warehousing/business intelligence methodologies, and best practices. The ideal candidate … will have a strong background in handling big data, cloud technologies, and unstructured data, along with a deep understanding of star schema structure and hybrid data warehouse design. As a Developer your key responsibilities will be: Design, develop, and maintain robust ETL/ELT processes and … data pipelines. Implement data warehousing solutions using Kimball and Inmon methodologies. Develop and manage cloud-based data solutions using Azure services such as Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Create and optimize data processing workflows in Databricks using PySpark more »

we serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI. Inviting applications for the role of Senior Principal Consultant, Data Architect/Data Engineer! In this role, you will … play a pivotal role in designing and implementing robust data solutions. Your technical expertise and leadership will drive the success of our big data initiatives. Good level of experience is required. Responsibilities: Build robust, high-performance, and adaptable solutions for modern platforms (GCP Big Query,Relational … OLAP) Finance data modelling extensive experience desired as the data lead. Talend/Informatica transformation logic experience is required Technical thought leadership on architecture, data modeling, and Big Data strategy Expertise in technical principles, vision, and standards for data warehouse. Scalability to handle increasing more »

We are a team of passionate engineers committed to building the best-in-class petabyte-scale data infrastructure optimization platform that combines hardware acceleration with performance metering to enable real-time actionable insights for reducing data center costs. So far, we have raised a total of $3.5M in … will collaborate with the founding team to expand the integration of our custom compiler technology with the internals of leading open-source software for Big Data analytics to drive faster data processing and broader operation coverage. Your contributions to our core product will directly impact data … every day where Xonai is being deployed. What you will do: Implement extensible optimizations for various query processing components such as columnar batch processing, data reading, shuffling and data partitioning algorithms. Implement code generation targeting Xonai custom DSL to accelerate SQL operations to be supported. Run profiling and more »

We offer world class learning and career development opportunities, while we celebrate an inclusive culture. The role We have an incredible opportunity for a Data Architectto influence the future of data management and data analytics at Allianz. We are looking for a self-motivated individual who is … looking to take our data capabilities to the next level. At Allianz there is a growing focus on data and data-driven decision-making. To enable this we are seeking a highly skilled and experienced Data Architect to design and govern end to end data solutions that support our organisation's needs. The successful candidate will work closely with our business, Allianz Group and other data teams and you will be part of the Data Architecture team based at our Head Office in Guildford. Allianz offers a hybrid working model, which means more »

AWS Data Architect (Must have current SC) Amber Labs was born out of the recognition that many organisations require support on their data maturity journey. Our team is passionate and experienced in delivering cutting-edge data capability. Amber Labs was established with a vision to provide specialist … services, automation, accelerators competitively to organisations across EMEA. Job Summary We are seeking a highly skilled AWS Data Architect to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and optimizing our data architecture on the AWS platform. You will work closely with various … teams to ensure data integrity, security, and availability, driving our data strategy forward Key Responsibilities Design and Implement Data Solutions: Develop scalable and efficient data architecture solutions on AWS. Create and maintain data pipelines using AWS services such as Glue, Lambda, Kinesis, and Data more »

Job Title: Data Engineer Location: London Job Type: Permanent Work Type: Hybrid Salary : £50,000 to £55,000 per annum Are you a sports enthusiast with a passion for working in the sports industry? Whether you're interested in the dynamic world of professional sports, the business of sports … of possibilities for those eager to immerse themselves in this thrilling and fast-paced environment. Databuzz is presently seeking an experienced candidate for a Data Engineer role with one of our clients located in London. About the Client: Our client is a sports tech company that leverages AI and … expert knowledge to offer data and analysis, addressing performance and commercial challenges in the sports and media industries. About the Role: As a Data Engineer you will be pivotal in designing, developing, and maintaining data architecture and infrastructure. The ideal candidate should have a strong foundation in more »

Data and Analytics Developer Overview We are seeking a highly skilled Data and Analytics Developer with extensive experience in ETL/ELT, data warehousing/business intelligence methodologies, and best practices. The ideal candidate will have a strong background in handling big data, cloud technology … and unstructured data, along with a deep understanding of relevant tools and technologies. Key Responsibilities Demonstrate detailed working knowledge of ETL/ELT processes, data warehousing/business intelligence methodologies, and best practices. Handle big data, cloud technology, and unstructured data, employing appropriate methodologies. Understand … and apply Kimball, Inmon, and hybrid data warehouse design principles. Utilize cloud data products such as Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Databricks and PySpark Development Develop in Databricks with experience coding in PySpark and Spark SQL. Ensure ETL code is more »

Role: Data Architect Location: London, UK Define all architecture patterns (Data Mesh, Data Fabric, EventHub etc) Define each architecture pattern Data & Analytics Platform Functional Blueprint, Logical Layers and Each layer Capabilities Identify All Ingestion Patterns (Real Time, Batch, Structured, Unstructured (Images/PDF) for each data & analytics platform Analyze existing Data & Analytics Platform Architecture Playbook, Identify Gaps and Enrich Playbook Guided Tooling Framework (Scorecard based approach) Potential Engineering Frameworks (Structured/Semi-Structure) Define Intake Frameworks (Unstructured - OCR/Intake) Data Governance Capabilities/Framework/Integration with rest of Ecosystems Design & Recommend … Data Traceability/Lineage/DQ/Reconciliation and Observability Platform Understanding of Cloud (GCP, AWS) Services Offering Deep Understanding of Banking Regulations and solution required to adopt them in Hybrid Cloud Ecosystem Data & Analytics Platform Governance: FinOps, Regulatory Conduct MVP/POC Qualifying Criteria Must have 12+ more »

Key responsibilities: Develop robust architectures and designs for big data platform and applications within the Apache Hadoop ecosystem. Implement and deploy big data platform and solutions on-premises and in hybrid cloud environments. Read, understand, and modify open-source code to implement bug fixes and perform … and support large scale migration for critical applications. Your Profile Key Skills/Knowledge/Experience: Proven experience in architecting, designing, building, and deploying big data platforms and applications using the Apache Hadoop ecosystem in hybrid cloud and private cloud scenarios. Experience with hybrid cloud big data platform designs and deployments, especially in AWS, Azure, or Google Cloud Platform. Experience in large-scale data platform builds and application migrations. Expert knowledge of Apache Hadoop ecosystem and associated Apache projects (eg, HDFS, Hive, HBase, Spark, Ranger, Kafka, Yarn etc.). Proficiency in Kubernetes for container orchestration. more »

Senior Data Engineer Mobysoft is one of the fastest growing SaaS providers in the UK and has been shortlisted in the "Top 50 fastest growing technology companies in the North" for four successive years. Mobysoft provides predictive analytical software that has helped our customers deliver tens of millions of … year at the Real I.T Awards 2024- one of the many awards we are proud of ! Role overview We are an ambitious, customer-centric Data & Insights team, dedicated to developing a new generation of data products that unlock significant value for the social housing sector. We operate with … a focused product lens, driven by curiosity and a commitment to technical excellence. Data Engineering is foundational to this mission, ensuring synchronized, curated, trusted, dynamic data is available at speed and scale for our clients, data analysts,data scientists, and stakeholders. As such we are looking more »

an experienced AWS Cloud Architect to design AWS reference architecture for our services-led client. Responsibilities: Design and implement scalable, secure, and high-performance data architectures on AWS. Develop data models and database designs that align with business requirements and ensure data integrity. Proficiency in CI/… CI, or AWS CodePipeline. Hands-on experience with Infrastructure as Code (IaC) tools like AWS CloudFormation, Terraform, or similar. Create and maintain ETL processes, data pipelines, and data integration workflows using AWS services. Implement data storage solutions, including data lakes, data warehouses, and operational databases. … Provide technical leadership and guidance on AWS data services and architecture to the team. Requirements: Proven experience as an AWS Data Architect or similar role, with a strong focus on data architecture and management. In-depth knowledge of AWS data services, including but not limited to more »

Senior Data Architect Opportunity - Scotland - Hybrid/Remote The Bridge IT have partnered with a leading energy supplier who are due to undertake a large data transformation spanning across the organisation. As a Senior Data Architect, you will play a pivotal role in designing, creating, and managing … our clients data architecture. Reporting to the Lead Data Architect, you will be instrumental in establishing a solid foundation for data analytics and data management, ensuring data is organised, accessible, secure, and aligned with business objectives. Key Responsibilities: Design, create, and manage comprehensive data architecture to support data analytics and management. Understand and address business issues, events, and activities, considering their wider implications and long-term impact. Ensure that detailed designs and solutions align with the solution data architecture. Manage and resolve design issues, working closely with the applications/integration more »

is a not-for-profit organisation focused on developing the blockchain/DLT ecosystem. Due to ongoing growth they are now looking for a Data Engineer to join their team. This role is pivotal in managing, curating, optimising, and securing datasets specifically related to cryptocurrency discussions across various platforms. … The ideal candidate will be adept in web scraping, data quality assurance using AI, data integration, ensuring data security and compliance, and maintaining detailed documentation. Blockchain experience is not needed but a solid background with Python and AWS is a must. Role and Responsibilities Data Collection … Identify relevant chat sources, groups, and forums on platforms discussing particular topics. Maintain and develop web scraping tools or APIs for periodic data extraction. Data Quality Assurance: Develop and implement AI-based procedures for quality control of data and data sources to eliminate inaccuracies and anomalies. more »

a not-for-profit organisation focused on developing the blockchain/DLT ecosystem. Due to ongoing growth they are now looking for an experienced Data Engineer to join their team. This role is pivotal in managing, curating, optimising, and securing datasets specifically related to cryptocurrency discussions across various platforms. … The ideal candidate will be adept in web scraping, data quality assurance using AI, data integration, ensuring data security and compliance, and maintaining detailed documentation. Blockchain experience is not needed but a solid background with Python, AWS and web scraping is a must. Role and Responsibilities Data Collection: Identify relevant chat sources, groups, and forums on platforms discussing particular topics. Maintain and develop web scraping tools or APIs for periodic data extraction. Data Quality Assurance: Develop and implement AI-based procedures for quality control of data and data sources to eliminate inaccuracies more »

This Global Pharmaceutical Services provider are looking for a Data Engineer to work within their growing Business Intelligence technical service function. You will be supporting the technical development of their cloud data platforms, offering the options for near real time process reporting solutions. Client Details Global Pharmaceutical Services … provider Description This Global Pharmaceutical Services provider are looking for a Data Engineer to work within their growing Business Intelligence technical service function. You will be supporting the technical development of their cloud data platforms, offering the options for near real time process reporting solutions. You will work … on designing and developing their company data acquisition strategy allowing for near real time process reporting and full support of contractual reporting to customers. Key Responsibilities: Monitor and maintain ETL processes to ensure the continuation of an accurate data reporting platform for the business. Explore solutions for optimising more »

Analytics Advanced Specialisation. Adatis is now part of Telefonica Tech as of March 2022, powering the next phase of our growth. We’re a Data Analytics Consultancy that works with our clients to deliver information solutions, to help make better informed business decisions. Our integral approach within our team … that people really love; and, importantly, a career model that lets you take control of your development and progression. OUR VISION To be the data analytics company most admired for its people, culture and innovation. THE ROLE The primary focus for you will be the design and delivery of … enterprise-level data solutions from the earliest discovery phases of projects through prototyping, architectural design and delivery. You will be working with Azure tools such as Databricks, Data Factory as well as Hadoop to create big data environments which, in turn, will help businesses to gain more »

of knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a … fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. About you: Our team … skills Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data ingestion more »

Data Models Lead - Data Engineering - MarTech R83188 Mars is a family-owned business with more than $35 billion in global sales. We produce some of the world’s best-loved brands: M&M’s®, SNICKERS®, TWIX®, MILKY WAY®, DOVE®, PEDIGREE®, ROYAL CANIN®, WHISKAS®, EXTRA®, ORBIT®, 5™, SKITTLES®, BEN … Principles – Quality, Responsibility, Mutuality, Efficiency and Freedom – inspire our 130,000 Associates to act daily towards creating the world we want tomorrow. Role Profile Data and Analytics is foundational to our Petcare OGSM and will drive our transformation to a business that is powered by data. To deliver on … OR equivalent demonstrated through work experience. Nice to have – Masters/Degree with some computing, scientific, statistical or mathematical component. Extensive experience working with data, data models, and data systems in support of marketing technology (MarTech), e.g. CMS, CDPs, identity resolution/SSO Extensive experience using MarTech more »