25 of 25 Big Data Jobs in the South West

growth and development opportunities in an environment that embraces your unique skills and experience. Your role and responsibilities IBM is currently seeking a seasoned Big Data Java Developer to join our Public Sector team for a significant project. The ideal candidate will possess a deep understanding of Big Data technologies, particularly within a Java context, along with a passion for creating innovative solutions tailored to the unique demands of public sector projects. As a Developer at IBM you'll participate in many aspects of the software development lifecycle, such as design, code implementation, testing, and support. … processing and analyzing large datasets, utilizing frameworks such as Apache Hadoop, Spark, and Kafka. Collaborate with cross-functional teams to define, design, and ship data-intensive features and services. Optimize existing data processing pipelines for efficiency, scalability, and reliability. Develop and execute unit tests, ensuring the quality and More ❯

The Data Management practice within the Insights and Data business unit of Capgemini is a global practice involved on a broad range of business and IT focused topics from Information Strategy, Governance, Master Data Management, Data Architecture, Data Migration and Lifecycle Management. We help our … clients build an enterprise class data platform that allows them to move ahead in their journey of big data and insights. Primarily working with leading software vendors like SAP, Informatica, IBM, Oracle et al, the team are first and foremost Consultants, putting client requirements and industry best … integration projects for our clients. Our ETL Specialists work closely with the project and client teams to understand the requirements, analyse source and target data architecture and systems, propose the most effective solution and work with a team of experts to deliver. We are looking for our ETL Specialists More ❯

The Data Management practice within the Insights and Data business unit of Capgemini is a global practice involved on a broad range of business and IT focused topics from Information Strategy, Governance, Master Data Management, Data Architecture, Data Migration and Lifecycle Management. We help our … clients build an enterprise class data platform that allows them to move ahead in their journey of big data and insights. Primarily working with leading software vendors like SAP, Informatica, IBM, Oracle et al, the team are first and foremost Consultants, putting client requirements and industry best … integration projects for our clients. Our ETL Specialists work closely with the project and client teams to understand the requirements, analyse source and target data architecture and systems, propose the most effective solution and work with a team of experts to deliver. We are looking for our ETL Specialists More ❯

Data Engineer required by our market leading, award winning, professional services organisation based in Yeovil. The successful Data Engineer, you'll play a vital role in designing, building, and maintaining sophisticated data pipelines and ensuring the integrity of our clients extensive customer data. Your work will support … data-driven decision-making across the business, helping to drive forward key customer insights and analytics. In this role, you will work closely with cross-functional teams to deliver high-quality data infrastructure that powers marketing efforts and analytics. Reporting directly into the Head of Data, you … will collaborate with a team of experienced data professionals while continuing to develop your expertise in data engineering. Key Responsibilities Design & Build Data Pipelines: Create and maintain scalable data pipeline architecture that supports business needs. Data Management: Assemble large, complex data sets to meet More ❯

Data Strategy Consultant Department: Consultancy Employment Type: Full Time Location: United Kingdom/Remote Description As a consultant at Actica, you will have the opportunity to work with a wide range of high-profile UK public sector and defence organisations. Our position as an independent, trusted, client-side advisor … so, will play a key role in nationally critical projects which make a real difference to people's everyday lives. You will use your data strategy skills across a range of consulting projects and clients. With expertise in using data strategy practices to enable large, complex businesses to … best exploit their data, you will help clients to make informed decisions that provide real benefit. Locations: London, Guildford, Bristol. M4 corridor Key Responsibilities Working either individually or as part of a larger Actica team, you will undertake a number of consultancy assignments, which could include: Creating conceptual and More ❯

Principal Data Engineer - REMOTE WORKING We are working with one of our biggest customers who are a leading force in the financial services sector. The company are based in Hampshire and the role is remote with occasional trips to the office when required. As a Principal Data Engineer … this involves designing scalable solutions, optimising data systems, and collaborating with various teams to support data-driven decision-making. As a Principal Data Engineer, you will also mentor junior engineers, ensuring best practices and innovative techniques are implemented to enhance overall data infrastructure and strategy alignment … with business goals. Main Responsibilities include: ' • Develop, design, and test data deliveries throughout the development lifecycle.' • Train and coach developers.' • Manage day-to-day data delivery tasks.' • Collaborate with stakeholders to align data solutions with organizational objectives.' • Design and implement scalable, high-performance data architectures.' • Define More ❯

Scala Data Engineer I am working with an analytics and digital solutions consultancy that partner with clients from several different industries to unlock their potential to become truly data driven. They work to deliver tailored, bespoke systems to fit the needs of their clients with a focus on … business have continued to build on their operations in both central Europe and America. You will be joining a project with a focus on data migration from Hadoop to the cloud, creating robust data pipelines and working with Scala, Spark and other AWS services to process and manipulate … data. As part of this role, you will be responsible for some of the following areas. Develop big data solutions utilising Hadoop and Apache Spark Create, develop and maintain robust ETL pipelines using AWS Glue and Scala Design and implement Scala-based applications for the use of big More ❯

Big Data : Are you excited about taking your technical career to new heights with a full-time, W-2 role as a consultant in a dynamic and rapidly growing company? If you are, let's get in touch - your interest is the first step to starting the conversation. … and SQL It is preferred that you have experience in at least one of the following additional languages: Java, C#, C++, Scala Familiarity with Big Data technology in cloud and on-premises environments: Hadoop, HDFS, Spark, NoSQL Databases, Hive, MongoDB, Airflow, Kafka, AWS, Azure, Dockers or Snowflake Good … understanding of object-oriented programming (OOP) principles & concepts Familiarity with advanced SQL techniques Familiarity with data visualization tools such as Tableau or Power BI Familiarity with Apache Flink or Apache Storm Understanding of DevOps practices and tools for (CI/CD) pipelines. Awareness of data security best practices More ❯

Your role and responsibilities We are seeking a highly skilled and experienced Senior Java Engineer to join our agile team and work on innovative big data systems that support public sector projects. As a Senior Java Engineer, you will play a critical role in designing, developing, and delivering … professional experience The ideal candidate will have a strong focus on delivering exceptional user experiences and a proven track record of working with complex data-intensive applications. Proven experience as a Java Engineer with a strong focus on user experience. Deep understanding of Java and its ecosystems, including experience … with popular Java frameworks (e.g. Spring, Hibernate). Familiarity with big data technologies and tools (e.g. Hadoop, Spark, NoSQL databases). Strong experience with Java development, including design, implementation, and testing of large-scale systems. Experience working on public sector projects and understanding of the unique challenges and More ❯

Join a dynamic, innovative environment where data-driven decisions fuel success. As a Data Scientist, you’ll work on impactful projects, from advanced analytics to process optimization, driving efficiency and growth. Key Responsibilities Analyze complex datasets to uncover insights and inform decisions. Design and implement machine learning models. … Develop dashboards, reports, and visualizations for data insights. Collaborate with teams to identify data-driven improvements. Enhance processes through predictive analytics and statistical modeling. Build data-driven systems with the software development team. Communicate findings clearly to all stakeholders. Required Skills 2+ years in data science … machine learning, and statistical analysis. Degree in Data Science, Computer Science, or related field. Proficiency in Python, SQL, and data visualization (e.g., Power BI). Strong skills in predictive modeling and statistical analysis. Excellent communication and ability to solve business problems with data. Desirable Skills Experience with cloud More ❯

you’ll do varied and fascinating work in a supportive and inclusive environment that puts the emphasis on teamwork. The Role As a Senior Data Scientist, you’ll leverage data science to advance our mission and inform policy and strategy decisions. While this role is data-centric … collaboration is at its heart. In this role, you’ll collaborate with data scientists and mission teams to utilise our services for problem-solving and discovering new applications. You’ll work with project teams to research and implement both established and novel models, and adapt AI techniques into our … to host large language models across multiple Graphic Processing Units (GPUs). After a year in this role, you’ll have opportunities to manage data scientists and engineers. You understand the power of data for a business, and at GCHQ, we know how to use it for good. More ❯

thrive in the future and benefits from well-managed growth, investment and regeneration. Your next role We have an excellent opportunity for a Principal Data Engineer to join our small and friendly Performance, Intelligence & Insight team - with the chance to progress, shape and challenge our service. In this key … position, you will be responsible for the Council's Data Architecture, which ensures the Council has the access to the data and insight it requires to fulfil its statutory or other functions. Working in collaboration and line managing a Data Engineer, the aim is to build and … document the Council's data and pipeline infrastructure against the vision and designs agreed in Council's Data Strategy. We are forward thinking and looking for new talent and ideas, therefore this is a great opportunity for you to challenge and shape our service, in an organisation that More ❯

while being accountable for ensuring design constraints are met by software code development Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems Proactively identifies hidden problems and patterns in data and uses these insights … and story refinement and estimation process through to delivery Provides out of hours application support and coordination of Production releases Analyzes complex flows of data between technical systems to develop solutions that meet the business needs Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts … event driven architecture and distributed messaging technologies (e.g. Kafka ) Experience with Docker and running Production workloads on Kubernetes Experience using and designing schemas/data structures on relational databases (e.g. PostgreSQL , MySQL , Aurora , and Oracle ) Experience in applying appropriate data structures and algorithms to solve business and technical More ❯

while being accountable for ensuring design constraints are met by software code development Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems Proactively identifies hidden problems and patterns in data and uses these insights … and story refinement and estimation process through to delivery Provides out of hours application support and coordination of Production releases Analyzes complex flows of data between technical systems to develop solutions that meet the business needs Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts … event driven architecture and distributed messaging technologies (e.g. Kafka ) Experience with Docker and running Production workloads on Kubernetes Experience using and designing schemas/data structures on relational databases (e.g. PostgreSQL , MySQL , Aurora , and Oracle ) Experience in applying appropriate data structures and algorithms to solve business and technical More ❯

You'll be part of a supportive and collaborative team, with guidance from experienced professionals while having the autonomy to shape and analyse complex data sets. In this role, you'll focus on data analytics; interpreting trends, identifying influencing factors, and applying statistical models to uncover meaningful insights. … You'll need a strong foundation in mathematics and statistics, along with hands on experience with SQL or Python for data transformation and analysis. Whether you have experience in retail, energy, or other data-rich industries, or bring relevant academic expertise, this is a fantastic opportunity to grow … your career in a dynamic and inclusive environment. If you're passionate about using data to solve real-world challenges and communicate insights in an accessible way, we'd love to hear from you. What you'll be doing Exploring and analysing large datasets to uncover trends, patterns, and More ❯

An understanding of frontend web technologies and how web browsers behave and perform. About Us For over 50 years, Verisk has been the leading data analytics and technology partner to the global insurance industry by delivering value to our clients through expertise and scale. We empower communities and businesses … We're 7,000 people strong. We relentlessly and ethically pursue innovation. And we are looking for people like you to help us translate big data into big ideas. Join us and create an exceptional experience for yourself and a better tomorrow for future generations. Verisk Analytics More ❯

Python Engineer/Data Scientist | 9 Month Contract | Bath, UK | £450pd Outside IR35 Python Engineer/Data Scientist My client is currently hiring a Python Engineer/Data Scientist for an exciting project that will be running until the end of the year. You will be working … within a Geospatial team of Developers and Data Scientists with a strong focus on the Python Engineering side for you. You will be working with Big Data and building the flows along with working on the infrastructure side too, so an overall Python generalist is ideal for … NumPy, Django, etc) AWS (Lambda, AWS integrations etc) Metaflow & Prefect What you need to do now If you feel like this Python Engineer/Data Scientist contract is a good fit for you, and you would like to know more, please send your latest CV to Ash . Fellows More ❯

connectivity activities for our braking systems. Knowledge of brake system functionality and familiarity with brake modulation functions and electronic braking systems is required. Understand data-driven development as a tool for improving hardware and software design. Know-how of embedded systems, automotive engineering, and big data engineering … is essential. Develop and produce fleets to provide data for decision-making. Collaborate with internal quality, systems, application, software, and hardware teams in the US and Germany, as needed. Collaborate with and/or present to the customer to align requirements for the collection of brake system data … and test connectivity software components. Guide customer teams for the development and deployment of brake system connectivity functions. Define, identify, and realize approaches to data analytics which contribute to improvements in brake system design and validation testing. Establish a working relationship with internal customer teams and assist in identifying More ❯

contract + +Outside IR35 Skills: +DevOps Engineer experience +Data engineering skills +Ansible/Terraform +DV clearance The role: Participating in the full lifecycle of data solution development, from requirements engineering through to continuous optimisation engineering and all the typical activities in between Providing technical thought-leadership and advisory on … technologies and processes at the core of the data domain, as well as data domain adjacent technologies Engaging and collaborating with both internal and external teams and be a confident participant as well as a leader Assisting with solution improvement activities driven either by the project or service … keeping and task prioritisation skills An ability to convey technical concepts to all levels of an audience, concisely, and with clarity An understanding of data-centric architectures and solutions that is both broad and in some depth. Data engineering skills - ETL/ELT Technical implementation skills - application of More ❯

DevSecOps practices, handling secrets management (Vault, Azure Key Vault), and zero-trust security. Implement security controls for both cloud and on-premises environments, ensuring data integrity, confidentiality, and availability. Knowledge of securing containerised environments (Kubernetes security, Docker security). Monitor and troubleshoot systems to ensure optimal performance, identifying and … of serverless architectures, such as Azure Functions, AWS Lambda, or Google Cloud Functions. Knowledge of disaster recovery and business continuity planning. Experience in handling Big Data Architecture. Proven experience with Microsoft Azure and Azure DevOps. Strong proficiency in Azure Bicep for infrastructure automation. Hands-on experience in deploying … solutions on client premises. In-depth understanding of security best practices, including network security, identity management, and data encryption. Experience with compliance frameworks such as ISO 27001, SOC 2, GDPR, etc. In-depth understanding of security best practices, including network security, identity management, data encryption, and DevSecOps practices. More ❯

Kubernetes, OpenShift, MicroK8s • Infrastructure as Code (IaC), automation & configuration management • Ansible (plus Puppet, Saltstack), Terraform, CloudFormation • NodeJS, REACT/MaterialUI (plus Angular), Python, JavaScript • Big data processing and analysis, e.g. Apache Hadoop (CDH), Apache Spark • RedHat Enterprise Linux, CentOS, Debian or Ubuntu. • Java 8, Spring framework (preferably Spring More ❯

such as Java, TypeScript, Python, and Go Web libraries and frameworks such as React and Angular Designing, building, and maintaining CI/CD pipelines Big data technologies, such as NiFi, Hadoop, Spark Cloud and containerization technologies such as AWS, OpenShift, Kubernetes, Docker DevOps methodologies, such as infrastructure as More ❯

hands-on in the design, development, and testing of the solution. This could include the specification of the system, choice of technologies, creation of data models, implementation, configuration, development, and testing. Be part of a team contributing to the end-to-end technical delivery, understanding how the solution is … the Python programming language. Have experience of working and leading tasks using a DevOps way of working. Have detailed knowledge of using and configuring big data technologies. Have experience of continuous improvement and process optimisation. Diversity and Inclusion: Diversity makes sense for us, for our customers and for More ❯

to include . Well-rounded Solutions Architect experience with focus on AI (Azure, CoPilot), plus experience in Dynamics 365 Building AI/ML/big data solutions in Azure Leading implementation of COTS and SaaS applications and cloud technologies for global user base Designing and developing software solutions More ❯

funded Health Tech Research Centres. Our mission is to develop impactful MedTech solutions that enhance patient care across four core themes: Sustainability in Healthcare, Big Data and AI, Frailty and Rehabilitation, and Diagnostics and Biomarkers. Working Pattern: 15hrs a week, flexible Interview Date: To be confirmed For further More ❯