Job DescriptionLead Data Engineer (Director) - Individual contributor - Azure, Data Factory, Databricks, ApacheSpark - London Based I am hiring for a Lead Data Engineer for a crucial role within one of my Investment Bank clients in London. This role is at Director level as they require a very senior … Responsibilities: Leading data engineering practicesSupport current applications Introduce AI practices to the team/project Communicate key successes with stakeholders Key Skills: Azure Databricks ApacheSpark Datascience, AI, ML Certifications or continued upskilling/contribution to blog posts within Data & AI beneficial but not essential. This is a … UK without sponsorship, if you are interested please apply or email me directly - aaron.dhammi@nicollcurtin.comLead Data Engineer (Director) - Individual contributor - Azure, Data Factory, Databricks, ApacheSpark - London Based more »
in cloud development (ideally AWS)Knowledge and ideally hands-on experience with data streaming, event-based architectures and KafkaStrong communication and interpersonal skillsExperience with ApacheSpark or Apache Flink would be ideal, but not essentialPlease note, this role is unable to provide sponsorship.If this role sounds of more »
leading business intelligence platform (e.g. Microsoft, Crystal, Qlik, SAP, Tableau). Good understanding of open source, big data, and cloud data platforms (e.g. Hadoop, Spark, Hive, Pentaho, AWS, Azure); given a business problem, you can analyse and evaluate options and recommend solutions. Proven experience in designing, building and maintaining more »
machine learning techniques, deep learning, graph data analytics, statistical analysis, time series, geospatial, NLP, sentiment analysis, pattern detection, etc.)Experience using Python, R or Spark to extract insights from dataKnowledge of SQL for accessing and processing data (PostgreSQL preferred but general SQL knowledge more important)Experience using the latest more »
Milton Keynes, Buckinghamshire, South East, United Kingdom Hybrid / WFH Options
Dupen Ltd
Linux, APIs, infrastructure design load balancing, VMs, PostgreSQL, vector dbs. ML Learning Engineer desirable skills: Version control (Git), computer vision libraries, Big Data (Hadoop, Spark), Cloud AWS, Google Cloud, Azure, and a knowledge of secure coding techniques PCI-DSS, PA-DSS, ISO27001. Note: as there are actually two roles more »
South East London, London, United Kingdom Hybrid / WFH Options
Stepstone UK
Bachelor's degree in Computer Science or a related field (Master's degree preferred) Nice to have: experience with LLMs, Vector Databases, AWS EMR, Spark, and Python Our commitment: Equal opportunities are important to us. We believe that diversity and inclusion at The Stepstone Group are critical to our more »
Reigate, England, United Kingdom Hybrid / WFH Options
esure Group
of OO programming, software design, i.e., SOLID principles, and testing practices. Knowledge and working experience of AGILE methodologies. Proficient with SQL. Familiarity with Databricks, Spark, geospatial data/modelling and insurance are a plus. Exposure to MLOps, model monitoring principles, CI/CD and associated tech, e.g., Docker, MLflow more »
Basingstoke, England, United Kingdom Hybrid / WFH Options
Intec Select
cross-functionally across the business to understand the requirements of the products Designing and implementing performance related data ingestion pipelines from multiple sources using ApacheSpark Integrating end-to-end data pipelines ensuring a high level of quality is maintained Working with an Agile delivery/DevOps methodology more »
Surrey, England, United Kingdom Hybrid / WFH Options
Hawksworth
working in the world of Data Science You're more than capable with SQL & Python You have exposure to big data technologies such as Spark Ideally you will have experience with statistical analysis, machine learning algorithms, and data mining techniques You have excellent communication skills and can communicate well more »
high level within a typical retail trading environment is key.Experience required:A background in leveraging hands on skills using tools such as Python, R, Spark, Hadoop, SQL and cloud based platforms such as GCP, Azure and AWS to manipulate and analyse various data sets in large volumesBackground in data more »
South East London, England, United Kingdom Hybrid / WFH Options
Hunter Bond
s Degree in Computer Science, Engineering (or other related STEM subject)5+ years experience in data engineering2+ years in a leadership role.Experience working with ApacheSpark, Azure Data Factory and other data pipelines tools.Strong programming skills.Impeccable communication skills.Precise attention to detail.Pioneering attitude.If you are a Lead Data Engineer more »
South East London, England, United Kingdom Hybrid / WFH Options
Oliver Bernard
as a Lead Big Data Engineer with excellent knowledge of Big Data-Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark etc-Excellent experience of ETL, data warehousing and handling a variety of data types-Very strong knowledge of database technologies such as NoSQL, Relational more »
South East London, England, United Kingdom Hybrid / WFH Options
Oliver Bernard
of Big Data-Great understanding of Cloud e.g. Azure and or AWS-Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark etc-Excellent experience of ETL, data warehousing and handling a variety of data types-Very strong knowledge of database technologies such as NoSQL, Relational more »
ll also get exposure to Python, lots of SQL (of course) and depending on your level of experience, data stream processing tools like Kafka, Spark, etc. As this company continues to build new platforms and modernise, you’ll also be exposed to the cloud and various other modern tools more »
as TensorFlow, PyTorch, scikit-learn, and Spark.Solid understanding of statistical analysis, data mining, and predictive modeling techniques.Experience with big data technologies such as Hadoop, Spark, and distributed computing frameworks.What is in it for you?Significant Bonus Package. Flexible working for work/life balance.Private healthcare package.Significant pension contribution package.Choice more »
South East London, England, United Kingdom Hybrid / WFH Options
Revolution Technology
Sector, they are on the lookout for 2 AWS Data Engineers to come in on a contract basis.Key Skills/Requirements:Must have Python & Spark experienceMust have strong AWS experienceMust have Terraform experienceSQL & NoSQL experienceHave built out Data Warehouses & built Data PipelinesStrong Databricks & Snowflake experienceDocker, ECS, Kubernetes & Orchestration tools more »
actionable insights for business improvementsLead a small team of data scientist on Neural Networks LLMs (CNN & RNN), ML, & NLPNLP/AI/ML/Spark/Python/Data scientist/Machine Learning Engineer/OCR/Deep LearningRequirementsBachelor's degree or equivalent experience in quantitative field (Statistics, Mathematics more »
South East London, England, United Kingdom Hybrid / WFH Options
Oliver Bernard
an Architect and excellent knowledge of Big Data-Excellence experience across Azure-Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark etc-Excellent experience of ETL, data warehousing and handling a variety of data types-Very strong knowledge of database technologies such as NoSQL, Relational more »
growing business.Requirements:Strong experience with Python (2+ Years)Experience working with REST MicroservicesStrong SQLExperience working with very large data sets.Knowledge of big data tools (Spark, Kafka etc)Experience working in finance (Preferred)Strong formal education - ideally in Computer ScienceIf this sounds of interest, then please do not hesitate to more »
of the complex issues they are facing.out data-driven analysis, craft solutions to resolve business problems.Artificial Intelligence and data science approaches (Python, R, Matlab, Spark etc).database technologies such as Hadoop.tools that expand the companies tool kit, advancing their ability to serve clients.Experience needed-in a consulting environment.coaching and more »
of databases. Snowflake is widely used, as are Docker and Kubernetes for containerisation. ETL and ELT tech are also used every day, primarily Airflow, Spark, Hive and a lot more.You’ll need to come from a strong academic background with some commercial experience in a data heavy software or more »
and manage data lake/data warehouse platforms. (Some of the following types of providers: AWS, Microsoft Azure, Google Cloud Platform, Databricks, Snowflake, Cloudera, Spark, MongoDB)Done this at companies using high volumes of data, ideally in retailing. Other sectors where used high volume data would also be relevant more »
South East London, England, United Kingdom Hybrid / WFH Options
Oliver Bernard
essential:-Proven experience as an Architect and excellent knowledge of Big Data-Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark etc-Excellent experience of ETL, data warehousing and handling a variety of data types-Very strong knowledge of database technologies such as NoSQL, Relational more »
in product experimentation, Causal AI, and advanced statistical techniques.Deep knowledge of data science tools (e.g., scikit-learn, TensorFlow, PyTorch) and big data technologies (e.g., Spark).Proficiency in Python for data manipulation, model building, and scripting.Strong communication skills to present findings to both technical and non-technical audiences.This role is more »
ideally in a start-up or scale-up.- Machine learning libraries and frameworks (TensorFlow, PyTorch, scikit-learn).- Python - Big data processing tools (e.g., Spark).The role offers a salary range of between £70-100K depending on experience. The successful candidate must be able to work from the more »