Some of the main Objectives of the Data Intelligence Platform are: • Efficiently load and transform data into a DWH • Provide advanced orchestration to use Data Lake based approach • Integration with 3rd party sources, open-source APIs • Data movement in both batch and real-time change data capture • Leverage BigData technologies (Spark) to ingest, clean & transform data • Apply Machine Learning on DWH to proactively figure out issues and generate insights • Create dashboards in Oracle Analytics Cloud to drive decision-making Your Opportunity You will be responsible for applying your extensive knowledge as … a dataengineer and building Digital Government Data Platform . Our Ideal Candidate We are looking for a strong DataEngineer who thrives on research and development projects. Be technically strong and hands-on, who works efficiently with other product groups and engineering leaders to more »
Senior DataEngineer Hybrid AND Flexible Up to £75,000 + 10% bonus + share scheme MBN Solutions are delighted to have been retained to secure a DataEngineer (BigData Technologies) for our client who are firmly positioned in the "Tech For Good … space. This is a key hire for the client during the early stages of the growth of their Data team and it is therefore essential this person is highly experienced in all the areas of skills required. Our client are a start up/scale up and we are … ideally looking for a Senior DataEngineer who has previous experience and success in this environment previously. Your Role: Building reusable data pipelines at scale with the capability of integrating data from multiple sources automatically. Work with structured and unstructured data, and curate datamore »
Lead BigDataEngineer - Hybrid - £120K My client is a leading trading platform that is looking to add a talented Senior BigDataEngineer You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's … in design, processes, and implementation to improve operational management, scalability, and extensibility. The following skills/experience is essential: -Proven experience as a Lead BigDataEngineer with excellent knowledge of BigData -Excellent knowledge of Hadoop and tools such as Hbase/Hive and … Spark etc -Excellent experience of ETL, data warehousing and handling a variety of data types -Very strong knowledge of database technologies such as NoSQL, Relational, Graph stores, OLAP, Data Lakes and Business Intelligence (BI) -Experience implementing data visualisation and reporting tools -Excellent communication and business-facing more »
REMOTE Site Reliability Engineer (SRE DevOps Infrastructure AWS Python Java Go JavaScript BigData Lake Data Mesh Kubernetes Terraform Finance Trading Glue Athena Dremio Iceberg Snowflake DBT Arrow gRPC protobuf Airflow Ignite Asset Manager Investment Management Financial Services Hedge Fund DevOps) required by our asset management … client in London. You MUST have the following: Strong experience as an SRE/Site Reliability Engineer Excellent AWS Kubernetes clustering Good Python, JavaScript, Java or Go Terraform SRE experience in an enterprise scale environment The following is DESIRABLE, not essential: SRE for bigdata Glue, Athena … Dremio, Iceberg, Snowflake, DBT, Arrow, gRPC, protobuf, Airflow, Ignite Graffana, Prometheus Role: REMOTE Site Reliability Engineer (SRE DevOps Infrastructure AWS Python Java Go JavaScript BigData Lake Data Mesh Kubernetes Terraform Finance Trading Glue Athena Dremio Iceberg Snowflake DBT Arrow gRPC protobuf Airflow Ignite Asset Manager more »
Data DevOps Engineer - DevOps, Bigdata - Permanent - Gloucestershire Location: Gloucestershire/Bristol (full-time onsite) Salary: £65 - £95K per annum Negotiable DOE Benefits: Flexible working hours, career opportunities, private medical, excellent pension, and social benefits Active DV Clearance is highly desirable. Please note that candidates will … with a global edge-to-cloud company advancing the way people live and work. They help companies connect, protect, analyse, and act on their data and applications wherever they live, from edge to cloud, so they can turn insights into outcomes at the speed required to thrive in today … The Candidate: We are looking for a bright, driven, customer focussed professional to join our clients Hybrid Cloud Delivery team, and work alongside Enterprise Data Engineering Consultants to accelerate and drive data engineering opportunities. This is a fantastic opportunity for a dynamic individual with big ambitions, who more »
The role involves the design, development, implementation, and support of a cutting-edge real-time data platform, which includes data streaming, a data lake, and a blazing fast analytics database. We are looking for someone who is passionate, motivated, driven, and up for the challenge. Strong knowledge … of database design and development with previous experience in developing ETL processes, and multidimensional data models. High understanding of both relational and multidimensional modelling principles. Deep knowledge of Object-Oriented Programming languages and must have a strong experience in Java. Strong experience on data quality standards and contribution … on defining and monitoring data quality metrics and KPIs Key Skills Needed: Flink Beam Kafka Connect Java more »
