1 to 25 of 217 ETL Jobs in London

scalable and reliable data pipelines and platforms using various technology solutions. Extract, transform, and load (ETL) data from various sources and formats. Build and maintain ETL pipelines Ensure data quality, integrity, and security by applying data governance and validation rules. Optimise data performance and efficiency by tuning, partitioning, indexing, and … Hands-on experience in designing, planning, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments. Skilled in data integration, ETL processes, and ensuring data quality. Capable of turning data into insights using visualisation and reporting tools. Able to effectively document business use-cases, data sources more »

in a cloud environment (Azure, AWS, GCP) Experience in at least one of: Python (or similar), SQL, PySpark Experience in building data pipeline/ETL/ELT solutions Ability and strong desire to research and learn new technologies and languages Interest in the contemporary data engineering and analytics landscape, the more »

practices. • Extensive experience with SQL databases, including complex queries and stored procedures. • Experience with SSIS, SSRS, and SSAS. • Strong understanding of data warehousing concepts, ETL, and data modelling. • Familiarity with statistical analysis, data visualization, data mining, and data transformation. • Power BI certification is a plus. • Proven problem-solving skills and more »

Coordinating the work of business, IT, and external teams to deliver the required results. Perform Feasibility, Impact Assessment, Estimation, Planning, Design and Delivery of ETL Migration projects. Documentation Review, ensuring that work produced by the teams conform to methods, designs, and standards so that economies of scale can be achieved … meaning of the data. Design, estimate, plan and implement the data migration projects from one platform/tool to another. Utilize Azure environment to extract, transform, and load (ETL) data from various sources. Design and implement data models, ensuring data accuracy, consistency, and integrity. Perform data analysis to identify trends … not limited to, SAP ERP, SAP BW, SAP HANA, Marketo, Salesforce etc. Collaboration with different teams, Requirement Gathering, Design and Delivery of Technical solutions. ETL migration project planning, estimation, and delivery Adeptia, Snaplogic ETL migration experience Hands on experience on Azure, ADF, ADLS, Synapse more »

certificates, encryptions, etc.).In-depth knowledge and experience with Azure data storage (SQL Server, Data lake, Synapse, etc.) & access tools, APIs, cloud connectivity, and ETL processes.Knowledge and some experience of MS Office/MS Office 365 suite, SharePoint Online, Power Apps, GitHub, MS Teams, etc.In-depth knowledge & experience using Visual more »

Advanced skills in SQL programming, with the ability to design, optimize, and maintain complex queries and databases. Strong experience in designing, implementing, and managing ETL processes using Azure Data Factory and other relevant tools. Proficiency in building and managing data warehouses using Azure Synapse Analytics and other data warehousing solutions. more »

through to developing user reports. They will work on the technical aspects of system integration and be involved in the development and maintenance of ETL (extract, transform, load) processes across all systems. The post holder will work closely with colleagues across the organisation to gather requirements and ensure data integrity … ensure that our technical solutions are fully integrated into business processes. Responsibilities: Advanced T-SQL and SSIS development for the creation and maintenance of ETL and reporting solutions. To lead the development and maintenance of custom applications to provide bespoke functionality, for example using .NET Framework, C# or Python. Development … expertise to internal stakeholders for College supported databases. Requirements: Experience of Advanced T-SQL querying and development: Stored Procedures, Views, functions etc. Experience of ETL development using SSIS or similar Knowledge of database and data warehouse design principles Experience of developing and maintaining custom applications to provide bespoke functionality, for more »

Data Lake Storage, Azure Databricks, and Azure SQL Database. Proficiency in SQL and programming languages like Python or Scala. Experience with data modeling and ETL/ELT concepts. Strong problem-solving and troubleshooting skills. Excellent communication and collaboration skills. Data Engineer – London more »

various teams to understand data requirements and implement solutions. > Optimizing data workflows and processes to enhance data quality, reliability, and performance. > Developing and managing ETL processes for data ingestion, processing, and transformation. > Implementing data governance practices to ensure data integrity, security, and compliance. > Monitoring and troubleshooting data infrastructure to address more »

capabilities and support our Finance business partners in their decision-making processes. Key responsibilities include: Design, build, and maintain efficient, reliable data pipelines using ETL and ELT processes. Ensure the seamless flow and availability of high-quality data across the organisation Use Snowflake for data storage, processing, and analytics. Optimise more »

model to meet new business requirements2+ years managing an analytics engineering team using a scrum/agile methodologyExperience working with commercial data warehouses (Redshift), ETL tools (Dbt), data visualization (Python notebook, Thoughtspot, Looker, Tableau, Hex), and Data Dictionary tools (Atlan)Demonstrated experience leading 2 or more multi-department analytics projects more »

Modelling, Data Point Modelling etc.), data architecture design patterns and paradigms (e.g. data lakehouse, medallion architecture, data vault, data mesh), data integration and engineering (ETL, ELT, CDC) for enterprise scale analyticsExperience designing data pipelines, data lakes and data warehouses to support data storage (SQL, NoSQL), processing analytics and visualisation solutions more »

to ensure data is accessible, reliable, and ready for analysis. Key Responsibilities: Data Pipeline Development : Design, build, and maintain data pipelines to ingest, transform, and load data from various sources into AWS data storage solutions. Data Integration : Implement ETL (Extract, Transform, Load) processes using AWS services such as AWS Glue … Java, or Scala. Experience with AWS services including S3, Redshift, Glue, Lambda, and RDS. Strong SQL skills for data manipulation and querying. Familiarity with ETL tools and processes. Understanding of data modeling and database design. Soft Skills : Strong problem-solving and analytical skills. Excellent communication and teamwork abilities. Detail-oriented more »

believe in the power of being... YOU! About the role We are seeking a highly skilled Senior Data Engineer with a strong focus on Extract, Transform, Load (ETL) processes to join our growing team. This role will be fully remote, offering flexibility and the chance to contribute significantly to our … data infrastructure. Key responsibilities of the Senior Data Engineer; Design, develop, and implement robust ETL pipelines to extract data from various sources (databases, APIs, etc.). Cleanse, transform, and validate data to ensure high quality and consistency before loading it into data warehouses or data lakes. Designing and implementing CI …/CD workflows for data engineering projects. Optimize ETL processes for efficiency, scalability, and performance. Develop and maintain documentation for data pipelines and data models. Troubleshoot and resolve ETL-related issues, ensuring data accuracy and integrity. Collaborate with data analysts, data scientists, and other engineers to understand data needs and more »

functional capabilitiesProven track record of delivering value through data products in a fast-paced, agile environment.Extensive knowledge of data principles, architecture/modeling, ingestion, ETL principles and practicesExtensive knowledge of Azure based big data platform & exposure to other clouds such as GCP is desirable.Experience in architect and design data platforms more »

of team, including ways of working, engineering principles, data governance and best practice. Become an SME on the design, development, and deployment of data ETL pipelines (using Azure Data Factory and other technologies) to access, combine and transform data from on-prem and cloud-based sources. Ensure that all data more »

Azure. Proficiency in Azure Data Factory, Azure Databricks, Azure SQL Database, and Azure Synapse Analytics. Strong SQL and Python skills. Experience with data modeling, ETL processes, and data warehousing. Knowledge of big data technologies such as Spark and Hadoop is a plus. Excellent problem-solving skills and attention to detail. more »

and data transformation.Strong experience in managing and leading data engineering teams.Strong proficiency in Scala, Python, SQL, Snowflake and DBT.In-depth understanding of data modelling, ETL processes, and data warehousing concepts.Experience with cloud-based data platforms (e.g., AWS, Azure, GCP) and containerisation technologies (e.g., Docker, Kubernetes) is a plus.Excellent problem-solving more »

to work with a team of experts who are passionate about harnessing data to create impactful solutions. Key Responsibilities: Design, develop, and maintain robust ETL (Extract, Transform, Load) processes to ensure efficient data flow and integration across various systems. Utilize Python for data manipulation, transformation, and automation tasks. Collaborate with … a Data Engineer or in a similar role. Strong proficiency in Python and experience with relevant libraries (e.g., pandas, numpy). Extensive experience with ETL tools and processes. Familiarity with data warehousing concepts and technologies (e.g., Redshift, BigQuery, Snowflake). Proficient in SQL and experience with relational databases (e.g., PostgreSQL more »

to their diverse clientele. Position Overview: Theseus is representing our client in their search for a Permanent Data Consultant with expertise in data migration, ETL (Extract, Transform, Load), and advanced SQL skills. In this role, you will play a pivotal part in delivering high-quality solutions and driving business success … Key Responsibilities: Lead and execute end-to-end data migration projects, collaborating closely with clients to understand their unique requirements. Utilise your expertise in ETL processes to design and implement efficient data movement solutions. Harness your advanced SQL skills to optimise database performance and ensure data integrity. Provide technical leadership … Bachelor's degree in Computer Science, Information Technology, or related field. Proven track record in successfully delivering data migration projects, with strong proficiency in ETL techniques. Advanced SQL skills, with the ability to write complex queries and optimise database performance. Familiarity with the Microsoft stack, particularly Dynamics 365 CE, is more »

and communicate how our data inputs and outputs affect different groups and identify areas Janes can provide additional value. Requirements Experience architecting and developing ETL pipelines solutions for the ingestion, transformation, and serving of data, as well as solutions for the orchestration of pipeline components (e.g. AWS Step Functions, Apache more »

working options and a competitive day rate of £250-£400, falling inside IR35 regulations. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes using AWS, Databricks, Python, Spark, and SQL. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data more »

. Knowledge of SQL and experience with relational databases, as well as NoSQL databases Familiarity with cloud services (preferably GCP ) and understanding of its ETL frameworks. Desired : experience with data pipeline and workflow management (Airflow, Composer). Desired : Familiarity with machine learning algorithms and data science principles is a plus. more »

Engineer, develop, and optimize code to ensure business processes support organizational growth. Essential Requirements: Proven track record in designing and building data infrastructure and ETL pipelines. Proficiency in Azure Platform, including Data Lake, Data Factory, Synapse, Logic Apps, and Function Apps etc. SQL Server, including Store Procedures, T-SQL, or more »

deadlines. Develop and uphold the best practice standards, design patterns and documentation for data management and data engineering. Design, build, and manage data pipelines, ETL processes, and data orchestration workflows that transfer data smoothly across different systems and platforms. Create system design for integrating and managing data. Ensure that you more »