1 to 25 of 29 ETL Jobs in Glasgow

data warehouses, and data marts using Azure Data Services Integrate data from various sources including APIs, structured/unstructured files, IoT devices, and real-time streams Develop and optimize ETL/ELT workflows using tools such as Azure Data Factory, Databricks, and Apache Spark Implement real-time data ingestion and processing using Azure Stream Analytics, Event Hubs, or Kafka Ensure … Azure Synapse Analytics for pipeline orchestration and data handling Expertise in SQL, data warehousing, data marts, and ingestion using PySpark and Python Solid experience building and maintaining cloud-based ETL/ELT pipelines, especially with Azure Data Factory or Synapse Familiarity with cloud data environments such as Azure and optionally AWS Experience with Azure DevOps for CI/CD and More ❯

into technical solutions that ensure scalability, robust data governance and optimal performance. Developing innovative solutions: Create PoCs and MVPs for Data & AI solutions focusing on pipeline automation, ELT/ETL processes, and deployment through enterprise data platforms. Crafting compelling user experiences: Blend user-centred design with storytelling to deliver impactful Gen AI/BI, WebApp and data product interfaces, leveraging More ❯

as Power BI or similar; exposure to Python, C# and\or Angular; Microsoft Power Automate; Modelling and data science practices Familiarity with optimising strategies, pipeline architectures, data sets and ETL/ELT processes. Understanding and experience of provisioning APIs for data consumption. A more detailed list of our requirements for this position is available within the role profile – which is More ❯

Job Description We are looking for a skilled ETL Developer with hands-on experience in Talend, Python, and Spark, to join data engineering team. The ideal candidate will be responsible for designing, building, and maintaining ETL pipelines that support data extraction, transformation, and loading from various sources into target systems. Key Responsibilities: · Design, build, and maintain ETL workflows using the … Talend ETL toolset. · Develop ETL solutions for extracting and transforming data from various sources such as Cloudera, PostgreSQL, and SQL Server. · Create and manage database schemas, tables, and constraints based on business requirements. · Collaborate with cross-functional teams to understand source systems and ensure accurate data mapping and transformation. · Write transformation logic using ETL tools or scripting languages like SQL … clean, validated, and aligned with target schema and data quality standards. · Contribute to data quality improvement initiatives and proactively resolve data inconsistencies. · Participate in troubleshooting and performance tuning of ETL jobs and workflows. Required Skills & Qualifications: · Proven experience with Talend, Python, and Apache Spark. · Strong understanding of relational databases and Big Data ecosystems (Hive, Impala, HDFS). · Solid experience in More ❯

Fabric Analytics Engineer Associate Responsibilities: On a daily basis your varied role will include, but will not be limited to: Design, build, and optimize high-performance data pipelines and ETL workflows using tools like Azure Synapse, Azure Databricks or Microsoft Fabric. Implement scalable solutions to ingest, store, and transform vast datasets, ensuring data availability and quality across the organization. Write More ❯

etc.) Ability to tackle design and functionality problems independently with little to no oversight Experience performing data analytics on AWS platforms Experience in writing efficient SQL's, implementing complex ETL transformations on big data platform. Experience in a Big Data technologies (Spark, Impala, Hive, Redshift, Kafka, etc.) Experience in data quality testing; adept at writing test cases and scripts, presenting More ❯

in this role. The ideal candidate will demonstrate most or all of the following: Strong technical expertise in AWS – Proven experience in designing and implementing cloud-based data architectures, ETL pipelines, and cloud-native applications, using services such as AWS EC2, S3, Lambda, Glue, Redshift, RDS, IAM, and KMS. Leadership & Stakeholder Management – Ability to engage with C-level executives (CDOs More ❯

determine appropriate tools and data patterns to perform analysis. Hands-on experience in building and maintaining Big Data systems. Hands-on experience with cloud computing, particularly AWS. Experience with ETL and processing real-time data. Preferred qualifications, capabilities, and skills: Hands-on experience of Databricks. AWS Data Platform Experience. Team player, comfortable working in a fast-paced environment. Excellent problem More ❯

determine appropriate tools and data patterns to perform analysis. Hands-on experience in building and maintaining Big Data systems. Hands-on experience with cloud computing, particularly AWS. Experience with ETL and processing real-time data. Preferred qualifications, capabilities, and skills: Hands-on experience of Databricks. AWS Data Platform Experience. Team player, comfortable working in a fast-paced environment. Excellent problem More ❯

be highly proficient with modern Python programming paradigms and tooling. Proficiency in data-centric programming and scripting languages (e.g., Python , SQL , Bash ). Proven experience designing and maintaining scalable ETL/ELT pipelines. Focused, sharp, and results-oriented : You are decisive, work with a high degree of autonomy, and consistently deliver high-quality results. You are quick to understand and More ❯

that foster fun and relationship building across our global community. The Role We are looking for a Senior Software Developers to contribute to development of the company’s proprietary ETL (Extract/Transform/Load) tool. In this role, you will be a member of an Agile development team that designs and implements a web user interface for engineers to More ❯

Clear communication with both technical and non-technical stakeholders is essential. End-to-end solution Architecture experience with information systems and order architecture. Data - Data Architecture, Data Warehousing & Lakes, ETL/ELT Pipelines, Customer Data Platforms (CDPs), Data Governance & Compliance, or, Analytics & BI. Integration - API Design & Management, Middleware & ESB, Event-Driven Architecture, BSS/OSS Integration, Partner Ecosystem Integration, CI More ❯

reviews Adds to team culture of diversity, equity, inclusion, and respect Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and applied experience with SQL, ETL, PL/SQL programming. Working knowledge of big data technologies and concepts. Hands-on practical experience in system design, application development, testing, and operational stability. Working knowledge of Unix and More ❯

all aspects of the Software Development Life Cycle, agile methodologies such as CI/CD, Application Resiliency, and Security Cloud implementation experience with AWS including: AWS Data Services: Glue ETL (or) EMR, S3, Glue Catalog, Athena, Lambda + Step Functions + Event Bridge, ECS Data De/Serialization: Parquet and JSON format AWS Data Security: Good Understanding of security concepts More ❯

on software engineering concepts and proficient applied experience. Hands-on practical experience in system design, application development, testing, and operational stability. Experience in Java, Spring Boot, Spring Data, JDBC, ETL, OpenAPI Doc, WSDL, JUnit, Kubernetes, Splunk, Dynatrace. Advanced in building REST API with Java, Oracle. Experience in developing UI applications using React. Experience in developing, debugging, and maintaining code in More ❯

management and admin teams. C9 Display role model behaviours with the ability to inspire and motivate operational colleagues to deliver service excellence. Desirable: D1 Expertise in designing and managing Extract, Transform, Load (ETL) workflows for data migration and warehousing. D2 Data integration and analysis skills. Experience Essential: E1 Practical experience in providing technical data management and leadership for one or More ❯

management and admin teams. C9 Display role model behaviours with the ability to inspire and motivate operational colleagues to deliver service excellence. Desirable: D1 Expertise in designing and managing Extract, Transform, Load (ETL) workflows for data migration and warehousing. D2 Data integration and analysis skills. Experience Essential: E1 Practical experience in providing technical data management and leadership for one or More ❯

all aspects of the Software Development Life Cycle, agile methodologies such as CI/CD, Application Resiliency, and Security Cloud implementation experience with AWS including: AWS Data Services: Glue ETL (or) EMR, S3, Glue Catalog, Athena, Lambda + Step Functions + Event Bridge, ECS Data De/Serialization: Parquet and JSON format AWS Data Security: Good Understanding of security concepts More ❯

Python concepts and expanding applied experience Hands-on practical experience in system design, application development, testing, and operational stability Cloud implementation experience with AWS including: AWS Data Services: Glue ETL (or) EMR, S3, Glue Catalog, Athena, Lambda + Step Functions + Event Bridge, ECS Data De/Serialization: Parquet and JSON format AWS Data Security: Good Understanding of security concepts More ❯

finance insight, drive data strategy and lead key projects within the Finance BI function, for a 6 month engagement. This is a hands-on role combining strong SQL and ETL expertise with the ability to shape architecture, influence stakeholders, and deliver impactful, data-driven solutions. Reporting into the Head of BI, the successful candidate will work closely with finance teams … members and championing best practice, this role bridges the gap between technical delivery and strategic business insight. Candidates will need proven experience in SQL development, a strong understanding of ETL and data warehousing and the confidence to lead projects in a fast-paced environment. Excellent communication skills, a collaborative mindset, and a passion for continuous improvement are essential. Experience with More ❯

ML frameworks. Extensive experience with AWS services (e.g., SageMaker, ECS, Lambda) and cloud environments. Proficiency with containerisation and orchestration tools (Docker, Kubernetes). Knowledge of data engineering concepts (e.g., ETL, data pipelines). Please note that this role is hybrid, based out of Dundee, Scotland. Flexible arrangements are on offer, but we can only consider candidates able to commit to More ❯

processes within a related technical discipline (. data ingestion, data storage, data serving, APIs, . Hands-on experience in data lake or data warehouse and related technologies (. Spark, ETL, Databricks). Hands-on practical experience delivering system design, application development, testing, and operational stability Ability to tackle design and functionality problems independently with little to no oversight Experience in More ❯

enhance data security and compliance. What You Will Bring: Extensive experience in database design, management, and optimization. Proficiency in advanced SQL and query optimization techniques. Hands-on experience with ETL processes and monitoring tools. Knowledge of both relational and non-relational database systems. Expertise in cloud-based database solutions and services, particularly Azure. Experience working as part of a multidisciplinary More ❯

CI/CD, Application Resiliency, and Security In-depth knowledge of the financial services industry and their IT systems Cloud implementation experience with AWS including: AWS Data Services: Glue ETL (or) EMR, S3, Glue Catalog, Athena, Lambda + Step Functions + Event Bridge, ECS Data De/Serialization: Parquet and JSON format AWS Data Security: Good Understanding of security concepts More ❯

heart of it. From day one, you'll be working across the full BI pipeline to rebuild reporting architecture using SQL, SSRS, SSIS , and Power BI , design brand new ETL pipelines, and deliver meaningful business critical insights. It's a rare opportunity to help shape a modern data landscape from the ground up , not just maintain what's already there. … across the business, giving you plenty of autonomy and responsibility . You'll ideally have strong commercial experience with the following; SQL Power BI SSRS and SSIS Experience building ETL pipelines The salary for this role is between £35k to £45k (DOE) including a range of company benefits. They support hybrid working at their Glasgow city centre office, (where you More ❯