26 to 50 of 7,576 Python Jobs in England

query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse Build scalable data processing solutions using PySpark, Python and cloud-native orchestration services Implement data quality checks, validation processes, monitoring and logging to ensure trusted and reliable data delivery Support the performance tuning … Data Factory, Synapse Pipelines, Azure Functions and Logic Apps PySpark SQL (Athena, Redshift, Azure Synapse SQL) AWS S3 or Azure Data Lake Storage Gen2 Python and/or Java ETL/ELT data pipeline development Data quality, validation and monitoring Git, CI/CD and Agile delivery practices Experience being ...

Logic Apps Azure Stream Analytics Azure Resource Manager skills (Terraform, Azure Portal, Az CLI and Az PowerShell) Strong PySpark, Delta Lake, Unity Catalog and Python skills. Includes ability to write unit and integration tests in Python with unittest, pytest, etc. Strong understanding of software development practices, such as SOLID principals ...

experience with GCP data services such as BigQuery, Dataflow, Dataproc, Cloud Composer (Airflow), Pub/Sub, Cloud Storage, Bigtable, and Cloud SQL. Proficiency in Python and SQL, with experience in Spark or Apache Beam. Experience designing data warehouse and data lake architectures, including data modeling. Working experience with Terraform ...

Selection Criteria Expertise in designing and building data intensive applications and pipelines, with an open mindset on choice of tools Strong proficiency in Python and SQL, with a focus on writing clean, performant code to process and manage large volumes of data Experience designing and implementing complex data-matching, reconciliation ...

Selection Criteria Expertise in designing and building data intensive applications and pipelines, with an open mindset on choice of tools Strong proficiency in Python and SQL, with a focus on writing clean, performant code to process and manage large volumes of data Experience designing and implementing complex data-matching, reconciliation ...

Code (IaC) using Terraform and/or Bicep with good understanding of Azure Resource Manager. Experience with scripting and automation using languages such as Python, Bash, or PowerShell. Solid understanding of CI/CD principles and experience with tools like Jenkins, Github Actions, GitLab CI, or Azure DevOps (ADO). ...

reporting. Including storage, data pipelines to ingest and transform data, and querying & reporting of analytical data. You've worked with technologies such as Python, Spark, SQL, Pyspark, PowerBI etc. You’re a problem-solver, pragmatically exploring options and finding effective solutions. An understanding of how to design and build well ...

have some of the skills and experience listed below, don’t let that stop you from applying! Engineering and Data Engineering Hands-on Python experience Knowledge of cloud infrastructure like AWS, GCP or Azure Have used version control systems, specifically Git or similar tools Understanding of TDD and diverse testing ...

have some of the skills and experience listed below, don’t let that stop you from applying! Engineering and Data Engineering Hands-on Python experience Knowledge of cloud infrastructure like AWS, GCP or Azure Have used version control systems, specifically Git or similar tools Understanding of TDD and diverse testing ...

level and we are looking for data engineers who have a variety of different skills which include some of the below. Strong proficiency in Python Extensive experience with cloud platforms (AWS, GCP, or Azure) Experience with: Data warehousing and lake architectures ETL/ELT pipeline development SQL and NoSQL databases ...

with a clear, well-formed view of what 'good' continuous delivery looks like and how to drive it across teams. Strong scripting ability in Python and/or Bash. Solid networking fundamentals — TCP/IP, DNS, HTTP, TLS. Experience with relational and non-relational databases (e.g. SQL Server, MySQL, DynamoDB ...

Introduction At IBM Consulting UK FutureNow, you’ll build a career at the forefront of hybrid cloud and AI, working with leading clients across the public and private sectors. You’ll collaborate with top industry ...

consultative approach, youre comfortable engaging with clients, understanding their needs, and translating them into effective outcomes. The Role: We are seeking an experienced Python Developer with significant data engineering experience to join a high-performing engineering team working on secure, data-intensive systems. The successful candidate will have a strong … background in Python software development, data engineering and data processing, with experience designing, building and maintaining robust data pipelines and services within complex technical environments. Requirements Key Responsibilities: Design, develop and maintain high-quality Python applications, services and data processing solutions. Build and optimise scalable ETL/ELT pipelines ...

consultative approach, you’re comfortable engaging with clients, understanding their needs, and translating them into effective outcomes. The Role: We are seeking an experienced Python Developer with significant data engineering experience to join a high-performing engineering team working on secure, data-intensive systems. The successful candidate will have … strong background in Python software development, data engineering and data processing, with experience designing, building and maintaining robust data pipelines and services within complex technical environments. Key Responsibilities: Design, develop and maintain high-quality Python applications, services and data processing solutions. Build and optimise scalable ETL/ELT pipelines ...

contribute to engineering excellence through best practices, mentoring, and thoughtful technical direction. Job responsibilities Design scalable, reusable data processing and data quality frameworks using Python, PySpark, and dbt Build and optimize batch and streaming data pipelines with strong performance, fault tolerance, and observability Develop and operate workflow orchestration (e.g., Apache … data movement and transformations Model and transform data for analytics using SQL and dbt to support business intelligence and reporting workloads Write production-grade Python/PySpark code with disciplined testing, performance tuning, and maintainable object-oriented design Implement infrastructure-as-code (e.g., Terraform) to provision and manage cloud-based ...

contribute to engineering excellence through best practices, mentoring, and thoughtful technical direction. Job responsibilities Design scalable, reusable data processing and data quality frameworks using Python, PySpark, and dbt Build and optimize batch and streaming data pipelines with strong performance, fault tolerance, and observability Develop and operate workflow orchestration (e.g., Apache … data movement and transformations Model and transform data for analytics using SQL and dbt to support business intelligence and reporting workloads Write production-grade Python/PySpark code with disciplined testing, performance tuning, and maintainable object-oriented design Implement infrastructure-as-code (e.g., Terraform) to provision and manage cloud-based ...

contribute to engineering excellence through best practices, mentoring, and thoughtful technical direction. Job responsibilities Design scalable, reusable data processing and data quality frameworks using Python, PySpark, and dbt Build and optimize batch and streaming data pipelines with strong performance, fault tolerance, and observability Develop and operate workflow orchestration (e.g., Apache … data movement and transformations Model and transform data for analytics using SQL and dbt to support business intelligence and reporting workloads Write production-grade Python/PySpark code with disciplined testing, performance tuning, and maintainable object-oriented design Implement infrastructure-as-code (e.g., Terraform) to provision and manage cloud-based ...

query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse Build scalable data processing solutions using PySpark, Python and cloud-native orchestration services Implement data quality checks, validation processes, monitoring and logging to ensure trusted and reliable data delivery Support the performance tuning … Data Factory, Synapse Pipelines, Azure Functions and Logic Apps PySpark SQL (Athena, Redshift, Azure Synapse SQL) AWS S3 or Azure Data Lake Storage Gen2 Python and/or Java ETL/ELT data pipeline development Data quality, validation and monitoring Git, CI/CD and Agile delivery practices Current active ...

using modern cloud-native data engineering technologies. Provide technical direction across data modelling, ingestion, transformation, orchestration and integration. Apply practical experience of Spark, PySpark, Python and SQL within enterprise data environments. Governance, Security & Quality Embed effective data governance, security, quality and access controls within cloud data environments. Ensure architecture decisions … another cloud data platform. Strong understanding of modern data architecture patterns, data modelling and ETL/ELT approaches. Practical experience with Spark, PySpark, Python and SQL and the design of scalable batch and real-time data pipelines. Experience designing appropriate data governance, security and data quality controls. Experience with modern ...

teams. Design, build, test and deploy scalable batch and near-real-time data pipelines, reusable data products and analytics solutions on Snowflake using SQL, Python, Snowpark, Snowpipe, Streams, Tasks and Dynamic Tables. Deliver across the full data engineering lifecycle, from requirements analysis and solution design through development, testing, deployment, operational … skills. Technical proficiency Experience developing or supporting cloud data warehouses using Snowflake and at least one of AWS, Azure or GCP. Proficiency in SQL, Python, data stack frameworks, integration libraries and orchestration tools, including Snowpark, Snowpipe, Streams, Tasks and Dynamic Tables. Knowledge of Snowflake architecture, stages, file formats, virtual warehouse ...

OpenAI, AWS Bedrock) Experience building scalable data products and analytics solutions Expert Power BI development, including semantic models and Power BI Service administration Expert Python development for data, analytics and automation Experience integrating REST APIs and multiple data sources Knowledge of traditional machine learning techniques, including tree-based models (e.g. ...

closely related field. Proven experience designing and building scalable data pipelines (ETL/ELT) for batch and streaming use cases using modern technologies (e.g., Python, SQL, Spark, Flink, Airflow) and advanced knowledge on the workings of these. Hands-on experience in building and operating workloads Databricks. Hands-on experience creating ...

reporting. Including storage, data pipelines to ingest and transform data, and querying & reporting of analytical data. You've worked with technologies such as Python, Spark, SQL, Pyspark, PowerBI etc. You’ve got a background in software engineering, including Front End technologies like JavaScript. You’re a problem-solver, pragmatically exploring ...

Databricks and/or Snowflake, including the design, implementation, and optimization of data platforms at scale Strong SQL expertise and software engineering experience using Python and/or other modern programming languages. Experience developing and orchestrating data pipelines using technologies such as DBT, Apache Spark, Airflow, Dagster, Kafka, Flink ...

engineering (or 3+ years with strong Foundry depth). Proven, hands-on experience working with Palantir Foundry in a production environment. Strong proficiency in Python, SQL, PySpark and Spark SQL Experience delivering production pipelines in AWS, Azure, or GCP environments. Solid understanding of data modeling, schema design, metadata management ...