1 to 25 of 44 Remote PySpark Jobs in England

have), Airflow - Detailed understanding of architecture including schedulers, executers, operators, XCom; Understanding DAG execution at scale; Databricks experience including Hive/Unity Catalogue; Optimisation; PySpark; Databricks Connect Log Analytics including Splunk, Elastic search/Logstash/Kibana, Graphana/LOKI/Prometheus SSO experience including Kerberos; Azure AD/ more »

Job Title: Head of Engineering £100,000 - £120,000 Location: Bristol, UK (Hybrid) Company Overview for Head of Engineering My client is a leading Insurtech specialising in cyber reinsurance, providing advanced analytic's and underwriting solutions that redefine how cyber more »

pools. Develop, maintain, and optimize semantic data models using Azure Synapse Analytics/Fabric, Spark notebooks. Ensure data model accuracy, scalability, and performance. Use PySpark within Azure notebooks to extract, transform, and load (ETL/ELT) data from raw formats (e.g. Delta, Parquet, CSV) stored in ADLS Gen2. Implement more »

Azure Data Engineer Associate are desirable * Knowledge of railway industry rolling stock, organisation and players * Data ingestion methods for real-time and batch ingestion * PySpark * Debugging Apache Spark workloads * Experience using BI visualisation tools, such as Power BI Key Skills * Interpersonal skills * Report writing, presentation and record keeping skills more »

A A B grades at A-level You have commercial Data Engineering experience working with technologies such as SQL, Apache Spark and Python including PySpark and Pandas You have a good understanding of modern data engineering best practices Ideally you will also have experience with Azure and Data Bricks more »

as Kafka or other Spark-based technologies. Essential Skills and Experience: Databricks : Advanced expertise in Databricks, including architecture, features, and best practices. Coding: Python, PySpark, Spark, SQL Azure Data Factory (ADF) & SQL : Strong experience in data integration and querying. Infrastructure as Code (IaC) : Proficient in deploying resources via IaC. more »

To be successful in the role you will have Strong ETL experience with tools such as ADF or SSIS Strong experience with Python/PySpark Experience working with Azure technologies - Synapse, Fabric, Data Lake Data visualisation experience with Power BI This is just a brief overview of the role. more »

To be successful in the role you will have Strong ETL experience with tools such as ADF or SSIS Strong experience with Python/PySpark Experience working with Azure technologies - Synapse, Fabric, Data Lake Data visualisation experience with Power BI This is just a brief overview of the role. more »

To be successful in the role you will have Strong ETL experience with tools such as ADF or SSIS Strong experience with Python/PySpark Experience working with Azure technologies - Synapse, Fabric, Data Lake Data visualisation experience with Power BI This is just a brief overview of the role. more »

To be successful in the role you will have Strong ETL experience with tools such as ADF or SSIS Strong experience with Python/PySpark Experience working with Azure technologies - Synapse, Fabric, Data Lake Data visualisation experience with Power BI This is just a brief overview of the role. more »

To be successful in the role you will have Strong ETL experience with tools such as ADF or SSIS Strong experience with Python/PySpark Experience working with Azure technologies - Synapse, Fabric, Data Lake Data visualisation experience with Power BI This is just a brief overview of the role. more »

To be successful in the role you will have Strong ETL experience with tools such as ADF or SSIS Strong experience with Python/PySpark Experience working with Azure technologies - Synapse, Fabric, Data Lake Data visualisation experience with Power BI This is just a brief overview of the role. more »

To be successful in the role you will have Strong ETL experience with tools such as ADF or SSIS Strong experience with Python/PySpark Experience working with Azure technologies - Synapse, Fabric, Data Lake Data visualisation experience with Power BI This is just a brief overview of the role. more »

To be successful in the role you will have Strong ETL experience with tools such as ADF or SSIS Strong experience with Python/PySpark Experience working with Azure technologies - Synapse, Fabric, Data Lake Data visualisation experience with Power BI This is just a brief overview of the role. more »

To be successful in the role you will have Strong ETL experience with tools such as ADF or SSIS Strong experience with Python/PySpark Experience working with Azure technologies - Synapse, Fabric, Data Lake Data visualisation experience with Power BI This is just a brief overview of the role. more »

Data Platform Azure Data Factory SQL Server Analysis Services (SSAS) SQL Server Integration Services (SSIS) SQL Server Reporting Services (SSRS) Data Vault Microsoft Fabric PySpark/Databricks Azure Synapse Azure Data Lake Data migration experience My client have very limited interview slots and they are looking to fill this more »

Working with and modelling data warehouses. Skills & Qualifications Strong technical expertise using SQL Server and Azure Data Factory for ETL Solid experience with Databricks, PySpark etc. Understanding of Agile methodologies including use of Git Experience with Python and Spark Benefits £40,000 - £45,000 This role is an urgent more »

Working with and modelling data warehouses. Skills & Qualifications Strong technical expertise using SQL Server and Azure Data Factory for ETL Solid experience with Databricks, PySpark, ADF etc. Understanding of Agile methodologies, Experience with Python and Spark Benefits £50,000 - £60,000 Company pension Free flu jabs Health & wellbeing programme more »

data modelling Technical Skills Proficient in SQL Server and relational database management Experience with cloud platforms like Azure (Synapse, Data Lake) Programming in Python, PySpark, and T-SQL Additional Skills Familiarity with data analysis tools and workflows Strong communication and collaboration skills Experience in fast-paced, team-oriented environments more »

Profile The successful Lead Data Engineer will be able to demonstrate: A background in building data pipelines and data analysis Skilled with AWS, Python, PySpark, SQL Knowledge of data architecture and database design.. Excellent leadership and communication skills. Job Offer We are based in Stockport and our office is more »

techniques, Data Connection, and Security setup Proficiency in developing data integration pipelines, transformations, pipeline scheduling, Ontology, and applications in Palantir Foundry Excellent skills in PySpark and Spark SQL for data transformations Experience in designing and building interactive data applications and developing parameterized, interactive dashboards in Quiver Desirable skills include more »

continual improvement of their performance. REQUIRED SKILLS AND EXPERIENCE Proficiency in Python, including its associated data and machine learning packages such as numpy, pandas, pyspark, matplotlib, scikit-learn, Keras, TensorFlow, and more. Experience working with object-oriented programming languages. Experience in Forecasting/Pricing & AB testing. Leadership Expertise in more »

Worked with varied data sources (On-Prem databases, Data Lakes, ERP systems) Experience with API Integration Has prior experience with complex data transformation using PYSPARK, SQL and optimisation techniques. Good understanding of Data modelling and Warehousing concepts. Data Documentation experience Basic Machine learning experience Are you interested in this more »

personal development What's in it for you? Up to £90k Bonus scheme Skills and Experience Experience in using modern technologies such as Python, Pyspark, Databricks Experience in using advanced SQL Experience with Cloud computing, preferably Azure Experience in working on loyalty scheme projects If you would like to more »

programme so this role has huge scope for extension. Key skills/responsibilities for this role will be: Azure Datafactory Data bricks Python or Pyspark SQL DAX Data Modelling Jira (project is run in Jira) Azure DevOps - Git Sourcing and mapping data. This role can be offered fully remote more »