1 to 25 of 178 Permanent Scala Jobs in England

cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout the data lifecycle. Azure ...

cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout the data lifecycle. Azure ...

similar Experience building, defining, and owning data models, data lakes, and data warehouses Programming proficiency in the likes of Python, Pyspark, SQL, Scala or Java. Experience operating in a cloud-native environment such as Azure, AWS, GCP etc ( Fabric experience would be beneficial but is not essential). Excellent stakeholder ...

automated pipeline development. • Hands-on experience with ETL/ELT processes, data governance, and cloud-based data platforms. • Proficiency in SQL, Python, or Scala for data processing and automation. • Familiarity with data architecture, warehousing, and business intelligence tools. Desirable • Experience with Azure Data Services, AWS, or GCP. • Knowledge ...

work scheme And More.. DATA ENGINEER – ESSTENTIAL SKILLS Proven experience building data pipelines using Databricks . Strong understanding of Apache Spark (PySpark or Scala) and Structured Streaming . Experience working with Kafka (MSK) and handling real-time data . Good knowledge of Delta Lake/Delta Live Tables ...

across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/ ...

across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/ ...

complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines and DevOps practices in Azure. Familiarity with data governance frameworks. Why Apply? Work on a flagship transportation project ...

complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines and DevOps practices in Azure. Familiarity with data governance frameworks. Why Apply? Work on a flagship transportation project ...

complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines and DevOps practices in Azure. Familiarity with data governance frameworks. Why Apply? Work on a flagship transportation project ...

complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines and DevOps practices in Azure. Familiarity with data governance frameworks. Why Apply? Work on a flagship transportation project ...

complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines and DevOps practices in Azure. Familiarity with data governance frameworks. Why Apply? Work on a flagship transportation project ...

complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines and DevOps practices in Azure. Familiarity with data governance frameworks. Why Apply? Work on a flagship transportation project ...

complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines and DevOps practices in Azure. Familiarity with data governance frameworks. Why Apply? Work on a flagship transportation project ...

complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines and DevOps practices in Azure. Familiarity with data governance frameworks. Why Apply? Work on a flagship transportation project ...

complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines and DevOps practices in Azure. Familiarity with data governance frameworks. Why Apply? Work on a flagship transportation project ...

complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines and DevOps practices in Azure. Familiarity with data governance frameworks. Why Apply? Work on a flagship transportation project ...

complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines and DevOps practices in Azure. Familiarity with data governance frameworks. Why Apply? Work on a flagship transportation project ...

complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines and DevOps practices in Azure. Familiarity with data governance frameworks. Why Apply? Work on a flagship transportation project ...

complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines and DevOps practices in Azure. Familiarity with data governance frameworks. Why Apply? Work on a flagship transportation project ...

complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines and DevOps practices in Azure. Familiarity with data governance frameworks. Why Apply? Work on a flagship transportation project ...

complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines and DevOps practices in Azure. Familiarity with data governance frameworks. Why Apply? Work on a flagship transportation project ...

complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines and DevOps practices in Azure. Familiarity with data governance frameworks. Why Apply? Work on a flagship transportation project ...

complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines and DevOps practices in Azure. Familiarity with data governance frameworks. Why Apply? Work on a flagship transportation project ...

complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines and DevOps practices in Azure. Familiarity with data governance frameworks. Why Apply? Work on a flagship transportation project ...