1 to 25 of 93 Scala Jobs in England

cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout the data lifecycle. Azure ...

larger initiatives What You'll Bring Technical Expertise: Strong SQL—comfortable with complex transformations, performance tuning and warehouse-specific dialect Strong Python skills (or Scala/Java where relevant) for pipeline development and tooling Hands-on experience with dbt or equivalent transformation tooling Orchestration experience (Airflow, Dagster, Prefect or equivalent ...

Amazon Athena, Amazon DynamoDB, Amazon Cloudwatch, Amazon SNS and AWS Step Functions. Programming Skills: Strong experience with modern programming languages such as Python, Java, Scala & Pyspark. Expertise in Data Storage Technologies: In-depth knowledge of Data Warehouse, Database technologies, and Big Data Eco-system technologies such as AWS Redshift ...

Kubernetes) as well as ETL frameworks (Apache Spark, Airflow, AWS IoT Analytics/Device Management/Events). (Preferred) Programming expertise in Python, Java, Scala, SQL, Spark, Unix shell scripting, and AWS CLI. (Preferred) Great background in building and managing AWS platforms for analytics and data lake workloads, including application ...

technology stack is flexible, but experience in some of the following are nice to have: Data Engineering & Programming: • Python • SQL • Spark/PySpark • Scala • Data modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake and data warehouse architectures ...

software development lifecycle (SDLC). Hands-on experience with big data frameworks such as Spark, Hadoop, or Hive, including derivatives like PySpark (preferred), Spark Scala, or Spark SQL, along with familiarity with development-accelerating libraries and frameworks. Experience using data modelling tools such as ERwin, ER/Studio, PowerDesigner ...

Advanced proficiency in SQL, including optimisation and performance tuning Strong experience with ETL/ELT pipelines and data transformation frameworks Programming capability in Python, Scala or Java for data processing Deep understanding of data warehousing concepts and best practices Experience designing and maintaining reliable, production-grade data pipelines Ability ...

s.Strong proficiency in SQL for data manipulation, querying, and optimizatio n.Expertise in at least one programming language commonly used in data engineering, preferably Python. Scala or Java is a plu s.Solid understanding of data warehousing concepts, data modeling techniques (dimensional modeling, Kimball, Inmon), and ETL/ELT processe s.Experience with ...

Strong understanding of ethical data usage in regulated environments CRITICAL COMPETENCIES – TECHNICAL FIT Essential: Strong SQL skills Programming experience with Python and/or Scala Hands-on experience with Azure-based data platforms Experience designing, building, and maintaining data pipelines Strong understanding of data modelling (relational and analytical), including medallion ...

product roadmap. What we look for: 6+ years experience in data engineering, data platforms & analytics, or software engineering Comfortable writing code in either Python, Scala, JavaScript/TypeScript, and modern frameworks Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one Deep ...

resolve complex issues related to Databricks infrastructure. Essential Skills & Experience: Proven experience working with Databricks in a similar role. Strong knowledge of Spark, Scala, Python, and SQL. Experience with cloud platforms such as AWS or Azure. Ability to work collaboratively in a fast-paced environment. Excellent problem-solving and communication ...

experience in Data Engineering - Experience building modern data pipelines and distributed data platforms - Knowledge of AWS, Azure or GCP - Experience with Python, Java or Scala - Exposure to technologies such as Spark, Kafka, Airflow, dbt or Hadoop - Strong analytical and problem-solving skills - Excellent communication and stakeholder management - An entrepreneurial mindset ...

Kimball Methodology, Master Data Services, Data Quality (DQ), Purview * Azure Data Lake, Azure Data Factory, Logic Apps, Azure Databricks, Azure Functions, Azure Synapse * Python, Scala, PySpark * SharePoint, PowerPivot, Power BI, Data integration layers, Database and storage models, Delta loading, External data loads Desirable Experience * PowerShell scripting, Agile delivery environments ...

Kimball Methodology, Master Data Services, Data Quality (DQ), Purview * Azure Data Lake, Azure Data Factory, Logic Apps, Azure Databricks, Azure Functions, Azure Synapse * Python, Scala, PySpark * SharePoint, PowerPivot, Power BI, Data integration layers, Database and storage models, Delta loading, External data loads Desirable Experience * PowerShell scripting, Agile delivery environments ...

Engineer, Software Architect, or similar senior technical role. Strong server-side software engineering experience, with flexibility across programming languages such as Python, Java, Go, Scala, C#, or similar. Experience designing and building distributed data services or large-scale backend platforms. Experience with Apache Spark, Apache DataFusion, Trino, Presto, or similar ...

with Cloud Experience with High Performance Compute (HPC) Preferred Qualifications: Knowledge and use of at least one common programming language: e.g., Python, Go, C++, Scala, Java, including toolchains for documentation, testing, and operations/observability Expertise in modern software development tools/ways of working (e.g. git/GitHub, devops ...

including hands‐off expertise with sophisticated proofs‐of‐concept and public cloud platform(s). Coding expertise in a core programming language (Python, Java, Scala). Foundational understanding of Apache Spark architecture is preferable; hands‐on skills will be advantageous. Key Notes for the role: Location for the role needs ...

Glue, Athena) Experience with real-time and batch data processing - Apache Flink, Kafka, Spark, or similar Proficiency in one or more of: Python, Java, Scala Experience with data modelling , ETL processes, and distributed systems Comfortable working in agile and DevOps environments Experience in sensitive or regulated data environments is highly ...

hands‐on expertise with sophisticated proofs‐of‐concept and public cloud platform(s). Coding expertise in a core programming language (i.e., Python, Java, Scala). A foundational understanding of Apache Spark architecture is preferable; hands‐on skills will be advantageous for the role. We will be testing your ability ...

Primary skills Data Engineering & Pipeline Development (ETL/ELT design and implementation) Strong SQL & Data Modeling (query optimization, schema design) Programming Skills (Python/Scala for data processing) Big Data Processing (Spark/Databricks) Cloud Data Platforms (Azure/AWS/GCP - especially data services) Secondary skills API-based Data ...

years Mandatory Required Skills Hands-on experience with Quantexa platform/Decision Intelligence Strong in Apache Spark/PySpark Proficiency in Python/Scala Experience in ETL, Data Engineering, Data Warehousing Knowledge of entity resolution, graph analytics, link analysis Experience working with large datasets (Big Data ecosystem – Hive/HDFS ...

Bring Technical Expertise: Strong proficiency in one or more of: Python, Java, Kotlin, Go, C#/.NET, TypeScript/Node, Ruby, PHP, Scala, Rust Hands-on experience with modern frameworks (Spring, .NET, Django, FastAPI, Rails, Express/NestJS, Laravel, React, Vue, Next.js, Angular or equivalent) Solid grounding in REST ...

Primary skills Data Engineering & Pipeline Development (ETL/ELT design and implementation) Strong SQL & Data Modeling (query optimization, schema design) Programming Skills (Python/Scala for data processing) Big Data Processing (Spark/Databricks) Cloud Data Platforms (Azure/AWS/GCP - especially data services) ZIPC1_UKTJ ...

Primary skills Data Engineering & Pipeline Development (ETL/ELT design and implementation) Strong SQL & Data Modeling (query optimization, schema design) Programming Skills (Python/Scala for data processing) Big Data Processing (Spark/Databricks) Cloud Data Platforms (Azure/AWS/GCP - especially data services ...

Primary skills Data Engineering & Pipeline Development (ETL/ELT design and implementation) Strong SQL & Data Modeling (query optimization, schema design) Programming Skills (Python/Scala for data processing) Big Data Processing (Spark/Databricks) Cloud Data Platforms (Azure/AWS/GCP - especially data services) Secondary s click apply ...