14 of 14 Apache Spark Jobs in the North West

will be working on complex data problems in a challenging and fun environment using some of the latest Big Data open-source technologies like Apache Spark as well as Amazon Web Service technologies including Elastic MapReduce Athena and Lambda to develop scalable data solutions. The role is hybrid. … skills positive attitude willing to help other members of the team. Experience debugging and dealing with failures on business-critical systems. Preferable: Exposure to Apache Spark Apache Trino or another big data processing system. Knowledge of streaming data principles and best practices. Understanding of database technologies and more »

Engineers to join our clients team and help us build robust, scalable, and secure data platforms. In this role, you'll work with Databricks, Apache Spark, and Azure technologies to design, develop, and implement data warehouses, lakehouses, and AI/ML models that drive our data-centric initiatives. … What You'll Do Build High-Performance Data Pipelines : Use Databricks and Apache Spark to transform and load data into Azure services. Develop Secure Data Solutions : Create data models, apply quality checks, and implement governance for accuracy and reliability. Integrate AI/ML Models : Build machine learning models … and best practices to continuously innovate. What You'll Need Experience : 3+ years as a Data Engineer or similar. Technical Skills : Expertise in Databricks, Apache Spark, and Azure (Data Lake Storage, Databricks, Azure Data Factory). Programming : Proficient in SQL, Python, or Scala. AI/ML Skills : Familiarity more »

Data Engineer - Manchester Key words: Data Engineer, Python, AWS, Apache Spark, SQL, Big Data My client is a well-established software house in Manchester who are going through a big growth phase and as part of a large recruitment drive are now looking to hire 2 more Data … span DevOps, backend, and cloud development, tackling challenging data problems in a dynamic, collaborative environment. Using state-of-the-art Big Data technologies like Apache Spark and AWS tools such as Elastic MapReduce, Athena, and Lambda, you'll create scalable solutions that make a real impact. What You … during code reviews to maintain high standards across the team. We are looking for a Data Engineer with skills in Python, SQL, AWS and Apache Spark. For further details and to apply please send your CV to jon.brass @ circlerecruitment.com Key words: Data Engineer, Python, Java, Scala, R Programming, SQL more »

deliver data solutions that align with business objectives and enhance analytics capabilities. Performance Optimization: Optimize Databricks workflows for performance, scalability, and cost efficiency, including Spark tuning and cluster management . Cloud Integration: Build cloud-native data engineering solutions on leading cloud platforms like Azure, AWS, or GCP to ensure … in Databricks . Proven ability to deliver large-scale data pipelines in consulting or enterprise environments. Technical Expertise: Proficiency in Databricks, Delta Lake , and Apache Spark . Strong programming skills in Python and SQL , with optional experience in Scala . Experience with cloud platforms such as Azure (preferred more »

Understanding of cloud computing security concepts Experience in relational cloud-based database technologies like Snowflake, BigQuery or Redshift Experience in open-source technologies like Spark, Kafka, Beam understanding of Cloud tools such as AWS, Microsoft Azure or Google Cloud Familiarity with DBT, Delta Lake, Databricks Experience working in an more »

understanding of database concepts, SQL, data modeling, and data integration techniques. ~ Proficiency in programming languages such as Python ~ Experience with data processing frameworks like Apache Spark ~ AWS, Azure, or Google Cloud) ~ Please either apply by clicking online or emailing me directly chelsea. more »

understanding of database concepts, SQL, data modeling, and data integration techniques. Proficiency in programming languages such as Python Experience with data processing frameworks like Apache Spark Familiarity with cloud platforms and services (e.g., AWS, Azure, or Google Cloud) Experience with Azure Databricks TO BE CONSIDERED… Please either apply more »

Data Infrastructure Engineer Technology: AWS serverless, Terraform Python, Spark Manchester (Hybrid) A leading technology provider in the market research industry is seeking a skilled Infrastructure Engineer to join their dynamic Data Engineering team. This is an exciting opportunity for those looking to leverage cutting-edge technology to gain deep … on DevOps, backend, and cloud development for the organization’s data infrastructure. The role involves tackling complex data challenges using advanced technologies such as Apache Spark and AWS services, including Elastic MapReduce, Athena, and Lambda. Adhere to company policies regarding security, quality, and health & safety. Develop infrastructure automation more »

Technology: AWS serverless, Terraform Python, Spark Location: Manchester (Hybrid) A leading technology provider in the market research industry is seeking a skilled Infrastructure Engineer to join their dynamic Data Engineering team. This is an exciting opportunity for those looking to leverage cutting-edge technology to gain deep insights into … focus on DevOps, backend, and cloud development for the organizations data infrastructure. The role involves tackling complex data challenges using advanced technologies such as Apache Spark and AWS services, including Elastic MapReduce, Athena, and Lambda. Key Responsibilities: Adhere to company policies regarding security, quality, and health & safety. Write more »

ll Need: Proven experience as a Data Engineer, preferably in HealthTech or a similar sector. Proficiency in SQL, Python, and big data tools (e.g., Spark, Hadoop). Hands-on experience with cloud platforms (AWS, Azure). Strong understanding of data modelling and database design principles. Apply now and a more »

Data Infrastructure Engineer Salary: Up to £65,000 Technology: AWS serverless, Terraform Python, Spark Location: Manchester (Hybrid) A leading technology provider in the market research industry is seeking a skilled Infrastructure Engineer to join their dynamic Data Engineering team. This is an exciting opportunity for those looking to leverage … on DevOps, backend, and cloud development for the organization’s data infrastructure. The role involves tackling complex data challenges using advanced technologies such as Apache Spark and AWS services, including Elastic MapReduce, Athena, and Lambda. Key Responsibilities: Adhere to company policies regarding security, quality, and health & safety. Write more »

Data Infrastructure Engineer Salary: Up to £65,000 Technology: AWS serverless, Terraform Python, Spark Location: Manchester (Hybrid) A leading technology provider in the market research industry is seeking a skilled Infrastructure Engineer to join their dynamic Data Engineering team. This is an exciting opportunity for those looking to leverage … on DevOps, backend, and cloud development for the organization s data infrastructure. The role involves tackling complex data challenges using advanced technologies such as Apache Spark and AWS services, including Elastic MapReduce, Athena, and Lambda. Key Responsibilities: Adhere to company policies regarding security, quality, and health & safety. Write more »

of AWS services with the ability to demonstrate working on large engagements Experience of AWS tools (e.g Athena, Redshift, Glue, EMR) Java, Scala, Python, Spark, SQL Experience of developing enterprise grade ETL/ELT data pipelines. Deep understanding of data manipulation/wrangling techniques Demonstrable knowledge of applying Data … DB/Neo4j/Elastic, Google Cloud Datastore. Snowflake Data Warehouse/Platform Streaming technologies and processing engines, Kinesis, Kafka, Pub/Sub and Spark Streaming. Experience of working with CI/CD technologies, Git, Jenkins, Spinnaker, GCP Cloud Build, Ansible etc Experience building and deploying solutions to Cloud more »

Stable Diffusion for real-world applications. • Build advanced ML solutions for classification, recommendations, and more. • Create scalable AI pipelines using tools like MLflow and Apache Spark. • Collaborate with teams to design AI systems for diverse industries. What You’ll Bring: • 4+ years of AI/ML experience, including Databricks more »