10 of 10 Apache Spark Jobs in the North West

will be working on complex data problems in a challenging and fun environment using some of the latest Big Data open-source technologies like Apache Spark as well as Amazon Web Service technologies including Elastic MapReduce Athena and Lambda to develop scalable data solutions. The role is hybrid. … skills positive attitude willing to help other members of the team. Experience debugging and dealing with failures on business-critical systems. Preferable: Exposure to Apache Spark Apache Trino or another big data processing system. Knowledge of streaming data principles and best practices. Understanding of database technologies and more »

Engineers to join our clients team and help us build robust, scalable, and secure data platforms. In this role, you'll work with Databricks, Apache Spark, and Azure technologies to design, develop, and implement data warehouses, lakehouses, and AI/ML models that drive our data-centric initiatives. … What You'll Do Build High-Performance Data Pipelines : Use Databricks and Apache Spark to transform and load data into Azure services. Develop Secure Data Solutions : Create data models, apply quality checks, and implement governance for accuracy and reliability. Integrate AI/ML Models : Build machine learning models … and best practices to continuously innovate. What You'll Need Experience : 3+ years as a Data Engineer or similar. Technical Skills : Expertise in Databricks, Apache Spark, and Azure (Data Lake Storage, Databricks, Azure Data Factory). Programming : Proficient in SQL, Python, or Scala. AI/ML Skills : Familiarity more »

Data Engineer - Manchester Key words: Data Engineer, Python, AWS, Apache Spark, SQL, Big Data My client is a well-established software house in Manchester who are going through a big growth phase and as part of a large recruitment drive are now looking to hire 2 more Data … span DevOps, backend, and cloud development, tackling challenging data problems in a dynamic, collaborative environment. Using state-of-the-art Big Data technologies like Apache Spark and AWS tools such as Elastic MapReduce, Athena, and Lambda, you'll create scalable solutions that make a real impact. What You … during code reviews to maintain high standards across the team. We are looking for a Data Engineer with skills in Python, SQL, AWS and Apache Spark. For further details and to apply please send your CV to jon.brass @ circlerecruitment.com Key words: Data Engineer, Python, Java, Scala, R Programming, SQL more »

what is possible, what is feasible and input into the client's product roadmap. The role involves using Big Data technologies such as AWS, Apache Spark and Amazon Athena as well as this you shall be working in the following tech environment: AWS Python Java Scala SQL Apache more »

On: Data Warehousing ETL (Extract, Transform, Load) Processes Data Modelling and Database Management Data Pipeline Development Data Quality Assurance Big Data Technologies (e.g., Hadoop, Spark) Data Visualization Roles & Responsibilities: Collaborate with experienced data engineering professionals and global team members. Participate in designing and implementing data warehousing solutions. Develop and more »

Technology: AWS serverless, Terraform Python, Spark Location: Manchester (Hybrid) A leading technology provider in the market research industry is seeking a skilled Infrastructure Engineer to join their dynamic Data Engineering team. This is an exciting opportunity for those looking to leverage cutting-edge technology to gain deep insights into … focus on DevOps, backend, and cloud development for the organizations data infrastructure. The role involves tackling complex data challenges using advanced technologies such as Apache Spark and AWS services, including Elastic MapReduce, Athena, and Lambda. Key Responsibilities: Adhere to company policies regarding security, quality, and health & safety. Write more »

ll Need: Proven experience as a Data Engineer, preferably in HealthTech or a similar sector. Proficiency in SQL, Python, and big data tools (e.g., Spark, Hadoop). Hands-on experience with cloud platforms (AWS, Azure). Strong understanding of data modelling and database design principles. Apply now and a more »

Data Infrastructure Engineer Salary: Up to £65,000 Technology: AWS serverless, Terraform Python, Spark Location: Manchester (Hybrid) A leading technology provider in the market research industry is seeking a skilled Infrastructure Engineer to join their dynamic Data Engineering team. This is an exciting opportunity for those looking to leverage … on DevOps, backend, and cloud development for the organization s data infrastructure. The role involves tackling complex data challenges using advanced technologies such as Apache Spark and AWS services, including Elastic MapReduce, Athena, and Lambda. Key Responsibilities: Adhere to company policies regarding security, quality, and health & safety. Write more »

of AWS services with the ability to demonstrate working on large engagements Experience of AWS tools (e.g Athena, Redshift, Glue, EMR) Java, Scala, Python, Spark, SQL Experience of developing enterprise grade ETL/ELT data pipelines. Deep understanding of data manipulation/wrangling techniques Demonstrable knowledge of applying Data … DB/Neo4j/Elastic, Google Cloud Datastore. Snowflake Data Warehouse/Platform Streaming technologies and processing engines, Kinesis, Kafka, Pub/Sub and Spark Streaming. Experience of working with CI/CD technologies, Git, Jenkins, Spinnaker, GCP Cloud Build, Ansible etc Experience building and deploying solutions to Cloud more »

Stable Diffusion for real-world applications. • Build advanced ML solutions for classification, recommendations, and more. • Create scalable AI pipelines using tools like MLflow and Apache Spark. • Collaborate with teams to design AI systems for diverse industries. What You’ll Bring: • 4+ years of AI/ML experience, including Databricks more »