7 of 7 Apache Spark Jobs in Yorkshire

with strong Foundry depth). Proven, hands-on experience working with Palantir Foundry in a production environment. Strong proficiency in Python, SQL, PySpark and Spark SQL Experience delivering production pipelines in AWS, Azure, or GCP environments. Solid understanding of data modeling, schema design, metadata management, and governance. Familiarity with ...

strong hands-on Palantir Foundry experience. Proven experience working with Palantir Foundry in a production environment . Strong proficiency in Python, SQL, PySpark, and Spark SQL . Experience delivering production-grade data pipelines in AWS, Azure, or GCP . Strong understanding of data modelling, schema design, metadata management, data ...

Stock Exchange. With 3,000 employees and 32 offices in 12 countries we’re a business with lots of opportunity for people with talent, spark and lots of ambition. If you want to build a great career with a company that prioritises strong values – such as integrity and courage ...

modern cloud engineering practices. Wherever you land, you'll be working with some of the biggest datasets in the UK - using everything from Spark and statistical methods to domain knowledge and emerging GenAI applications. The work you could be doing Cloud-native AI engineering and large-scale data platforms ...

role you should have the following skills: Experience implementingdata processes for Data Warehouse and production systems. Strong experience withBig Data technologies(e.g.,Hadoop/Spark). Programming in modern languages (e.g.,ScalaandPython). Strong delivery engineering tooling:Git/GitHub,Jenkins,Ansible, andJIRAfor requirement/backlog management. Strong understanding ...

ingestion processes and solutions. Lead the execution of Microsoft Fabric migration activities. Lead and guide migration engineers and QA resources. Develop Python, PySpark and Spark SQL code for data validation and curation within notebooks. Create data integration test cases and support testing activities. Implement and amend data processing … PySpark, SQL and Python. Good knowledge of real-time streaming applications, preferably including Kafka, Azure Functions or Azure Service Bus. Strong understanding of Spark processing and performance tuning. Experience working with file formats and partitioning, including Parquet, JSON, XML and CSV. Experience with Azure DevOps/GitHub ...

needed). Skills and knowledge Demonstrable experience designing, deploying, and operating big data platforms at scale. Hands‐on experience with OSS data ecosystems (e.g., Spark, Trino, Airflow, Apache Superset, and similar technologies). Knowledge of cloud platforms and traditional on‐premise hosting; hands‐on experience with Azure ...