and Dask, and data visualization with Matplotlib, Seaborn, and Plotly. Scripting abilities in shell scripting, along with experience in managing databases like SQL, MongoDB, Cassandra, PostgreSQL, and MySQL, are also included. Additionally, the skill set features knowledge of version control systems such as Git, GitHub, and GitLab, and continuous more »
Responsibilities: Design and develop scalable, high-performance data processing applications using Scala. Build and optimize ETL pipelines for handling large-scale datasets. Work with Apache Spark, Kafka, Flink, and other distributed data frameworks to process massive amounts of data. Develop and maintain data lake and warehouse solutions using technologies … like Databricks Delta Lake, Apache Iceberg, or Apache Hudi. Write clean, maintainable, and well-documented code. Optimize query performance, indexing strategies, and storage formats (JSON, Parquet, Avro, ORC). Implement real-time streaming solutions and event-driven architectures. Collaborate with data scientists, analysts, and DevOps engineers to create … Master’s degree in Computer Science Engineering, or a related field. 10+ years of experience in software development with Scala Hands-on experience with Apache Spark (batch & streaming) using Scala. Experience in developing and maintaining data lake and warehouses using technologies like Databricks Delta Lake, Apache Iceberg, or more »
Nottingham, Nottinghamshire, East Midlands, United Kingdom
Ascent People
databases such as as Neptune, Dynamo or MongoDB? We are looking for C# developers who have worked with NoSQL databases, anything from MongoDB, Dynamo, Cassandra, or CouchDB. You don't need to come with AWS experience but any Cloud based development will be beneficial. Role: This Senior .Net Core more »
