Azure Data Engineer

2

Azure Data Engineer

Perm

Cheltenham / Hybrid working (2 / 3 days per week onsite)

Up to £65,000pa

Candidates must be eligible for SC Clearance

We're in search of an exceptional Azure Data Engineer to join our Engineering Team. As a member of our dynamic and forward-thinking group, you'll have the chance to actively participate in a broad spectrum of digital projects, spanning cultural awareness, business continuity, and beyond.

QUALIFICATIONS

Due to the nature of client work for this role, you will need to be a sole British national, eligible to work on secure client sites.

We're seeking a Data Engineer with a focus on Azure, showcasing proficiency in:

· Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement.

· Utilizing Azure data and analytics services, including but not limited to Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Stream Analytics, and Azure Synapse Analytics.

· A solid foundation in data engineering, data science, and product development, encompassing experience in both stream and batch processing.

· Designing and deploying production data pipelines, utilizing languages such as Java, Python, Scala, Spark, and SQL.

In addition, you should have proficiency or familiarity with:

· Scripting and data extraction via APIs, along with composing SQL queries.

· Integrating data engineering components into production systems and expertise in data cleaning, data wrangling, data visualization, and reporting.

· Handling substantial volumes of structured and unstructured data, including integration of data through Azure cloud-based ingestion and curation processes.

· Knowledge of data mining, machine learning, and natural language processing is considered advantageous.

· Familiarity with Agile methodologies and participation in Scrum ceremonies.

· Competence in designing and constructing solutions tailored for the Azure cloud environment, which may involve expertise in Platform-as-a-Service components, serverless architecture, and container technologies