Publicēts: Inženierpakalpojumi - Prestona | Pēdējo reizi atjaunots: |
Title: Principle Data Engineer
Location: Hybrid - Once per Month Travel to office in North West.
Salary: £75,000 + Package
Role Overview:
The Principal Data Engineer holds a key position within the Data Engineering function, reporting directly to the Head of Data & Platform Engineering. This role requires a deep understanding of Google Cloud Platform to ensure that all production data processes are reliable, efficient, and compliant. Key responsibilities include overseeing data ingestion, quality, integrity, modeling, warehousing, transformation, security, encryption, monitoring tools, and batch management.
The Principal Data Engineer will:
l Identify opportunities for automation and process improvement.
l Mentor and guide data engineers.
l Establish coding standards and best practices.
l Implement and document data integrity and quality checks.
l Optimize queries.
l Facilitate collaboration within the data engineering team.
l This role involves close collaboration with the Principal Cloud Engineer and the Data Architect to ensure data pipeline designs are optimized and reliable within the Google Cloud Platform. Effective documentation and communication of solutions to both technical and non-technical stakeholders are essential.
Candidate Profile:
l Extensive ETL/ELT background with experience in developing data pipelines, optimizing queries, and enhancing database performance.
l Proficient in data modeling and data warehousing.
l Multiple years of experience with GCP, especially with core processing and orchestration products like BigQuery, DataFlow, DataFusion, DataStream, Cloud Functions, DataProc, and Airflow/Composer.
l Strong problem-solving skills and a meticulous approach to code reviews.
l Proven leadership qualities with the ability to uphold high standards within the team.
l Experience in managing and participating in the full development lifecycle of data products.
l Demonstrated experience in a leading role within a Data Engineering function, including directing other data engineers through the design, build, and deployment of complex data solutions and driving CI/CD implementation and adoption.
l Self-motivated with the ability to drive innovation and mentor team members.
Experience & Skills:
l 7+ years in Data Engineering.
l 1+ years in a Lead/Principal Engineer role.
l 3+ years of experience with GCP.
l Extensive experience with SQL and Data Lake/Warehouse solutions.
l Proficiency in languages such as SQL, Python, Java, or Scala.
l In-depth knowledge of query optimization techniques and experience in fine-tuning complex SQL queries.
l Strong understanding of Data Governance, including Data Dictionaries, MDM, Lineage, Data Legislation, and handling PII.
l Excellent communication skills and the ability to work collaboratively with cross-functional teams.
l Experience with Agile/Scrum/SDLC methodologies
