Lead Big Data Engineer

Category: Analytics and Emerging Digital Technologies
City: London, England - London, United Kingdom
Position ID: J0320-1284
Employment Type: Full Time

Position Description

If you’re looking for a challenge that stretches your talents and you want to make a real difference in people’s lives, come and help us support the digital transformation of the UK. We need a Lead Consultant _ Big data to join our innovative UK Advanced Analytics team tasked with creating and managing Big Data infrastructure and tools, typically designing and building big data pipelines and platforms. At CGI you’ll be a member not an employee and you’ll find a friendly, collaborative environment where your ambition is rewarded. Tempted?

Your future duties and responsibilities

CGI have an exciting opening for a Big Data Consultant to work on the collecting, storing, processing, and analysing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. The Big Data engineer will also be responsible for integrating them with the architecture used across the business.

This is a senior consultant position for a qualified Big Data expert to build ETL/ELT best practices in a big data environment, featuring big data pipelines, real time streaming using Kafka and leveraging high levels of proficiency across distributed computing principles.

The Consultant will be able to select and integrate any Big Data tools and frameworks required to provide requested capabilities, implementing ETL/ELT process, working closely with Cloud big data architecture (AWS, Azure, GCP) and be an SME in relation to knowledge of big data tools/platforms, data management tools and necessary infrastructure changes.

This represents an exciting opportunity to help build CGI’s UK Advanced Analytics Capability as it takes flight out of our growing Emerging Technology practice.

Required qualifications to be successful in this role

The successful candidate will offer a demonstrate track record in building scalable big data solutions with a view to act as a trusted technology advisor, with core knowledge across a variety of tools and platforms in big data landscape, including appreciation of data management/governance and security.

Necessary skills:

1. Python, Spark for data pipelines

2. Appreciation of ETL/ELT, Lambda architecture, Hadoop, data security & GDPR controls

3. Strong data engineering skills on the Azure Cloud Platform is essential. Other cloud platforms are desirable but not essential.

4. Streaming frameworks like Kafka

5. Understanding of Data Warehousing, Data Modelling techniques

6. Appreciation of database technologies such as noSQL, graph, in-memory databases

7. Attitude to be excited with new technology experimentation in a lab style setup



Nice to have:

1. Snowflake cloud DW

2. Some experience on visualisation tools like Power BI or others, not required at expert level

3. Understanding of Elasticsearch, Hadoop stack, Airflow, Apache ni-fi, Apache Beam, Storm

4. Understanding of Docker, Kubernetes, CI/CD

For candidates with strong mandatory skills, we will support training and certification on other cloud platforms and technologies using our partnerships with technology providers.



Suffice to say we’re also looking for well-developed interpersonal skills - clear, concise – with a passion for latest business innovations and their application to clients’ challenges.

You will need to be keen to learn & develop and CGI will provide you the support and training to help achieve this.

#INDCGI

What you can expect from us

Build your career with us.

It is an extraordinary time to be in business. As digital transformation continues to accelerate, CGI is at the center of this change—supporting our clients’ digital journeys and offering our professionals exciting career opportunities.

At CGI, our success comes from the talent and commitment of our professionals. As one team, we share the challenges and rewards that come from growing our company, which reinforces our culture of ownership. All of our professionals benefit from the value we collectively create.

Be part of building one of the largest independent technology and business services firms in the world.

Learn more about CGI at www.cgi.com.

No unsolicited agency referrals please.

CGI is an equal opportunity employer.