We are seeking a highly skilled Data Engineer with hands-on experience in developing complex data-intensive processes and solutions. The successful candidate will bring a solid and diverse skillset in ETL pipeline development within data frameworks and applications. The ideal candidate will have experience developing and maintaining scalable ETL pipelines, implementing cloud-native “Big Data” solutions (Data Lake / Lake houses), and collaborating with software engineers and data scientists to build robust data processes across multiple systems.

The candidate will have advanced knowledge of SQL, Python, and experience working with data orchestration tools (e.g. Dagster, Airflow). Experience working with unstructured data / NoSQL, containerization, or other programming languages is desirable. They are passionate about implementing best practices, ensuring that their work is both maintainable and scalable.

In this role, you will be responsible for architecting production data processes and systems to empower machine learning and software engineers, enhancing operational efficiency across the business. You will gain a deep understanding of “the whole picture” and will draw on this knowledge when working with cross-functional teams to help scope, develop, and deliver new and enhanced business initiatives.

Main Duties and Responsibilities

• Scope, architect, and implement production-grade ETL pipelines to consolidate data sets into a data-lake solution, developing solutions that make this data available to a variety of stakeholders.
• Develop data structures necessary to support analysis and drive business processes by combining diverse data sources, including geolocation data, usage data, and more, distributed across multiple databases and unstructured data sources.
• Develop and maintain complex production-grade data processes (e.g. usage rating, event listener engines, CDR injections).
• Collaborate with internal (SysOps, Tech, Finance, etc.) and external (network operators, hosted system owners, etc.) stakeholders to define business requirements, develop analytical solutions, and implement process improvements.
• Monitor and maintain orchestration logic to ensure all rulesets are accurately applied on an ongoing basis.

Key attitude/behaviours

Exceptional results require exceptional people. Exceptional people who live and breathe the plan.com values. We are built on trust, fuelled by passion and driven by excellence.

Attributes we look for include:

• Curious and continuous learner – We value individuals who are eager to learn and grow and committed to self-improvement. We encourage continuous learning and provide a wide range of opportunities for personal and professional development.
• Innovative and Initiative – We embrace innovation and encourage our team members to be ambitious, think outside the box, challenge the status quo, and explore new ideas to drive growth and success. We value team players who can work off their own initiative, empower our people to make informed decisions and trust them to do the right thing.
• Adaptable – In a dynamic industry, adaptability is key. We seek individuals who can thrive in a changing environment, embrace new challenges, and quickly adjust to evolving circumstances while maintaining a positive attitude.
• Collaborative – We value the collective power of working together.
• Passion – One of our three core values, passion goes beyond our people's enjoyment of their work. It's a passion for the business and their contribution to furthering its success. It means striving to be the best and encouraging those around us to do the same. And it means not being afraid to take risks. Go big or go home!

About You – Personally

All plan.com employees must present a professional, efficient image at all times and undertake any tasks reasonably requested of them by the company. We’re looking for somebody with:

• A can-do attitude – prepared to "go the extra mile".
• Lots of energy – a team player who can work off their own initiative.
• Meticulous attention to detail.
• A curious learner who strives to deliver optimal solutions to complex problems.
• A passion for the business and our corporate values – Trust, Passion, Excellence.

Personal Qualities

• A willingness and ability to pick up new concepts and/or languages as required. – Essential
• Excellent communication and collaboration skills, with the ability to communicate technical concepts to non-technical stakeholders – Essential
• Ability to work effectively in a fast-paced, dynamic environment and manage multiple projects simultaneously – Essential

• Strong analytical and problem-solving skills, with the ability to analyse complex datasets and extract actionable insights – Essential
• Advanced proficiency in Python and SQL. Experienced with data orchestration / ETL frameworks (e.g. Dagster, Prefect, DBT, Airflow) – Essential
• Experience working with leading Data Lake and Warehousing platforms (e.g. Azure, Databricks, Snowflake, AWS) – Essential
• Experience with other programming languages (PHP, R, Go) and containerization technologies (Docker, Docker Swarm). Knowledge of distributed data processing technologies (e.g. Spark, Dask, Polars) – Desirable
• Comfortable using distributed version control systems (Git, GitHub, etc.) to facilitate knowledge sharing and maintain version control principles – Desirable

• Bachelor's or Master's degree in Data Engineering, Computer Science, Applied Mathematics, Physics, or a related numerical/computational field – Essential
• Proven experience (3+ years) as a data engineer or data scientist in a data/computationally intensive role, ideally in the telecommunications industry – Essential