About the role We are seeking an experienced Data Engineer to design, build, and optimise a modern data platform across Azure Databricks and Fabric. This role will be instrumental in architecting and developing scalable data solutions using Databricks and Microsoft Fabric, enabling data‑driven decision‑making across the organization. A key responsibility will be mentoring junior and mid‑level Data Engineers. Key Responsibilities Data Platform Development Design and implement robust data pipelines and ETL/ELT workflows using Databricks and Microsoft Fabric Architect and maintain lakehouse solutions leveraging Delta Lake and OneLake architectures Optimize data processing workflows for performance, cost‑efficiency, and scalability Develop and maintain real‑time and batch data integration solutions Technical Leadership Lead the implementation of data architecture standards and best practices Mentor junior and mid‑level data engineers on modern data engineering techniques Collaborate with data scientists, analysts, and business stakeholders to understand requirements Evaluate and recommend new technologies and tools to enhance the data platform Data Quality & Governance Implement data quality frameworks and monitoring solutions Establish and enforce data governance policies and security controls Ensure compliance with data privacy regulations and organisational standards Design and implement data lineage and metadata management solutions Performance & Optimisation Monitor and optimise query performance across Databricks and Fabric environments Implement cost optimisation strategies for cloud data infrastructure Troubleshoot complex data pipeline issues and implement solutions Skills & Experience Education: Bachelor’s degree in engineering, Computer Science, or a related field. Master’s degree or MBA preferred. Experience: 5+ years of experience in data engineering, data analytics, business intelligence, or related data domains. 3+ years of experience in a consulting or professional services environment. Proven experience in leading data engineering teams and delivering client‑focused solutions. Technical Skills: Expertise in data analytics tools and platforms (e.g., SQL, Python, R, Apache Spark, Tableau, Power BI). Expertise in Azure services and analytics platforms such as Databricks, Synapse and MS Fabric (Data Factory, Synapse, Power BI, OneLake). Knowledge of other cloud platforms (AWS, Google Cloud) is a plus. Expertise with data lake modelling such as Kimball (Star Schema) and Data Vault modelling. Understanding of machine learning, predictive analytics, and data visualisation techniques. Strong expertise with Databricks platform including Delta Lake, Spark, and MLflow. Knowledge of infrastructure as code (Terraform, ARM templates). Has worked with Databricks Assets Bundles. Familiarity with CI/CD pipelines for data workflows. Strong understanding of data warehousing concepts and dimensional modelling. Soft Skills: Strong client focus and ensures effective relationships with key client stakeholders. Excellent client relationship management skills with the ability to explain complex technical concepts to non‑technical stakeholders. Solid experience in relationship management, conflict resolution, influencing and negotiation. Must be able to work independently but also lead consulting engagements in a highly matrixed environment (especially for short‑term engagements). A team player who can liaise effectively with a diverse group of delivery teams. Ability to manage multiple projects simultaneously and prioritise effectively in a dynamic environment. Excellent verbal and written communication skills. Preferred Qualifications: Consulting experience in various industries (e.g., finance, healthcare, manufacturing). Azure and Databricks certifications are a plus. Experience with Agile methodologies and project management tools. WHY JOIN US Be part of a dynamic consultancy firm that values innovation, growth, and professional development. Lead a growing practice at the forefront of data‑driven business transformation. Work with diverse, top‑tier clients across multiple industries, delivering impactful solutions. Competitive salary and benefits package. Career development and growth opportunities within a rapidly expanding organisation. This is a Sydney based, permanent opportunity and will be hybrid in nature. No agencies please. Candidates must have valid visa with full work rights in Australia. Visas will not be transferred or sponsored. Diversity and Inclusion TL Consulting Group understands the importance of fostering a diverse and inclusive workplace. We are committed to ensuring that everyone, no matter their gender, identity, sexual orientation, race, ethnicity, religion, disability, or age, has equal access to opportunities. We warmly welcome applications from all individuals, including Aboriginal and Torres Strait Islander peoples, members of the LGBTQI+ community, and individuals with disabilities. #J-18808-Ljbffr
Data Engineer
TL CONSULTING GROUP
council of the city of sydney, council of the city of sydney
Published 4 days ago
Report job
Similar jobs
Part Time Work From Home Focus Group Panelist. Call Centre Agent Experience Not Required
APEX FOCUS GROUP LLC
Permanent