Company Description About us: At NCS Australia, we believe in doing technology services better. Our commitment to quality, focus on people, and willingness to challenge traditional thinking set us apart. Our team brings this belief to life by partnering with our clients and communities to make tomorrow together. We are committed to creating an environment that prioritises innovation, collaboration, and purposeful work. Our diverse team is empowered to make a meaningful impact with curiosity, creativity and resilience to shape better outcomes. Join us and accept the challenge of creating a better tomorrow. Job Description This role will be a blend of client partnership and innovative solution building. You’ll collaborate closely with our diverse NCS clients to understand their unique business ambitions, data landscapes, and analytical aspirations. With these valuable insights, you'll be empowered to develop and bring to life comprehensive data solutions on the cutting-edge Databricks Lakehouse Platform. This means you'll build smart and robust data ingestion pipelines for all types of data, creatively implementing effective data transformation processes, and leveraging the power of Delta Lake to ensure data is not just stored, but is reliable, optimised, and ready to fuel insights. Your technical flair and thoughtful approach will be key to crafting data solutions that are not only high-performing but also meticulously governed. You’ll enjoy the challenge of developing and fine-tuning Apache Spark jobs, ensuring they run efficiently and can scale to meet growing demands. You’ll also play a crucial part in managing and configuring secure Databricks environments, expertly using features like Unity Catalog to build a foundation of trust and control, and MLflow to streamline the journey for innovative machine learning projects. Furthermore, you'll creatively apply your skills in data modelling and warehousing, designing solutions that truly illuminate the path for our clients’ business intelligence and advanced analytics goals. Beyond your direct technical contributions, your collaborative spirit will shine as you actively engage with key technology partners, especially Databricks, fostering strong relationships to ensure seamless delivery of integrated client solutions and keeping us all at the forefront of platform innovation. You’ll have the rewarding opportunity to guide and support project teams, sharing your expertise as you collaboratively tackle complex data puzzles and champion best practices in Databricks development and data engineering. We believe in growing together, so a passion for continuous learning is something we champion, ensuring you and NCS are always equipped with the latest knowledge from the vibrant Databricks ecosystem to deliver truly innovative and effective outcomes for our clients. Qualifications To excel in this client-focused Databricks Engineer role, you’ll demonstrate a strong combination of technical depth and consulting aptitude: Databricks Lakehouse Platform Expertise: Proven hands-on experience designing and delivering solutions on the Databricks Lakehouse Platform, backed by recent project work. This includes deep familiarity with core features such as Delta Lake, Unity Catalog, and Databricks SQL, with experience in MLflow being highly advantageous. Databricks certifications (e.g., Data Engineer Professional/Associate) are a significant plus. Advanced Spark, Python/Scala & SQL Proficiency: In-depth understanding and practical application of Apache Spark, including its architecture and optimisation techniques, coupled with strong programming skills in Python and/or Scala for Spark development, and robust SQL capabilities. Cloud Data Solutions: Experience deploying and managing data solutions on one or more major cloud platforms (AWS, Azure, or GCP). Solid Data Engineering Fundamentals: A solid grasp of data warehousing concepts, data modelling techniques, and best practices for ETL/ELT development. Familiarity with data pipeline orchestration tools (e.g., Apache Airflow, Azure Data Factory) and CI/CD/DevOps principles for data engineering will be highly regarded. Exceptional Problem-Solving & Communication: Excellent analytical and problem-solving skills, with a proven ability to dissect complex data challenges and devise effective solutions. This is complemented by strong verbal and written communication skills, enabling confident and clear engagement with both clients and internal technical teams. Collaborative & Dynamic Approach: A strong collaborative mindset with the ability to thrive in a dynamic, client-facing consulting environment, working effectively within diverse teams. Educational Foundation: A Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field. Broader Data Ecosystem Knowledge (Desirable): While not essential, experience with other data technologies like Kafka, streaming solutions, or BI tools (e.g., Power BI, Tableau) would be an added advantage. Additional Information Why join us: NCS Australia is where you can feel at home, nurturing your talents and skills as we make tomorrow together, one day at a time. Our benefits include paid parental leave, initiatives focused on your well-being and discounted health insurance. You will also enjoy discounts on various products and services and be regularly recognised and rewarded for high performance. We are committed to your career development through our Capability Fingerprint, industry and partner training programs, special interest groups, and an AI-driven learning platform. No matter where you are in your career, we offer meaningful work and opportunities for growth. NCS Australia is an equal-opportunity employer, and we take pride in our commitment to valuing and supporting our people and the communities we serve.We are dedicated to attracting, retaining and developing our people regardless of gender identity, ethnicity, sexual orientation, disability and age. Applications are encouraged from all sectors of the community and we strongly encourage applications from the Veterans, Aboriginal and/or Torres Strait Islander community. At NCS Australia, we are committed to supporting adjustments throughout the recruitment and selection process, as well as during employment. We actively support and encourage people with disability to apply. Agencies: We’ve got this. We request that you do not contact NCS employees outside of the Talent Acquisition team. NCS exclusively accepts resumes from agencies on our preferred supplier panel through the NCS Agency Portal. Agencies that submit resumes must have a valid fee agreement and be assigned to the particular requisition by the Talent Acquisition team. Any resumes that are submitted outside of this process will become the sole property of NCS. If a candidate is hired outside of this process, no fee or payment will be given. Work rights and background checks: To be eligible for a position with us, applicants will need to have valid work rights for Australia and be willing to undergo a comprehensive background checking process, including probity and police checks