Cognizant has an exciting opportunity for a skilled and collaborative Data Engineers with hands on experience in Pyspark ,Scala to join our thriving team. This full-time role is based in Sydney and offers an attractive salary and benefits. You'll be joining a collaborative and inclusive team seeking to be at the forefront of the business unit and deliver outstanding projects. In your first few weeks in this role, you can expect to: Independently Design and build/configure Big data pipelines as per the design Able to identify and solve big data problems independently. Work closely with Sr. Big data developer to report any issues in build Work on defect fixes during QA & UAT. Work through the life cycle of the code from low-level design to production and Postproductions support. To apply for this role, your soft skills, expertise and experience should include: Strong technical and analytic skills to solve complex big data problems. Experienced with Spark software stack, Prior experience in working on Spark using Python or Scala or Java and PySpark based big data implementations. Have strong knowledge and hands-on few of HDFS, Map reduce Hive, Impala, Tej, Sqoop, Pig, Oozie, HBase, Cassandra, Mongo DB, Kafka, Spark, Storm, Knox, Ranger, Flume, NiFi, Falcon, Kerberos, Sentry, Cloudera Manager, Cloudera Navigator and Ambari. Big Data Stack (Spark, Hive, Hbase, Apache Pheonix, Pig), Python , Scala, Kafka, Spark Streaming, Atlas, Pig, Java ,SQL, Impala, Tej, Sqoop, Pig, Oozie, HBase, Cassandra, Mongo DB, Kafka, Spark, Storm, Knox, Ranger, Flume, Nifi, Falcon, Kerberos, Sentry, Cloudera Manager, Cloudera Navigator and Ambari. Good Experience in CICD & DevOps concepts Good experience working in any cloud environment (Azure / AWS / GCP) using Agile methodology You'll receive an excellent salary and benefits package for your knowledge, expertise and flexibility. At Cognizant, taking care of employees is a priority: • You can pursue innovative career tracks and opportunities here • You can enhance your professional development through education and dedicated training • We'll give you the skills you need to keep pace with the changing workplace while our compensation, benefits and wellness packages help you stay healthy and plan for the future. If this full-time role in Sydney motivates and inspires you, please get in touch with Cognizant today. We'd love to help you get your next role. At Cognizant, we engineer modern businesses to improve everyday life because we're dedicated to making a lasting impact. Cognizant (Nasdaq: CTSH) engineers modern businesses. We help our clients modernize technology, reimagine processes and transform experiences so they can stay ahead in our fast-changing world. Together, we're improving everyday life. See how at www.cognizant.com or cognizant.