Software/Data Engineer

Are you looking for a challenging and rewarding career in software/data engineering? Do you have deep knowledge in Spark Python, Azure services/AWS, DevOps, and Kubernetes? If yes, then we have an exciting opportunity for you!

We are seeking for a leading company in the field of data analytics and cloud computing, and we are looking for a talented and experienced software/data engineer to join our team. 

You will be responsible for designing, developing, testing, deploying, and maintaining scalable and reliable data pipelines and applications using cutting-edge technologies and best practices.

As a software/data engineer, you will work closely with other engineers, data scientists, and business stakeholders to understand the data needs and requirements and deliver solutions that meet or exceed their expectations. You will also collaborate with the DevOps team to ensure the smooth and continuous delivery of your code, and with the Kubernetes team to manage the orchestration and deployment of your applications on the cloud.

To be successful in this role, you will need the following qualifications and skills:

• Bachelor's degree or higher in computer science, engineering, or a related field
• At least 3 years of professional experience in software/data engineering
• Proficient in Spark Python, and familiar with other programming languages such as Scala, Java, or R. (Databricks experience could be a plus)
• Expert in Azure services/AWS, and able to use various cloud services and tools for data storage, processing, and analysis
• Skilled in DevOps, and able to use tools such as Git, Jenkins, Docker, Ansible, or Terraform for version control, automation, and configuration management
• Knowledgeable in Kubernetes, and able to use it for container orchestration and deployment
• Experience in working with big data frameworks and technologies such as Hadoop, Spark, Hive, Kafka, or Flume
• Experience in building and optimizing data pipelines and applications using Real Time Streaming (Structured Streaming or Delta Live Tables)
• Experience in applying data quality, security, and governance standards and best practices
• Experience in performing data analysis, testing, debugging, and troubleshooting
• Excellent communication, collaboration, and problem-solving skills
• Self-motivated, proactive, and eager to learn new technologies and skills