Job Description

We are seeking a skilled Python & PySpark Developer to join our growing and dynamic team. As a Python & PySpark Software Developer, you will be responsible for designing, developing, and maintaining Python-based applications and PySpark data processing pipelines. Your expertise will contribute to the development of scalable and efficient data solutions.

Responsibilities

• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
• Develop Python applications and PySpark data processing pipelines for data extraction, transformation, and loading (ETL) processes.
• Optimize and fine-tune existing Python and PySpark code to ensure high performance and efficiency.
• Implement data quality checks and ensure data integrity throughout the development process.
• Troubleshoot and resolve issues related to data processing and application performance.
• Expertise with CSS preprocessors like SASS or LESS.
• Stay up-to-date with industry best practices, tools, and technologies related to Python and PySpark development.
• Write clear and concise technical documentation.

Requirements

• Bachelor's degree in Computer Science, Software Engineering, or a related field.
• Strong experience in Python programming and PySpark development.
• Proficiency in working with big data frameworks like Apache Spark and related technologies.
• Familiarity with data processing concepts such as ETL, data warehousing, and data modeling.
• Solid understanding of distributed computing principles.
• Experience with SQL and relational databases.
• Strong problem-solving and analytical skills
• Excellent communication and collaboration abilities.
• Ability to work effectively in a fast-paced, deadline-driven environment.

Preferred Qualifications

• Experience with cloud-based data platforms such as AWS, Azure, or Google Cloud Platform.
• Familiarity with machine learning libraries and algorithms.
• Knowledge of data visualization tools like Tableau or Power BI.
• Experience with version control systems (e.g. Git).