Responsibilities
- Design, develop, and maintain scalable data pipelines and backend services for data processing, storage, and access.
- Implement systems for tracking data quality and consistency, ensuring the highest standard of data integrity and reliability.
- Collaborate with cross-functional teams to understand data needs and deliver solutions that aid in achieving strategic goals.
- Optimize data retrieval, and reports for various user segments, facilitating effective decision-making. Write clean, efficient, and reusable Python code that meets industry standards
- Review and improve existing systems, enhancing performance and integrating new features.
- Stay current with industry trends and technologies, and apply this knowledge to enhance the business’s technological resources
Qualifications
- Proficient in Python, with extensive knowledge of FastAPI and other modern frameworks.
- Experience with cloud services (Azure) and integrating diverse data sources.
- Expertise in SQL and NoSQL database technologies, such as PostgreSQL, MongoDB, etc.
- Familiarity with big data tools like Hadoop and Spark, and workflow orchestration tools such as Airflow.
- Skilled in designing and implementing RESTful APIs and microservices architecture.
- Clear and coherent in both written and verbal communication skills with the ability to convey complex technical concepts to non-technical stakeholders.
- Strong problem-solving skills and ability to work in a dynamic, team-based environment.
Screening Criteria
• Bachelor’s or Master’s degree in computer science, engineering, or a related field.
• At least three (3) years of experience as a Python Software Engineer, specifically in data engineering.
• Must have a stable employment history.