The Software Engineer is responsible for designing, developing, and maintaining scalable data pipelines and backend services that facilitate efficient data processing, storage, and access. This role ensures the highest standards of data integrity and reliability by implementing robust systems for data quality and consistency.
Job Description
• Design, develop, and maintain scalable data pipelines and backend services for data processing, storage, and access.
• Implement systems for tracking data quality and consistency, ensuring the highest standard of data integrity and reliability.
• Collaborate with cross-functional teams to understand data needs and deliver solutions that aid in achieving strategic goals.
• Optimize data retrieval, and reports for various user segments, facilitating effective decision-making. Write clean, efficient, and reusable Python code that meets industry standards
• Review and improve existing systems, enhancing performance and integrating new features.
• Stay current with industry trends and technologies, and apply this knowledge to enhance the business’s technological resources
Required Qualifications
• Proficient in Python, with extensive knowledge of FastAPI and other modern frameworks.
• Experience with cloud services (Azure) and integrating diverse data sources.
• Expertise in SQL and NoSQL database technologies, such as PostgreSQL, MongoDB, etc.
• Familiarity with big data tools like Hadoop and Spark, and workflow orchestration tools such as Airflow.
• Skilled in designing and implementing RESTful APIs and microservices architecture.
• Clear and coherent in both written and verbal communication skills with the ability to convey complex technical concepts to non-technical stakeholders.
• Strong problem-solving skills and ability to work in a dynamic, team-based environment.