ستاره‌ی راهکار باش!

●      Design and implement complex data pipelines using Apache Airflow, ensuring scalability, reliability, and efficiency.

●      Work closely with data scientists to integrate AI and machine learning models into production pipelines.

●      Manage and optimize data workflows and schedules, ensuring timely and accurate data processing.

●      Develop and maintain data lake and data warehouse architectures, supporting a wide range of data types and formats.

●      Implement best practices for data governance, security, and compliance throughout the data pipeline.

●      Monitor, troubleshoot, and optimize performance of data pipelines and infrastructure.

●      Stay abreast of emerging technologies and techniques in data engineering and AI, recommending improvements to our processes and systems.

●      Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field is a plus.

●      At least 1 years of experience as a Data Engineer or in a similar role, with a proven track record of building and maintaining large-scale data pipelines.

●      Strong proficiency in Python and SQL, with solid experience in using Apache Airflow for workflow management.

●      Experience with database technologies (SQL, NoSQL).

●      Familiarity with Docker, Kubernetes, or other containerization and orchestration technologies is a plus.

●      Knowledge of AI and machine learning model deployment processes is highly desirable.

●      Excellent problem-solving skills and the ability to work independently or as part of a team.