Senior Python Data Engineer

Mantium is a young startup building sophisticated tools to safely develop and deploy next-generation Artificial General Intelligence backed applications. We are looking for a senior python engineer to join our fast-paced team to enhance and improve our data engineering practices and processes. Responsibilities for this role would not be limited to that (we are a startup after all!), but could include FastAPI development, batch processing, analytics, workflow management engineering, customer-developer tool development, and more.

Hard Requirements

• Must be very familiar with Python 3
• Must have experience with python's asynchronous libraries and tools
• Must be familiar with message bus and pub/sub data processing environments
• Must be familiar with git
• Must be familiar with Docker
• Must be familiar with Apache Airflow
• Must have experience with unstructured data collection, management, and storage.
• Must have a great attitude and love learning new things and love sharing it
• Must be flexible and able to adapt to a fast paced quickly changing environment

Nice-To-Have Requirements

• Experience with Kafka/Faust
• Experience with Full Text Search technologies
• Experience with FastAPI
• Experience with Natural Language Processing (GPT-3, GPT-J)
• Experience with AI NLP vendors such as OpenAI, HuggingFace, CoHere, Eleuther
• Experience with PostgreSQL
• Experience with Redis