Co-creator of Mantis (<a href="https://mantis-llm-gateway.github.io/case-study/introduction/" rel="nofollow">https://mantis-llm-gateway.github.io/case-study/introduction...), an open-source, self-hosted Large Language Model (LLM) gateway that provides a single interface for interacting with multiple LLMs. I was particularly involved with building out the end-to-end asynchronous token streaming pipeline, writing and publishing the SDK on PyPi and automating the deployment
workflow using Terraform.
rizsyed1 · · focus · HN ↗
Remote: Yes - but am open to both hybrid and in-office too.
Willing to relocate: Yes
Technologies: Python, FastAPI, Node.js, Express, PostgreSQL, MongoDB, REST APIs, JavaScript, TypeScript, React, HTML/CSS, Pytest, AWS, Terraform, Docker, Nginx, DigitalOcean, Linux, Git/GitHub, Postman, PyPI
Résumé/CV: <a href="https://www.linkedin.com/in/riz-s/" rel="nofollow">https://www.linkedin.com/in/riz-s/
Email: rizwansyed876@gmail.com
Co-creator of Mantis (<a href="https://mantis-llm-gateway.github.io/case-study/introduction/" rel="nofollow">https://mantis-llm-gateway.github.io/case-study/introduction...), an open-source, self-hosted Large Language Model (LLM) gateway that provides a single interface for interacting with multiple LLMs. I was particularly involved with building out the end-to-end asynchronous token streaming pipeline, writing and publishing the SDK on PyPi and automating the deployment workflow using Terraform.