A collection of work I have done for the past while that I’m proud of.

A backlog of unfinished ideas can be found here.


writing.

You can find internal monologue under posts index.

open source.

  • OpenLLM - Run any open-source LLMs as OpenAI compatible API endpoint in the cloud. (2023-)

    • 🔬 Build for fast and production usages
    • 🚂 Support Llama, Qwen, Gemma, etc, and quantized versions
    • ⛓️ OpenAI-compatible API
    • 💬 Built-in ChatGPT like UI
    • 🔥 Accelerated LLM decoding with state-of-the-art inference backends
    • Source: GitHub
  • Quartz - 🌱 a fast, batteries-included static-site generator that transforms Markdown content into fully functional websites (2023-)

    • A set of tools that helps you publish your digital garden and notes as a website for free.
    • Improved performance of graph interaction with Canvas (#1328)
    • Added support for PDF in popover modal (#913)
    • Implemented font-fetching before runtime (#817)
    • Implemented telescope-style search (#722, #774, #782)
    • Landing page of this website, with custom components, i.e: supper club, curius
    • Source: GitHub and site
  • avante.nvim - A Cursor-like chat IDE for Neovim

  • BentoML - Build Production-grade AI Application (2021-)

    • a framework that simplifies machine learning model deployment and provides a faster way to ship your model to production. Supports a variety of use cases, from classical ML to LLMs, diffusions models.
    • Built using Python, BuildKit, gRPC
    • Source: GitHub, Documentation
  • onw - A real-time navigation tools for safer commute (2021)

    • Implemented route optimization, heat map visualization to identify hot zones, peer notification system.
    • Added a heuristic Gaussian Mixture Model to find the safest path between different locations, trained on past assault data provided by Toronto Police Department.
    • Awarded: Finalists at Hack the North 2021.
    • Built using AWS Fargate, React Native, TypeScript, GraphQL, Apache Spark MLlib, Google Maps API
    • Source: GitHub, devpost

talks.

  • OpenLLM, and everything about running LLMs in production at Hack The North (2023)