Serving Frameworks

7 Frameworks for Serving LLMs

Better Programming

Finally, a comprehensive guide into LLMs inference and serving with detailed comparison. Image generated by Stable Diffusion While browsing through LinkedIn, I came across a comment that made me real...

Libraries and frameworks

JavaScript from Beginner to Professional

Let's start with libraries and frameworks. Libraries are basically pre-programmed JavaScript modules that you can use to speed up your development process. They typically do one specific thing for you...

API Frameworks

Full Stack Python

API frameworks are code libraries that provide well-tested, commonly-used functionality when building a web API.

Master the Backend Realm: Unleashing the Dynamic Power of Top Frameworks (͡• ͜ʖ ͡•)

Javarevisited

In the vast landscape of web development, backend frameworks serve as the cornerstone for building robust, scalable, and efficient applications. These frameworks equip developers with the necessary to...

Model serving architectures

Marvelous MLOps Substack

Lecture 5 of MLOps with Databricks course

We Stopped Using Frameworks — and Built Something That Actually Worked

Javarevisited

1. Frameworks Don’t Save Time — They Hide It

— A framework for network servers

The Python Standard Library

socketserver — A framework for network servers Source code: Lib/socketserver.py The socketserver module simplifies the task of writing network servers. There are four basic concrete server classes: c...

Escape From the Framework

Better Programming

Or as Robert C. Martin says: “Don’t marry the framework” Photo by geraldo stanislas on Unsplash Once upon a time, I used to learn frameworks and apply what I learned directly on projects without much...

Web Applications & Frameworks

The Hitchhiker's Guide to Python!

Web Applications & Frameworks As a powerful scripting language adapted to both fast prototyping and bigger projects, Python is widely used in web application development. Context WSGI The Web Server G...

🌀Edge#12: The challenges of Model Serving~

TheSequence

In this issue: we explain the concept of model serving; we review a paper in which Google Research outlined the architecture of a serving pipeline for TensorFlow models; we discuss MLflow, one of the ...

Building Application Frameworks

Python 3 Patterns, Recipes and Idioms

An application framework allows you to inherit from a class or set of classes and create a new application, reusing most of the code in the existing classes and overriding one or more methods in order...

Program Frameworks

The Python Standard Library

Program Frameworks The modules described in this chapter are frameworks that will largely dictate the structure of your program. Currently the modules described here are all oriented toward writing c...