TensorFlow Serving - Learn Data Science with Travis

Serving TensorFlow models with TensorFlow Serving

Towards Data Science

TensorFlow Serving is a flexible, high-performance serving system for machine learning models, designed for production environments.

Getting started with TensorFlow Serving

Towards Data Science

TensorFlow Serving is a part of TensorFlow Extended(TFX) that makes deploying your machine learning model to a server more comfortable than ever. Before Google released TensorFlow Serving, your model…...

TensorFlow Serving client. Make it slimmer and faster!

Towards Data Science

TensorFlow Serving provides a neat way to deploy and serve the models in the production. I have described the deployment process previously here. Unfortunately, there are two problems I noticed much…

Image Classification on Tensorflow Serving with gRPC or REST Call for Inference

Towards Data Science

TensorFlow Serving is a flexible, high-performance serving system for machine learning models, designed for production environments. TensorFlow Serving makes it easy to deploy new algorithms and…

Serving Image-Based Deep Learning Models with TensorFlow-Serving’s RESTful API

Towards Data Science

TensorFlow Serving is great for serving deep learning models across a network, and it's even better with a RESTful API. Here's how to do it.

Scaling Machine Learning models using Tensorflow Serving & Kubernetes

Towards Data Science

Tensorflow serving is an amazing tool to put your models into production from handling requests to effectively using GPU for multiple models. The problem arises when the number of requests increases…

Exposing Tensorflow Serving’s gRPC Endpoints on Amazon EKS

Towards Data Science

Tensorflow serving is popular way to package and deploy models trained in the tensorflow framework for real time inference. Using the official docker image and a trained model, you can almost…

Serving an Image Classification Model with Tensorflow Serving

Level Up Coding

This is the second part of a blog series that will cover Tensorflow model training, Tensorflow Serving, and its performance. In the previous post, we took an object oriented approach to train an…

Serving TensorFlow Models. Serverless

Towards Data Science

Previously I wrote, how to serve models with TensorFlow Serving or wrap it up with Flask for provisioning of a REST API. It is also possible to host the model directly with Flask, which is in many…

Deploying Machine Learning models with TensorFlow Serving — an introduction

Towards Data Science

Deploying Machine Learning models with TensorFlow Serving — an introduction Step-by-step tutorial from initial environment setup to serving and managing multiple model versions with TensorFlow Servin...

Integrating TensorFlow Distributed Image Serving with the TensorFlow Object Detection API

Towards Data Science

This Notebook is a sequel to Serving Image-Based Deep Learning Models with TensorFlow-Serving’s RESTful API. Please be sure to read that article to understand the basics of TensorFlow-Serving and the…...