Transitioning Machine Learning Models to the TF Framework
Scaling TensorFlow to 300 million predictions per second
We present the process of transitioning machine learning models to thetensorflow framework at a large scale in an online advertising ecosystem.
Notably, we address the key challenges we faced and describe how we successfully tackled them ; notably, implementing the models in tf and serving them efficiently with low latency using various optimization techniques.
Notably, we address the key challenges we faced and describe how we successfully tackled them ; notably, implementing the models in tf and serving them efficiently with low latency using various optimization techniques.