Post Tagged with: "Transformers"

Analysis of the Huggingface Infinity Inference Engine

We love Huggingface and use it a lot. It really has made NLP models so much easier to use.  They recently released an enterprise product that is an inference solution with all the magic software for a hardware deployment in a docker container. https://huggingface.co/infinity Performance of ML Systems is close […]

Read More