A Rust, Python and gRPC server for text generation inference. Used in production at Hugging Face to power Hugging Chat, the Inference API and Inference Endpoint.

This setting is actually called Text Language, and it lives in the Interface ... desired (especially when it comes to dialogue from the background NPCs that populate the world).