Support horizontal scaling to distribute the traffic and failover
Also support Caching when response to the client:
