The key-value and nearest neighbor interfaces both have support for performing multiple operations together. In use cases where a machine learning model is run on batches of data, this can dramatically improve throughput.
Most Embeddinghub operations require a full round trip from client to server. Using batching, this can be pipelined, and throughput can be increased. However, if your system has very low latency requirements, a local snapshot can be used.