inferlayer

a lightweight python library for routing llm prompts across providers and caching responses for cost and latency optimization.

github · contact@inferlayer.xyz

install

pip install inferlayer

usage

from inferlayer import InferLayer

layer = InferLayer(providers=["openai", "anthropic"])
print(layer.ask("explain tcp vs udp"))