Viewing a single comment thread. View all comments

t1_jbx9gcj wrote

if latency is not a critical requirement, you can try serverless GPU cloud like banana.dev, pipeline.ai . These platform provide an easy to use template for deploying LLM.

1