Llama 3.1 70B

Description

Llama 3.1 70B is ideal for content creation, conversational AI, language understanding, R&D, and enterprise applications.

Pricing

• Dedicated Endpoints: Calculated by the instance type and the number of GPUs, you can find the details in pricing page. You can also contact us to reserve GPUs.
• Serverless Endpoints: $0.8 / M tokens for using Llama 3.1 70B, pay as you go.

Create a Dedicated Endpoint

Beyond the serverless endpoints, Lepton provides a simple way to create a dedicated endpoint for Llama 3.1 70B, which is a fully managed endpoint for your own use cases. If this model is what you are looking for, head over our dashboard to create your endpoint.