Toppy M 7B

Description

A wild 7B parameter model that merges several models using the new task_arithmetic merge method from mergekit.

Pricing

• Dedicated Endpoints: Calculated by the instance type and the number of GPUs, you can find the details in pricing page. You can also contact us to reserve GPUs.
• Serverless Endpoints: $0.07 / M tokens for using Toppy M 7B, pay as you go.

Create a Dedicated Endpoint

Beyond the serverless endpoints, Lepton provides a simple way to create a dedicated endpoint for Toppy M 7B, which is a fully managed endpoint for your own use cases. If this model is what you are looking for, head over our dashboard to create your endpoint.