LLM Inference APIs
with Lightning

LLM Inference APIs
with Lightning

LLM Inference APIs
with Lightning

⚡️ / 🤖

⚡️

🤖

⚡️ / 🤖

Pay for open-source LLM APIs through the Lightning Network with L402

Get Started

Pay for open-source LLM APIs through the Lightning Network with L402

Get Started

Pay for open-source LLM APIs through the Lightning Network with L402

Get Started

Plug and Play

Integrate with existing infrastructure and code like OpenAI SDK with our ready-to-go L402 clients.

Read More

Pay per query

Pay for each call, one call at a time.
No more, no less.

Read More

import os
from openai import OpenAI

from pyl402.wallet import AlbyWallet
from pyl402.client import L402Client
from pyl402.token_store import MemoryTokenStore

# Create the L402 client
alby_wallet = AlbyWallet(os.getenv("ALBY_BEARER_TOKEN"))
token_store = MemoryTokenStore()
client = L402Client(wallet=alby_wallet, store=token_store)

client = OpenAI(
    http_client=client,
    base_url='https://suluai.ln.sulu.sh/v1',
)

chat_completion = client.chat.completions.create(
    messages=[
        {
            "role": "user",
            "content": "Say this is a test",
        }
    ],
    model="meta-llama/Llama-3-70b-chat-hf",
)
print(chat_completion.choices[0].message.content)

Plug and Play

Integrate with existing infrastructure and code like OpenAI SDK with our ready-to-go L402 clients.

Read More

Pay per query

Pay for each call, one call at a time.
No more, no less.

Read More

import os
from openai import OpenAI

from pyl402.wallet import AlbyWallet
from pyl402.client import L402Client
from pyl402.token_store import MemoryTokenStore

# Create the L402 client
alby_wallet = AlbyWallet(os.getenv("ALBY_BEARER_TOKEN"))
token_store = MemoryTokenStore()
client = L402Client(wallet=alby_wallet, store=token_store)

client = OpenAI(
    http_client=client,
    base_url='https://suluai.ln.sulu.sh/v1',
)

chat_completion = client.chat.completions.create(
    messages=[
        {
            "role": "user",
            "content": "Say this is a test",
        }
    ],
    model="meta-llama/Llama-3-70b-chat-hf",
)
print(chat_completion.choices[0].message.content)

Plug and Play

Integrate with existing infrastructure and code like OpenAI SDK with our ready-to-go L402 clients.

Read More

Pay per query

Pay for each call, one call at a time.
No more, no less.

Read More

import os
from openai import OpenAI

from pyl402.wallet import AlbyWallet
from pyl402.client import L402Client
from pyl402.token_store import MemoryTokenStore

# Create the L402 client
alby_wallet = AlbyWallet(os.getenv("ALBY_BEARER_TOKEN"))
token_store = MemoryTokenStore()
client = L402Client(wallet=alby_wallet, store=token_store)

client = OpenAI(
    http_client=client,
    base_url='https://suluai.ln.sulu.sh/v1',
)

chat_completion = client.chat.completions.create(
    messages=[
        {
            "role": "user",
            "content": "Say this is a test",
        }
    ],
    model="meta-llama/Llama-3-70b-chat-hf",
)
print(chat_completion.choices[0].message.content)

Supported Models

Supported Models

Supported Models

Name

Model ID (for API)

price pq

Meta LLaMA-3 Chat 70B

meta-llama/Llama-3-70b-chat-hf

5 sats

MetaLLaMA-3 Chat 8B

meta-llama/Llama-3-8b-chat-hf

5 sats

Meta LLaMA-2 Chat 70B

meta-llama/Llama-2-70b-chat-hf

5 sats

Meta Code Llama Instruct 70B

codellama/CodeLlama-70b-Instruct-hf

5 sats

Mixtral-8x22B Instruct 141B

mistralai/Mixtral-8x22B-Instruct-v0.1

5 sats

Mixtral-8x7B Instruct 46.7B

mistralai/Mixtral-8x7B-Instruct-v0.1

5 sats

Vicuna v1.5 13B

lmsys/vicuna-13b-v1.5

5 sats

Nous Capybara v1.9 7B

NousResearch/Nous-Capybara-7B-V1p9

5 sats

Pricing

Pricing

Pricing

Pay per query

5 sats

p/query

Limited time offer

Pay through lightning

Same price for all models

Get Started

Want to monetize your own APIs
with Bitcoin Lightning?

Want to monetize your own APIs
with Bitcoin Lightning?

Want to monetize your own APIs
with Bitcoin Lightning?

Check out Sparkwall and our other products

© 2023 SuLu Ltd.. All Rights reserved

© 2023 SuLu Ltd.. All Rights reserved