小编Hek*_*eka的帖子

使用 OpenAI 嵌入和 Chroma 向量存储限制 LangChain 中每分钟的代币数量

我正在寻找一种方法来限制在 Chroma 矢量存储中保存嵌入时每分钟的令牌数。这是我的代码:

[...]
# split the documents into chunks
text_splitter = CharacterTextSplitter(chunk_size=1500, chunk_overlap=0)
texts = text_splitter.split_documents(documents)
# select which embeddings we want to use
embeddings = OpenAIEmbeddings()
# create the vectorestore to use as the index
db = Chroma.from_documents(texts, embeddings)
[...]
Run Code Online (Sandbox Code Playgroud)

我收到以下错误:

Retrying langchain.embeddings.openai.embed_with_retry.<locals>._embed_with_retry in 4.0 seconds as it raised RateLimitError: Rate limit reached for default-text-embedding-ada-002 in organization org-xxx on tokens per min. Limit: 1000000 / min. Current: 1 / min. Contact us through our help center at help.openai.com …
Run Code Online (Sandbox Code Playgroud)

langchain chromadb openaiembeddings

5
推荐指数
1
解决办法
2673
查看次数

标签 统计

chromadb ×1

langchain ×1

openaiembeddings ×1