我在 Python 中使用 Langchain 和 Gradio 接口。我制作了一个对话代理,并尝试将其响应传输到 Gradio 聊天机器人界面。我查看了 Langchain 文档,但找不到使用代理实现流式传输的示例。这是我的代码的一些部分:
# Loading the LLM
def load_llm():
return AzureChatOpenAI(
temperature=hparams["temperature"],
top_p=hparams["top_p"],
max_tokens=hparams["max_tokens"],
presence_penalty=hparams["presence_penalty"],
frequency_penalty=hparams["freq_penaulty"],
streaming=True,
callback_manager=CallbackManager([StreamingStdOutCallbackHandler()]),
verbose=True,
model_name=hparams["model"],
deployment_name = models_dict[hparams["model"]],
)
# Loading the agent
def load_chain(memory, sys_msg, llm):
"""Logic for loading the chain you want to use should go here."""
agent_chain = initialize_agent(tools,
llm,
agent="conversational-react-description",
verbose=True,
memory=memory,
agent_kwargs = {"added_prompt": sys_msg},
streaming=True,
)
return agent_chain
# Creating the chatbot to be used in Gradio.
class ChatWrapper:
def __init__(self, …Run Code Online (Sandbox Code Playgroud) Gradio 包括一个口号“用 Gradio 构建”。我怎样才能删除它?
如果由于某种原因省略了这个选项,是否有猴子补丁可以做到这一点?
我正在尝试使用 Gradio 块作为输入来创建变量。然后,这些变量被发送到一个函数,用于格式化字符串。
\n后面的函数不接受 Gradio 块创建的变量。详细信息如下。
\n这是 Gradio“前端”Gradio 代码,旨在生成我想要的变量:
\nwith gr.Blocks() as main:\n with gr.Tab("The Workout Plan"):\n with gr.Column():\n with gr.Row():\n age = gr.Number(label="Age"), #1 Age\n weight = gr.Number(label="Weight (lbs)"), #2 weight \n sex = gr.Dropdown( #3 sex\n label="Biological Sex",\n choices=["Male", "Female"]),\n with gr.Column():\n goal = gr.Dropdown( #4 goal\n label="What is your primary goal?",\n choices=["Hypertrophy (muscle growth)", "Power Lifting (strength increase)", "Flexibility and Mobility"]),\n location = gr.Dropdown( #5 location\n …Run Code Online (Sandbox Code Playgroud)