Writer LLM
Writer is a platform to generate different language content.
This example goes over how to use LangChain to interact with Writer
models.
Setup
To access Writer models you'll need to create a Writer account, get an API key, and install the writer-sdk
and langchain-community
packages.
Credentials
Head to Writer AI Studio to sign up to OpenAI and generate an API key. Once you've done this set the WRITER_API_KEY environment variable:
import getpass
import os
if not os.environ.get("WRITER_API_KEY"):
os.environ["WRITER_API_KEY"] = getpass.getpass("Enter your Writer API key:")
Installation
The LangChain Writer integration lives in the langchain-community
package:
%pip install -qU langchain-community writer-sdk
Now we can initialize our model object to interact with writer LLMs
from langchain_community.llms import Writer as WriterLLM
from writerai import AsyncWriter, Writer
llm = WriterLLM(
client=Writer(),
async_client=AsyncWriter(),
temperature=0.7,
max_tokens=1000,
# other params...
)
API Reference:Writer
Invocation
response_text = llm.invoke(input="Write a poem")
print(response_text)
Streaming
stream_response = llm.stream(input="Tell me a fairytale")
for chunk in stream_response:
print(chunk, end="")
Async
Writer support asynchronous calls via ainvoke() and astream() methods
API reference
For detailed documentation of all Writer features, head to our API reference.
Related
- LLM conceptual guide
- LLM how-to guides