Fetching Prompts

​

Using your prompt

The SDK fetches your prompts from Traceloop servers. Changes made to a prompt are available in the SDK during runtime. The SDK polls the Traceloop servers for changes every every poll interval.

The default poll interval is 60 seconds but can be configured with the TRACELOOP_SYNC_POLL_INTERVAL environment variable, or the initialization function. When in the Development environment, the poll interval is determined by the TRACELOOP_SYNC_DEV_POLL_INTERVAL environment variable or appropriate initialization argument, and defaults to 5 seconds.

To disable polling all together, set the TRACELOOP_SYNC_ENABLED environment variable to false (its enabled by default).

Make sure you’ve configured the SDK with the right environment and API Key. See the SDK documentation for more information.

​

Get Prompt API

Let’s say you’ve created a prompt with a key joke_generator in the UI and set ot to:

Tell me a joke about OpenTelemetry as a {{persona}}

Then, you can retrieve it with in your code using get_prompt:

from openai import OpenAI
from traceloop.sdk.prompts import get_prompt

client = OpenAI(api_key=os.environ["OPENAI_API_KEY"])

prompt_args = get_prompt(key="joke_generator", variables={"persona": "pirate"})
completion = client.chat.completions.create(**prompt_args)