AgenticFlow AI: ChatGPT in the Flow of Work
HomeCommunityDiscordLogin
  • Get Started
    • AgenticFlow - the OS for your AI Workforce
    • llms.txt
    • FAQs
    • Key Concepts
      • Workflows
      • Templates
      • Data
      • Agent
      • API Keys
      • AgenticFlow MCP
    • Office Hours
      • #4 Office Hours
      • #5 Office Hours
    • Workflows quickstart
    • Agents quickstart
    • Introduction to Large Language Models
    • Plans and Credits
    • System Quotas
    • Affiliate program 💵
  • AGENTS
    • Introduction to agents
    • Agent Templates
    • Create an Agent
    • Customize an Agent
    • FAQ
  • Workflows
    • Introduction
    • Workflow Templates
    • Creating a Workflow
    • User Inputs - Get Started
      • Text Input
      • Long text input
      • Drop-down
      • Numeric Input
      • File to URL
      • File to Text
      • Checkbox
      • Image Input
      • Audio Input
      • Video Input
      • Multiple Media Input
      • Carousel Select Input
    • Actions - Get Started
      • LLM
        • LLM - Advanced Settings
        • Validators
        • Too Much Text
        • LLM Prompt
        • LLM Output
      • Code - JavaScript
      • Code - Python
      • Python Helper Functions
      • PDF to text
      • Extract Website Content
      • Knowledge Search
      • Audio/Video to Text
      • Insert Data into a Dataset
    • Knowledge
    • Workflow Single Run
    • Workflow Table Run
    • Export Results
    • API Run
    • FAQ
    • Parameter Substitution Utility
  • Data
    • Introduction
    • Data Table
    • FAQ
  • Use Cases
    • Summarization
      • GPT on My Files
      • GPT on My Website
      • Question-Answering on Data
    • Research
      • Sentiment Analysis
      • Anonymize Text
      • Audio Transcription + High-Level Analysis
  • Sales
    • Teach LLMs to Mimic Your Style
  • Marketing
    • SEO Optimize
    • Automating Creativity Transforming Workflow with AgenticFlow AI (PDF)
  • Policies
    • Security Overview
      • AI Policy
      • Reporting bugs and vulnerabilities
      • Subprocessors
      • DPA
    • Privacy Policy
    • Terms of Service
    • Cookies Policy
  • Actions Reference
    • Actions
    • AI LLM
      • Claude Ask
      • Extract Structured Data
      • Knowledge Base Search
      • LLM
      • OpenAI Ask
      • OpenAI Search
      • Perplexity Search
      • PML LLM
    • Automation and Search
      • Google Search
      • URL to Markdown
    • Data and Integrations
      • Advanced Web Scraping
      • API
      • JSON to Google Sheet
      • Send Email
      • Web Scraping
      • Webhook
    • Image and Video
      • Audio Transcription
      • Face Swap
      • Generate Image
      • Inpainting
      • Outpainting
      • Remove Background
      • Text to Speech
    • Logic and Control
      • Bash
      • Code
      • Conditional
      • Map
      • Sub-workflow
      • Switch
    • Telegram
      • Send Audio
      • Send Chat Action
      • Telegram Send Audio
      • Telegram Send Document
      • Telegram Send Message
      • Telegram Send Photo
      • Telegram Send Video
  • MCPs Reference
    • MCPs
    • Hugging Face Spaces
    • 0-9
      • 0codekit
      • 10,000ft by smartsheet
      • 123formbuilder
      • 15five
      • 1crm
      • 1sec mail
      • 360nrs
      • 7todos
      • 8x8 connect
    • A
      • abstract email verification api
      • abstract ip geolocation api
      • abuselpdb
      • accuranker
      • action builder
      • adrapid
      • adroll
      • adyen
      • aero workflow
      • aeroleads
      • affinda
      • affinity
      • agendor
      • agentx
      • agiliron
      • agility cms
      • agiled
      • ahrefs
      • ai/ml api
      • ai workforce management
      • airplane
      • airbrake
      • airfocus
      • airnow
      • airtable
      • aivoov
      • akeneo
      • akismet
      • akkio
      • albus
      • alchemer
      • alegra
      • alerty
      • algomo
      • all images.ai
      • altoviz
      • amazing marvin
      • ambee
      • ambient weather
      • amazon ses
      • amazon selling partner
      • amplitude
      • amplifier
      • amqp
      • annature
      • announcekit
      • anthropic (claude)
      • apaleo
      • apex 27
      • api labz
      • api ninjas
      • appcircle
      • appcues
      • appsflyer
      • arlo
      • aroflo
      • aryn
      • ascora
      • asknicely
      • askyourpdf
      • astica.ai
      • async interview
      • attractwell
      • auth0 (management api)
      • autodesk
      • autoklose
      • automizy
      • autotask psa
      • avaza
      • aws
      • aweber
      • awork
      • axesso data service amazon
      • azure api for fhir
      • azure devops
    • B
      • backblaze
      • backlog (api)
      • badger maps
      • bannerbear
      • barcode lookup
      • baremetrics
      • bart
      • baserow
      • bc gov news
      • beanstalk
      • beebole
      • benchmark email
      • benchmarkone
      • bexio
      • bigdatacorp
      • bigcommerce
      • bika.ai
      • bill
      • billplz
      • bird
      • bitbucket
      • bitdefender gravityzone
      • biztera
      • blackbaud
      • blink
      • blockchain exchange
      • blogger
      • bookingmood
      • bot9
      • botcake
      • botpenguin
      • botpress
      • botstar
      • box
      • braintree
      • breeze
      • bridge
      • brillium
      • brosix
      • bruzu
      • budgets.ai
      • bugsnag
      • builderall mailingboss
      • builtwith
      • burst sms
      • businesslogic
      • buy me a coffee
      • byteforms
      • bytenite
    • C
      • calendarhero
      • calendly
      • callerapi
      • campaign monitor
      • campaignhq
      • canny
      • cardly
      • cartes
      • caspio
      • centralstationcrm
      • cerebras
      • chainaware.ai
      • chaindesk
      • chaport
      • chargebee
      • chargeover
      • chaser
      • chat data
      • chatbotic
      • chatra
      • chatsonic
      • chatwork
      • cheddar
      • checkvist
      • circle
      • cisco meraki
      • cisco webex
      • claid ai
      • classmarker
      • claude
      • clearout
      • cleverreach
      • clevertap
      • clientify
      • cloudbees
      • cloudcart
      • cloudflare
      • cloudflare r2
      • cloudfill
      • cloudpresenter
      • cloudtables
      • coda
      • codemagic
      • codeq natural language processing api
      • coderpad
      • codescene
      • cody
      • coinbase
      • coinbase commerce
      • coinlore
      • columns ai
      • commcare
      • commpeak
      • concord
      • constant contact
      • content snare
      • contentful (oauth)
      • contentstack
      • convertkit
      • conveyor
      • countdown api
      • cradl ai
      • craftmypdf
      • crawlbase
      • credit repair cloud
      • crove
      • crm
      • crunchbase
      • curated
      • currencyscoop
      • customer fields
      • customer.guru
      • cutt.ly
      • cvr.dev
      • cyberimpact
    • D
      • dailybot
      • dandelion
      • dappier
      • dart
      • darwinbox
      • dadata.ru
      • databases
      • databox
      • datatrails (formerly rkvst)
      • dbt cloud
      • decision journal
      • demio
      • dialmycalls
      • digicert
      • digitalocean
      • directus
      • dispatch
      • discord
      • ditlead
      • dnsfilter
      • docker engine
      • documenterra
      • documentpro
      • docugenerate
      • docunify
      • docupost
      • docuraptor
      • docusign developer
      • docsumo
      • docsautomator
      • dokan
      • donedone
      • dopplerai
      • dots!
      • dotsimple
      • dovetail
      • drata
      • drchrono
      • dreamstudio (stable diffusion)
      • drift
      • drimify
      • dromo
      • dropcontact
      • droxy
      • dub
      • dungeon fighter online
      • dust
      • dux soup
      • dynalist
    • E
      • e commerce
      • e2b
      • easypost
      • easypromos
      • easysendy
      • easy project
      • easy projects
      • easycsv
      • echtpost postcards
      • ecologi
      • educateme
      • edusign
      • efinder
      • elastic cloud
      • elorus
      • emaillistverify
      • emailoctopus
      • encodian
      • encharge
      • endorsal
      • engagebay
      • enormail
      • enrichley
      • enrow
      • eodhd apis
      • epic games
      • epsy
      • esendex
      • esignatures.io
      • espocrm
      • esputnik
      • evenium
      • everwebinar
      • exa (formerly metaphor)
      • exhibitday
      • expofp
      • extensiv integration manager
      • eyepop.ai
    • F
      • facebook graph api
      • faceup
      • faktoora
      • faros
      • fatture in cloud
      • fauna
      • fedex
      • feedier
      • filestack
      • finmei
      • finmo
      • fireberry
      • fiserv
      • fixer
      • flexie
      • flexmail
      • flippingbook
      • float
      • florm
      • flowla
      • fluent support
      • flutterwave
      • fly.io
      • follow up boss
      • form.io
      • formaloo
      • formcan
      • formdesk
      • formpress
      • formspree
      • formstack
      • formstack documents
      • formatting
      • fractel
      • frame.io
      • frappe
      • fraudlabs pro
      • freeagent
      • freedcamp
      • freshlearn
      • frontegg
      • fullcontact
      • fullstory
    • G
      • gami5d
      • gan.ai
      • gather
      • geckoboard
      • gender api
      • genderapi.io
      • getemails
      • getform
      • getscreenshot
      • ghost.org (admin api)
      • giantcampaign
      • gistly
      • gitlab
      • glide
      • gmodstore
      • gocanvas
      • gocardless bank account data (formerly nordigen)
      • godial
      • gong
      • goodreads
      • goody
      • google
      • google ad manager
      • google cloud vision
      • google dialogflow
      • google docs
      • google drive
      • google maps (places api)
      • google marketplace
      • google meet
      • google palm
      • google play
      • google postmaster tools
      • google recaptcha
      • google search console
      • google slides
      • google vertex ai
      • gosquared
      • govee
      • gozen growth
      • gpt trainer
      • gptzero: detect ai
      • grade.us
      • grafana
      • grafbase
      • grain
      • greenhouse
      • greenhouse job board
      • greptile
      • growsurf
      • gtmetrix
      • gumroad
      • gupshup
    • H
      • h supertools analytics tool
      • habitify
      • hackerone
      • hashnode
      • hathr ai
      • headless testing
      • helcim
      • helium (console)
      • helloleads
      • helpdesk
      • herobot chatbot marketing
      • heyy
      • hiveage
      • homerun
      • hootsuite
      • hostaway
      • hotjar
      • howuku
      • hr cloud
      • hr partner
      • html 2 pdf
      • hub planner
      • hubspot
      • hubstaff
      • hugging face
      • hunter
      • hygraph
      • hystruct
    • I
      • iauditor by safetyculture
      • ibm cloud natural language understanding
      • ibm cloud speech to text
      • idealspot
      • idx broker
      • ihomefinder
      • ikas
      • ilovepdf
      • illumidesk
      • imagior
      • imgbb
      • imgix
      • impression
      • inferable
      • infolobby
      • inmobile
      • inputmag
      • insightly
      • instabot
      • instapaper
      • instasent
      • intellexer api
      • intelliprint
      • interzoid
      • intuiface
      • invidious
      • invision community
      • invoicing.plus
      • ip2whois
      • ipbase
      • ipdata.co
      • iqair airvisual
      • ironclad
      • iscraper
      • itemize
    • J
      • jeffreyai
      • jellyreach
      • jira data center
      • jobber
      • join
      • jvzoo
    • K
      • kadoa
      • kaggle
      • kakao
      • kaleido
      • kanban tool
      • karbon
      • kartra
      • keap (infusionsoft)
      • kenjo
      • kindo
      • kintone
      • kite suite
      • kiwihr
      • kizeo forms
      • klazify
      • klipy
      • knorish
      • knowbe4
      • knowfirst
      • kommo
      • koyeb
      • krispcall
      • kvdb
      • kyvio
    • L
      • l2s
      • l3mbda
      • labsmobile
      • lahar
      • langbase
      • langfuse
      • larger.io
      • lastpass enterprise api
      • launchdarkly
      • launchnotes
      • leadfeeder
      • leadoku
      • leap
      • leiga
      • lessaccounting
      • lettria
      • levity
      • libraria
      • lifterlms
      • lightspeed vt
      • line
      • line messaging
      • linkish
      • linkly
      • linkup
      • listclean
      • livechat
      • llamaindex
      • llmwhisperer
      • lmnt
      • lnk.bio
      • lob
      • locate
      • lokalise
      • lucid
    • M
      • mailcheck
      • mailcoach
      • mailercloud
      • mailerlite
      • mailjet
      • mailmodo
      • mailsoftly
      • mailwizz
      • mailboxlayer
      • mamo business
      • manifestly checklists
      • mapulus
      • marketing master io
      • marketstack
      • mastodon
      • mattermost
      • matterport
      • mav
      • mboum
      • mediatoolkit
      • meetstream ai
      • melo
      • membervault
      • mercury
      • merge
      • metatext.ai pre build ai models api
      • mezmo
      • microbilt developer
      • microsoft dataverse
      • microsoft excel
      • microsoft graph api
      • microsoft outlook
      • microsoft outlook calendar
      • microsoft teams
      • microsoft teams bot
      • middesk
      • milvus
      • minerstat
      • mixmax
      • mixpanel
      • miyn
      • modelry
      • monday (oauth)
      • moneybird
      • mongodb
      • monkeylearn
      • more trees
      • motive
      • moxie
      • mslm cloud
      • mural
      • murlist
      • musicbrainz
      • mux
      • mx technologies
      • mx toolbox
    • N
      • nango
      • nasa
      • nasdaq data link (time series and table data)
      • nationbuilder
      • navigatr
      • needle
      • neetoinvoice
      • neetokb
      • neo4j auradb
      • netatmo
      • neverbounce
      • new relic
      • new sloth
      • nextcloud
      • nextdns
      • nextdoor ads
      • nexweave
      • nifty
      • niftyimages
      • nile database
      • ninox
      • nocrm.io
      • noor
      • nozbe teams
      • npm
      • ntfy
      • nutrient document web services api
      • nutrient workflow automation
      • nutshell
    • O
      • occasion
      • ocr web service
      • odoo
      • ometria
      • omniconvert
      • omnisend
      • oncehub
      • onepagecrm
      • onesignal (rest api)
      • oneuptime
      • onlyoffice docspace
      • openperplex
      • openrouter
      • openweather api
      • oracle cloud infrastructure
      • order desk
      • ortto
      • osu!
      • ottertext
      • outreach
      • outscraper
      • outseta
      • owl protocol
      • oxford dictionaries
    • P
      • paddle
      • page x
      • paigo
      • paperform
      • papersign
      • parma
      • parseur
      • parsio.io
      • partnerize
      • partnerstack (partner api)
      • passslot
      • paved
      • paystack
      • paypal
      • pcloud
      • pdfmonkey
      • pdffiller
      • pdforge
      • peaka
      • peerdom
      • pendo
      • pennylane
      • perplexity
      • persona
      • phantombuster
      • phaxio
      • phone.com
      • phrase
      • piggy
      • piloterr
      • pingone
      • pinterest
      • pipefy
      • pirate weather
      • placekey
      • planday
      • planning center
      • planview leankit
      • planyo online booking
      • plecto
      • podio
      • pokéapi
      • polygon
      • postalytics
      • posthog
      • postgresql
      • prepr (graphql)
      • pretix
      • printavo
      • printnode
      • processplan
      • product fruits
      • productboard
      • productive.io
      • productivity
      • productlane
      • profitwell
      • proprofs quiz maker
      • propeller
      • provesource
      • proworkflow
      • proxy spider
      • proxycurl
      • publisherkit
      • pusher
      • pushcut
      • pushover
    • Q
      • qntrl
      • qryptal
      • qstash
      • qualaroo
      • quickbooks sandbox
      • quickemailverification
      • quickmail.io
    • R
      • re:amaze
      • radar
      • rafflys
      • ragie
      • raindrop
      • ramp
      • range
      • rapid url indexer
      • rapid7 insight platform
      • rasa
      • razorpay
      • reachmail
      • recruitis
      • reform
      • refiner
      • regal
      • reipro
      • rejoiner
      • relavate
      • relevance ai
      • relink url shortener
      • remote
      • renderform
      • replicate
      • rescuetime
      • retently
      • retool
      • retriever
      • revel systems
      • reverse contact
      • revolt
      • reward sciences
      • rex
      • richpanel
      • riku.ai
      • ringcentral
      • riskadvisor
      • robly
      • robocorp
      • roboflow
      • rocket chat
      • rocketreach
      • rollbar
      • rss
      • runware
      • ryver
    • S
      • salesblink
      • salesflare
      • salesforce
      • saleslens
      • salesloft
      • salesmate
      • salesmsg
      • sales simplify
      • samsung smartthings
      • savvycal
      • schedule it
      • scheduleonce
      • scopemaster
      • scrape it.cloud
      • scrapingbot
      • search api
      • security reporter
      • securitytrails
      • semaphore
      • semgrep
      • sender
      • sendbird ai chabot
      • sendblue
      • sendfox (personal access token)
      • sendinblue
      • sendlane
      • sendloop
      • sendowl
      • sendspark
      • sensibo
      • seqera
      • serpapi
      • serveravatar
      • sessions
      • shadertoy
      • shipday
      • shipstation
      • shopify partner
      • shopwaive
      • short.io
      • shorten.rest
      • showpad
      • sierra interactive
      • sifter
      • sigma
      • signable
      • signpath
      • signwell
      • silfer bots
      • simla.com
      • simple analytics
      • simplebackups
      • simplekpi
      • simplero
      • simpletexting
      • skyciv
      • skyvern
      • slack bot
      • slottable
      • smaily
      • smartsheet
      • smarty
      • smartlead
      • smartroutes
      • smartymeet
      • sms everyone
      • sms magic
      • sms partner
      • sms it
      • smsapi
      • smstools
      • smoove
      • smugmug
      • snapdocs
      • snov
      • snyk
      • softledger
      • solarwinds service desk
      • solve crm
      • speak ai
      • specific
      • speechace
      • splunk http event collector
      • spondyr
      • spydra
      • squarespace
      • ssh (key based auth)
      • ssh (password based auth)
      • sslmate — cert spotter api
      • stack overflow for teams
      • stannp
      • statuspage
      • stealthgpt
      • storerocket
      • storyscale
      • strava
      • studio by ai21 labs
      • suitedash
      • sumup
      • supersaas
      • supabase management api
      • supportivekoala
      • survicate
      • surveymethods
      • surveymonkey
      • survser
      • survey2connect
      • swaggerhub
      • swell
    • T
      • tableau
      • taleez
      • talenthr
      • talentlms
      • talkspirit
      • tally
      • talend
      • tave
      • teachable
      • team sms
      • teamcamp
      • teamioo
      • teamleader focus
      • teamup
      • teamwork
      • telegram
      • telnyx
      • testapp006
      • testmonitor
      • tettra
      • textrazor
      • thanks.io
      • the magic drip
      • thesportsdb
      • thoughtful gpt
      • thoughtly
      • thrivecart
      • ticket source
      • ticket tailor
      • ticktick
      • tilda
      • tiledesk
      • time tracker by ebillity
      • timelink
      • timeular
      • tinybird
      • tinypng
      • tinyurl
      • tldr
      • toggl track
      • tolstoy
      • tomba
      • tomtom
      • tookan
      • trakt
      • transifex
      • trawlingweb
      • tricentis qtest
      • triggercmd
      • truss
      • tuesday
      • tubular
      • turso
      • tutor lms
      • twist
      • typless
    • U
      • u301
      • uchat
      • uipath automation hub
      • ultramsg
      • unbounce
      • unisender
      • unity cloud build
      • unstructured
      • unsplash
      • uplead
      • uploadcare
      • upollo
      • updown.io
      • upviral
      • urlbae
      • urlbox.io
      • uservoice
      • userlist
      • utradea
    • V
      • v7 darwin
      • vectera
      • verifiedemail
      • verifone
      • vies api
      • vimeo
      • virifi
      • vitel phone
      • vivifyscrum
      • voice monkey
      • voilanorbert
      • vonage
      • voodoo sms
      • voxapp
    • W
      • wafrow
      • waitlist
      • webinarkit
      • webscraper.io
      • whatconverts
      • whatsapp business
      • whatsable
      • whosonlocation
      • widgetform
      • wildberries
      • wishpond
      • withings
      • wiza
      • wolfram alpha api
      • woocommerce
      • woodelivery
      • wordpress.org
      • workamajig
      • workboard
      • workbooks crm
      • workflow max
      • workiom
      • workiz
      • worksnaps
      • workstack
      • world news api
      • woxo
      • wp maps
      • wpforms
      • wrike
      • writer
      • writesonic
      • wubook ratechecker
      • wuf
      • wufoo
    • X
      • xai
      • xata
      • xeggex
      • xendit
      • xero accounting
      • xperiencify
      • xverify
    • Y
      • y.gy
      • yahoo! fantasy sports
      • yanado
      • yelp fusion
      • yepcode
      • yespo
      • yext
      • yoast seo
      • yodiz
      • yoplanning
      • yoprint
      • yotpo loyalty & referrals
      • yotpo reviews & ratings
      • you need a budget
      • youcanbook.me
      • youtube analytics
      • youtube data
      • yumpu
      • yr
    • Z
      • z api
      • zagomail
      • zamzar
      • zenserp
      • zenscrape
      • zenkit
      • zenler
      • zendesk
      • zendesk sell
      • zenventory
      • zep
      • zerobounce
      • zerotier
      • zest
      • zeta (boomtrain)
      • zip archive api
      • zixflow
      • zoho assist
      • zoho analytics
      • zoho bigin
      • zoho billing
      • zoho bookings
      • zoho books
      • zoho bugtracker
      • zoho calendar
      • zoho campaigns
      • zoho catalyst
      • zoho cliq
      • zoho commerce
      • zoho creator
      • zoho crm
      • zoho desk
      • zoho expense
      • zoho fms
      • zoho forms
      • zoho inventory
      • zoho invoice
      • zoho mail
      • zoho meeting
      • zoho notebook
      • zoho people
      • zoho projects
      • zoho recruit
      • zoho salesiq
      • zoho sheet
      • zoho sign
      • zoho sprints
      • zoho survey
      • zoho tables
      • zoho workdrive
      • zonka feedback
      • zoom
      • zoom admin
      • zulip
      • zuora billing
      • zylvie
      • zyte api
  • Guides
Powered by GitBook
On this page
  • Core Concepts
  • 1. Prompting: Giving Instructions
  • 2. Temperature: Controlling Creativity
  • 3. Max Tokens: Limiting Output Length
  • Advanced Feature: JSON Mode
  • How to Use JSON Mode
  • Configuration
  • Input Parameters
  • Example Configuration
  • Output
  • Output Parameter

Was this helpful?

  1. Actions Reference
  2. AI LLM

LLM

A comprehensive guide to the fundamental concepts of working with Large Language Models (LLMs).

The LLM (Large Language Model) Action is the core of most AI-powered workflows in AgenticFlow. It's a general-purpose tool that allows you to send instructions (a "prompt") to a powerful language model to perform a vast range of tasks, from writing emails and summarizing text to analyzing data and making decisions.

This guide covers the fundamental concepts that apply to all LLM actions, regardless of the specific provider (like OpenAI or Anthropic).

Core Concepts

1. Prompting: Giving Instructions

The most critical part of using an LLM is the prompt. This is the set of instructions you give the model. A well-crafted prompt is clear, specific, and provides enough context for the model to understand the desired output.

There are two parts to a prompt:

  • System Prompt: This sets the stage and defines the AI's persona, role, or overall goal. It's the "You are..." part of the instruction.

    • Good Example: You are a helpful and cheerful customer support assistant. Your goal is to answer user questions clearly and provide a single, actionable next step.

  • User Prompt: This is the specific, immediate task you want the model to perform.

    • Good Example: A customer is asking for a refund for order #12345. Please draft a polite email explaining that we can offer store credit.

2. Temperature: Controlling Creativity

Temperature is a number (usually between 0 and 1) that controls the randomness and "creativity" of the model's output.

  • Low Temperature (e.g., 0.2): The model will be more focused, deterministic, and predictable. It will choose the most likely next word, which is great for factual tasks like data extraction, classification, or writing code.

  • High Temperature (e.g., 0.8): The model will be more creative and surprising. It might choose less common words, leading to more diverse and imaginative outputs. This is ideal for brainstorming, writing marketing copy, or other creative tasks.

3. Max Tokens: Limiting Output Length

Max Tokens sets a limit on the length of the model's response. A "token" is a piece of a word (roughly 4 characters for English). Setting this value helps control costs and ensures the output remains concise. If you expect a short answer (like "yes" or "no"), set a low value like 5. If you need a long article, you might set it to 2000 or higher.

Advanced Feature: JSON Mode

Many LLM actions offer a JSON Mode. When you enable this, you are instructing the model to only output valid JSON that conforms to a structure you define in the prompt. This is incredibly powerful for structured data extraction.

How to Use JSON Mode

  1. Enable JSON Mode: Check the "JSON Mode" box in the action's configuration.

  2. Define the Structure in Your Prompt: Your prompt must clearly state that you want JSON output and provide an example of the desired structure.

Example: Extracting Contact Information

  • User Prompt:

    Please extract the name, email, and company from the following text. Respond with ONLY a valid JSON object with the keys "name", "email", and "company".
    
    Text:
    "Hi, this is Jane Doe from ACME Corp. You can reach me at jane.doe@acmecorp.com to discuss the proposal."
  • Guaranteed Output:

    {
      "name": "Jane Doe",
      "email": "jane.doe@acmecorp.com",
      "company": "ACME Corp"
    }

Using JSON mode eliminates the need for messy text parsing in later steps. The output is a clean, structured object ready to be used by other actions like a Google Sheet Action or an API Action.

Configuration

To use the LLM Action, you need to configure its input parameters.

Input Parameters

Parameter
Type
Description

Model

Dropdown

The specific language model you want to use (e.g., Google Gemini 2.0 Flash, gpt-4o-mini). The available models will depend on the connections you have configured.

System Message

Text

An optional instruction that sets the context and persona for the AI. It tells the model how to behave (e.g., "You are a helpful assistant specializing in marketing copy.").

Human Message

Text

This is your prompt. It's the main instruction or question you are giving to the model. You can use variables from previous actions (e.g., {{previous_action.output}}).

Chat History ID

Text

An optional ID to maintain a memory of the conversation across multiple runs. This is crucial for building conversational chatbots.

Temperature

Number

A value from 0 to 1 that controls the randomness of the output. Lower values (e.g., 0.2) make the output more deterministic, while higher values (e.g., 0.8) make it more creative.

Example Configuration

{
  "model": "Google Gemini 2.0 Flash",
  "system_message": "You are a travel expert.",
  "human_message": "What are the top 3 things to see in Paris for a first-time visitor?",
  "temperature": 0.5
}

Output

The LLM Action produces a single output containing the generated text from the model.

Output Parameter

Parameter
Type
Description

content

Text

The text content generated by the model in response to your prompt.

You can reference this output in subsequent actions using a variable, like {{llm_action_name.content}}.

PreviousKnowledge Base SearchNextOpenAI Ask

Last updated 4 days ago

Was this helpful?