Components All New MacOS Windows Linux iOS
Examples Mac & Win Server Client Guides Statistic FMM Blog Deprecated Old

Component: Llama

Use llama.cpp in FileMaker to run LLM models locally.

Version macOS Windows Linux Server iOS SDK
16.1 ✅ Yes ✅ Yes ✅ Yes ✅ Yes ✅ Yes

Item Details
Llama.Backends   New in 16.1
Queries the backends available. 		All
16.1
Llama.Chat   New in 16.1
Sends a chat messages to the model. 		All
16.1
Llama.ChatBuiltinTemplates   New in 16.1
Queres the list of built-in template names. 		All
16.1
Llama.ClearTranscript   New in 16.1
Clears the current transcript. 		All
16.1
Llama.CloseContext   New in 16.1
Closes the context. 		All
16.1
Llama.CloseModel   New in 16.1
Closes the current model. 		All
16.1
Llama.CloseSampler   New in 16.1
Closes the current sampler. 		All
16.1
Llama.ContextAvailable   New in 16.1
Queries context memory available. 		All
16.1
Llama.ContextUsed   New in 16.1
Queries context memory used. 		All
16.1
Llama.Detokenize   New in 16.1
Convert the provided tokens into text (inverse of llama_tokenize()). 		All
16.1
Llama.InitSampler   New in 16.1
Initializes the sampler chain. 		All
16.1
Llama.List   New in 16.1
Lists all the current llama identifiers. 		All
16.1
Llama.LoadLibrary   New in 16.1
Loads the library. 		All
16.1
Llama.LoadModel   New in 16.1
Load the model from a file. 		All
16.1
Llama.Loaded   New in 16.1
Whether the library is loaded. 		All
16.1
Llama.ModelChatTemplate   New in 16.1
Queries the chat template text for the model. 		All
16.1
Llama.ModelMetadata   New in 16.1
Queries the metadata for a model. 		All
16.1
Llama.ModelSize   New in 16.1
Queries the model size. 		All
16.1
Llama.New   New in 16.1
Creates a new session. 		All
16.1
Llama.Query   New in 16.1
Runs a text through the model. 		All
16.1
Llama.Release   New in 16.1
Releases the session. 		All
16.1
Llama.ReleaseAll   New in 16.1
Releases all sessions. 		All
16.1
Llama.StartContext   New in 16.1
Initializes a context. 		All
16.1
Llama.Tokenize   New in 16.1
Convert the provided text into tokens. 		All
16.1
Llama.Transcript   New in 16.1
Queries the transcript. 		All
16.1
Llama.TranscriptJSON   New in 16.1
Queries the transcript as JSON. 		All
16.1

26 functions shown.

Release notes

  • Version 16.1
    • Added Llama functions to load local large language models to query them.

Blog Entries

Example Databases