support for system prompts in runPrompt

[pelikhan]

• 🦚 Improved system prompt identification in resolveSystems method (in systems.ts file).
  • Refined with word boundary check to prevent partial word matches.
  • For example, earlier 'diff' could have matched 'different', but with this change it will not.
• 🧬 Adjusted handling of system and model options in the context creator (createPromptContext in promptcontext.ts).
  • Now allows a set of system prompts to be executed before the main prompt.
  • System prompts become part of the conversation with their outputs used to supplement the main prompt's output.
• 🔍 Enhanced detection of presence of schema in script source in resolveSystems method
  • Additional check for separated 'defschema' word in the source.
  • Consequential addition of 'system.schema' and 'system.files_schema' to systems if schema usage detected.
• 🔧 Modified expandTemplate function in expander.ts to call the expander for each system in the systems array.
  • Each system's function adds its output (if any) to the overall RunPromptResult for the prompt.
• 🛠 Added the system field to the PromptGeneratorOptions interface in prompt_template.d.ts file.
  • This field is meant to allow system prompts to be specified when calling runPrompt.
• 🏗 Refining error handling in expandTemplate and createPromptContext by replacing some abrupt returns with throwing of descriptive error messages.
• 🖼 If a system prompt produces an image, it throws a NotSupportedError.
• 📄 runprompt.genai.js in the package/sample/genaisrc/style/ directory has been updated to demonstrate a usage of the new system property.
• Two different runPrompt calls are made, one for generating a poem and another for generating JSON. The system option is used in the first call. Each runPrompt has its own label.

generated by pr-describe

[github-actions]

Unused import 'logVerbose'. If it's not being used, it should be removed.

generated by pr-review-commit unused_import

[github-actions]

The visibility of the function 'callExpander' has been changed from private to public. This could potentially expose internal logic and should be reviewed.

generated by pr-review-commit function_visibility_change

[github-actions]

Unused import 'ChatCompletionMessageParam'. If it's not being used, it should be removed.

generated by pr-review-commit unused_import

[github-actions]

The pull request introduces several changes across multiple files. Here are the main points:

1. In chat.ts, logVerbose is being imported from ./util but it's not used anywhere in the file.

2. In expander.ts, there's a change of function definition for callExpander. The function now accepts an additional parameter prj: Project. This function is then being invoked in expandTemplate with prj as the first argument. This modification has also led to changes in the return type of several parts of the code, which are now more structured.

3. In promptcontext.ts, the createPromptContext function is also updated to accept one more parameter prj: Project. This change affects the runPrompt function where now it also takes into account 'system' in runOptions and throws NotSupportedError for several unsupported cases.

4. In systems.ts, there's a change in how systems are resolved. It uses more strict regular expressions to match keywords in jsSource for system identification.

5. In prompt_template.d.ts, a new property system is added to the interface PromptGeneratorOptions.

Concerns:

• Unused import logVerbose in chat.ts may lead to linting warnings.

Suggestions:

--- a/packages/core/src/chat.ts
+++ b/packages/core/src/chat.ts
@@ -8,7 +8,7 @@ import {
     CancellationToken,
     checkCancelled,
 } from "./cancellation"
-import { assert, logError, logVerbose } from "./util"
+import { assert, logError } from "./util"

Overall, this pull request looks good to me (LGTM). 🚀 Please consider the suggestion regarding the unused import.

generated by pr-review