Explore CI/CD Pipeline Integration - Allowing end users to score their apps in CI

[dllewellyn]

Objective

Give then Prompt Defender has an endpoint (/score) which will take a 'prompt' and return a json response indicating the prompt score for its security, we want to look at what the options are for allowing people to run this as part of their CI/CD pipelines - this will allow people to have some level of assurance whenever they update their prompts that the updated prompt is still secure

We need to explore different ways of integrating the PromptDefender application into a CI/CD pipeline so it can be used as part of someone's CI/CD process. There's a few options for setup.

Create a github application

• Create a github 'application' which users can install onto their profile and configure

GitHub Authentication and Webhooks:

• Explore the use of GitHub authentication for secure CI/CD processes.
• Implement webhooks to trigger automated testing workflows.
• This means that the cloning etc will happen on our servers rather than CI servers most likely

Custom GitHub Action:

• Investigate how to create and use a custom GitHub Action for the automated testing pipeline which can be deployed into the github actions store.

Other things we need to work out

• How someone configures this - e.g. how do you determine which file contains a prompt.
• Authentication integration so someone can set up an account and - likely don't want security vulnerabilities in public PRs