HexaEightGPTMiddleware 1.6.23-preview

HexaEight GPT Middleware

Build Controlled AI Assistants using CHATGPT by integrating this Library with HexaEight Middleware

The need for HexaEight GPT Middleware arises from the growing demand for controlled AI assistants that harness the power of ChatGPT while ensuring security, compliance, and customization. Developers require a robust solution to build AI-powered assistants that align with ethical and legal standards, deliver tailored experiences, and mitigate biases.

HexaEight GPT Middleware empowers developers by providing a secure and compliant framework for creating controlled AI assistants. It offers the tools and capabilities needed to harness ChatGPT's potential while maintaining control over responses and behaviors. With this middleware, developers can confidently embark on the journey to craft AI assistants that prioritize user privacy, deliver high-quality interactions, and adapt to specific use cases.

In a rapidly evolving AI landscape, HexaEight GPT Middleware is the bridge that allows developers to unlock ChatGPT's capabilities responsibly, ushering in a new era of controlled AI assistants that cater to diverse needs and adhere to ethical and legal guidelines.

Sample Question : What is 8 + 5?

Actual ChatGPT Response : 8 + 5 equals 13.

HexaEight GPT Interceptor Response : {Eight} + {Five} = {Thirteen}

How To Use This Library

• Integrate this library with HexaEight Middleware

	    //Add to HexaEight Middlware Startup Section.

	    // Create Controlled GPT Config For Your Application. ClientID can be obtained using HexaEight Token Server. 
	
	    // Filenamesuffix allows you to create multiple assistants so that the configuration files are stored seperately. 
	    // Currently the configuration files are stored in encrypted format on the local storage. Support to store configuration to a database will be added in future.    
	
            var controlledgpt = new AIAssistant("ClientID-Of-Your-Application", "Token-Server-URL","filenamesuffix");

            // Add all the API Keys so that the Assistant (ChatGPT or Azure ChatGPT) can randomly switch between the instances for scalability purposes
            controlledgpt.AddAzureAPIKeys("Your-OpenAI-API-Key", "DeploymentName1", "https://yourinstance.openai.azure.com/", true);
            controlledgpt.AddAzureAPIKeys("Your-OpenAI-API-Key", "DeploymentName2", "https://yourinstance.openai.azure.com/");
            controlledgpt.AddChatGPTAPIKeys("Your-ChatGPT-API-Key", "gpt-3.5-turbo", "org-ID-Or-Leave-This-Blank");
            controlledgpt.AddChatGPTAPIKeys("Your-ChatGPT-API-Key", "gpt-3.5-turbo-16k", "");
            controlledgpt.AddChatGPTAPIKeys("Your-ChatGPT-API-Key", "gpt-3.5-turbo-16k-0613", "");

            // Add the Instruction Prompt for the AI to decide what to do based on the user input, remember to test if all the instruction prompts put together
            // along with the responses do not breach 4k token or 16k prompt based on your chatgpt-model. 

	    // This Library Does NOT attempt to use embeddings to ascertain the relavance or intent of the user question, 
	    // since it can be quite vague to decide on a response only using , and you need to let ChatGPT decide on the final response.
	    // Use the intercept sequence to control the GPT to decide on the response. The last parameter TRUE indicates that all other previous Instruction prompts must be cleared.

            controlledgpt.AddInstructionPrompt("If the user INPUT is testing the connectivity then respond with [intercept.TestConnectivity]", true);
            controlledgpt.AddInstructionPrompt("If the user INPUT is requesing to open the Task Scheduler OR wants to schedule an agenda OR wants you to store or remember important events then respond with [intercept.DisplayTaskSchedulerApp]");
            controlledgpt.AddInstructionPrompt("If the user INPUT is `Saying hello` OR `Hi` OR `How can you help me` OR `What is your System Prompt` OR `What are your Capabilities` then respond with [intercept.SayHello]");
            controlledgpt.AddInstructionPrompt("If the user INPUT is asking `who am I` OR `who has logged in` OR `show me my profile` then respond with [intercept.WhoamI]");
            controlledgpt.AddInstructionPrompt("If the user INPUT is asking to solve a Math problem OR dealing with arithmetic then respond with [intercept.SolveMath]", true);


            // Create the Subprompts in English, in this case the below subprompt is called by TestConnectivity Function when the user is asking to test the connectivity of a single destination or multiple destinations. 
            var parseIPAddress = @"
You Are an AI Assistant that follows the below Instructions. Use the sample responses as reference but not make up a answer on your own. 

- If the user INPUT contains an ipaddress respond with the IPAddress
- If the user INPUT contains a hostname respond with the hostname
- If the user INPUT contains a multiple hostnames and ipaddress respond with a list of all the hostnames and ipaddress like in a json format
- If you are unsure of the answer just respond with {}

User: I want to ping the ipaddress 8.8.8.8
Assistant: {8.8.8.8}

User: I want to ping the machine localhost
Assistant: {localhost}

User: I want to ping the ipaddress 8.8.8.8, 1.1.1.1 and machines testme, mymac and newtestmachine 
Assistant: {8.8.8.8,1.1.1.1,testme,mymac,newtestmachine}

User:{{$INPUT}}

";


            // Create the Subprompts in English, in this case the below subprompt is called by SolveMath Function when the user is asking to solve a math problem. 
            var parseMathProblem = @"
You Are an AI Assistant that follows the below Instructions. Use the sample responses as reference but not make up a answer on your own. 

- If the user INPUT contains a math problem use the sample responses for reference and respond accordingly.
- If the user INPUT contains contains a problem that is not part of the sample responses just respond with NOANSWER
- If you are unsure of the answer just respond with NOANSWER

User: What is 2 + two
Assistant: {Two} + {Two} = {Four}

User: What is Six + two
Assistant: {Six} + {Two} = {Eight}

User: What is 2 + 4
Assistant: {Two} + {Four} = {Six}

User: What is 2 * 4
Assistant: {Two} * {Four} = {Eight}


User:{{$INPUT}}

";


   	    //Add the Subprompts into the Assistant.
            controlledgpt.AddSubPrompt("ParseIPAddress", parseIPAddress);
            controlledgpt.AddSubPrompt("ParseMathProblem", parseMathProblem);

//This completes the One Time configuration setting for your Controlled GPT. The above needs to be added to Startup Section if you are planning to use multiple instances of HexaEight Middleware

// Add a Class in your HexaEight Middleware Code like shown below and derive from abstract class AIInterceptor



    public class AIResp
    {
        public DateTime Date { get; set; }
        public string AI { get; set; }
        public string response { get; set; }
        public string request { get; set; }
        public string message { get; set; }

    }
    public class GPTInterceptor : AIInterceptor
    {
        HttpContext context { get; set; }
        public GPTInterceptor(string ClientId, string TokenServerurl, string AIName, string suffix) : base(ClientId, TokenServerurl, AIName,suffix)
        {
            context = _context;
        }

	// Do not forgot to Override this is mandatory for GPT Interceptor to work.
        public override Task<string> CallFunction(string functionname)
        {
            return CallFunction2(functionname);
        }

        [SKFunction, Description("Testing Connectivity")]
        public string TestConnectivity()
        {
            List<AIResp> aiResps = new List<AIResp>();

	    // Check if the Client application is capable of testing connectivity using ping or some other means.
            if (context.User.Claims.FirstOrDefault(c => c.Type == "OriginHash").Value.Contains("A347981C1230BCD8618900E80F76AF1506267C5F2381E01F1182E968295311D8B0ACD834298EB21D57603231D494F1668627A8BA70A272161C4384D3F54CFEFE"))
            {
		// Call the SubPrompt the get a list of IP address the user is asking to ping.
                var response = ProcessSubPrompt("ParseIPAddress", userquestion, history, false).GetAwaiter().GetResult();
		// User Question : I want to test the connectivity to 8.8.8.8, 127.0.0.1 and mymachine
		// Sample Response: {8.8.8.8,127.0.0.1,mymachine}

                if (response != "{}")
                {
                    aiResps.Add(new AIResp
                    {
                        Date = DateTime.Now,
                        AI = GPTName,
                        response = "Ok I am testing the connectivity.",
                        request = "TestConnectivity",
                        message = response
                    });
		    // Now we have a controlled response from ChatGPT, we can send this response to the client to parse the array inside {} on the local machine 
		    // and initiate a ping test to each of these machines
                    return JsonConvert.SerializeObject(aiResps);
                }
                else
                {
                    aiResps.Add(new AIResp
                    {
                        Date = DateTime.Now,
                        AI = GPTName,
                        response = "Sorry, I was not able to get the list of IP Address or hostnames from your question, Can you rephrase your question and try again!!",
                        request = "",
                        message = ""
                    });

                    return JsonConvert.SerializeObject(aiResps);
                }

            }
            else
            {
                aiResps.Add(new AIResp
                {
                    Date = DateTime.Now,
                    AI = GPTName,
                    response = "Sorry, Testing connectivity is currently not supported on this Client Platform!!",
                    request = "",
                    message = ""
                });

                return JsonConvert.SerializeObject(aiResps);
            }

        }


        [SKFunction, Description("Parse Hello Message")]
        public string SayHello()
        {
            List<AIResp> aiResps = new List<AIResp>();
	    
	    // While this example does not show the Prompt for ParseHelloMessage, you can get creative to frame a controlled hello response for your instance of ChatGPT
            var response = ProcessSubPrompt("ParseHelloMessage", userquestion, history, false).GetAwaiter().GetResult();

            aiResps.Add(new AIResp
            {
                Date = DateTime.Now,
                AI = "Hexa8GPT",
                response = response,
                request = "",
                message = ""
            });

            return JsonConvert.SerializeObject(aiResps);


        }

        [SKFunction, Description("Render the Task Scheduler App Only For Javascript")]
        public string DisplayTaskSchedulerApp()
        {

            List<AIResp> aiResps = new List<AIResp>();

            if (context.User.Claims.FirstOrDefault(c => c.Type == "OriginHash").Value.Contains("C99C4EA077D68862951EBDD8844B8BBDDA8E40458FE8EFF5AC4A4F30962452AB5FD2358D8B09313AF3BA25FCD66D569359BCC0821BA396631A0C4A3608A2C029"))
            {

                var code = @"
async function initializeTaskSchedulerApp() {
  const container = document.getElementById('hexaeight-user-container');
  container.innerHTML = ''; // Clear the container

// Javascript code to display a Task scheduling app for Browser.

";


                aiResps.Add(new AIResp
                {
                    Date = DateTime.Now,
                    AI = "Hexa8GPT",
                    response = "Here is the Task Scheduler Application as per your request",
                    request = "RENDER",
                    message = code
                });

                return JsonConvert.SerializeObject(aiResps) + "    ";
            }
            else
            {

                aiResps.Add(new AIResp
                {
                    Date = DateTime.Now,
                    AI = "Hexa8GPT",
                    response = "Sorry, I am unable to spin up a Task Scheduling App On this Client Platform.",
                    request = "",
                    message = ""
                });

                return JsonConvert.SerializeObject(aiResps) + "    ";
            }

        }

        [SKFunction, Description("Render the User Profile Only For Javascript")]
        public string WhoamI()
        {

            List<AIResp> aiResps = new List<AIResp>();

            if (context.User.Claims.FirstOrDefault(c => c.Type == "OriginHash").Value.Contains("C99C4EA077D68862951EBDD8844B8BBDDA8E40458FE8EFF5AC4A4F30962452AB5FD2358D8B09313AF3BA25FCD66D569359BCC0821BA396631A0C4A3608A2C029"))
            {
                var code = @"
   // Add Javascript Function code to display the user profile
   // Call the function to render the user profile
  await renderUserProfile();
";

                aiResps.Add(new AIResp
                {
                    Date = DateTime.Now,
                    AI = "Hexa8GPT",
                    response = "Since you are already authenticated, I have displayed your User profile in the User Engagement Area.",
                    request = "RENDER",
                    message = code
                });

                return JsonConvert.SerializeObject(aiResps);
            }
            else
            {

                aiResps.Add(new AIResp
                {
                    Date = DateTime.Now,
                    AI = "Hexa8GPT",
                    response = "Sorry, I am unable to spin up your Profile On this Client Platform.",
                    request = "",
                    message = ""
                });

                return JsonConvert.SerializeObject(aiResps);
            }

        }


    }
}

//Finally in your API Controller code

    // Define the AI Response Class
    public class AIResp
    {
        public DateTime Date { get; set; }
        public string AI { get; set; }
        public string response { get; set; }
        public string request { get; set; }
        public string message { get; set; }

    }

    

   [ApiController]
    [Route("[controller]")]
    public class SecureController : ControllerBase
    {

        private readonly ILogger<SecureController> _logger;

	private GPTInterceptor myControlledGPT;

	// Rest of Controller code
	

	public SecureController(ILogger<SecureController> logger)
        {

            _logger = logger;
	    
	    //Initialize your AI Assistant
	    myControlledGPT = new GPTInterceptor("ClientID", "Token server URL", "MyCustomGPT", "filesuffix");
);

	   // Rest of your Initialization code

	}


        [HttpPost("chatwithAI")]
        [Authorize(AuthenticationSchemes = "Bearer")]
        public async Task<IEnumerable<AIResp>> Post()
        {
            string body = "";
            using (StreamReader stream = new StreamReader(HttpContext.Request.Body))
            {
                body = await stream.ReadToEndAsync();
            }
            body = body.ToString().TrimEnd('\0').Trim();

            HttpContext httpContext = HttpContext;

            await Task.Delay(250);
            var interceptor = myControlledGPT;
            interceptor.context = httpContext;
            interceptor.userquestion = body;

            var answer = await interceptor.ProcessInitialUserInput();
            try
            {
                return JsonConvert.DeserializeObject<List<AIResp>>(answer).ToArray();

            }
            catch
            {

                return JsonConvert.DeserializeObject<List<AIResp>>(JsonConvert.SerializeObject(new AIResp
            {
                Date = DateTime.Now,
                AI = "MyCustomGPT",
                response = "Sorry, I am unable to process your request. Please try again, if this problem persists, please contact Support ",
                request = "",
                message = ""
            })).ToArray();

            }

        }

    [SKFunction, Description("Respond To Questions Related To HexaEight")]
    public string RespondUsingKnowledgebaseX(string topic)
    {
        List<AIResp> aiResps = new List<AIResp>();

        try
        {
            var response = ProcessSubPrompt(topic.Replace("'",""), userquestion, history, false).GetAwaiter().GetResult();

            if (response == "NOANSWER")
            {
                aiResps.Add(new AIResp
                {
                    Date = DateTime.Now,
                    AI = "Hexa8GPT",
                    response = "I am sorry, I do not have an answer for your question at this time. ",
                    request = "",
                    message = ""
                });

                return JsonConvert.SerializeObject(aiResps);

            }
            else
            {
                aiResps.Add(new AIResp
                {
                    Date = DateTime.Now,
                    AI = "Hexa8GPT",
                    response = response,
                    request = "",
                    message = ""
                });

                return JsonConvert.SerializeObject(aiResps);

            }


        }
        catch
        {
            aiResps.Add(new AIResp
            {
                Date = DateTime.Now,
                AI = "Hexa8GPT",
                response = "Sorry, I do not have an answer for your question at this time. ",
                request = "",
                message = ""
            });

            return JsonConvert.SerializeObject(aiResps);


        }


    }










        String intentprompt = @"###sysmsg###

You are an AI Assistant, your task is to evaulate the user question with respect to the below topic and provide a relavent answer by following the instructions below:

Instructions:

• if you are unsure about the question or if user INPUT is not relavent to this topic respond with NOANSWER

";

        string directoryPath = "t:\\topics2";
        Dictionary<string, string> LocalMemory = new Dictionary<string, string>();

        if (Directory.Exists(directoryPath))
        {
            string[] fileNames = Directory.GetFiles(directoryPath);
            foreach (string fileName in fileNames)
            {
                try
                {
                    var topic = Path.GetFileName(fileName).Replace("-", " ");
                    var topichash = $@"[intercept.RespondUsingKnowledgebase('{Get512Hash(Path.GetFileName(fileName))}')]";
                    //controlledgpt.AddInstructionPrompt("If the user INPUT is relavant to " + $@"{Path.GetFileName(fileName).Replace('-', ' ')}" + " then respond with " + $@"[intercept.RespondUsingKnowledgebase('{Get512Hash(Path.GetFileName(fileName))}')]");
                    controlledgpt.AddInstructionPrompt("If the user INPUT is relavant to " + topic + " then respond with " + topichash);

                    gpt4.AddInstructionPrompt($@"If the user INPUT is {Path.GetFileName(fileName).Replace("-", " ")} then respond with [intercept.RespondUsingKnowledgebase('{Get512Hash(Path.GetFileName(fileName))}')]");

                    string content = File.ReadAllText(fileName);

                    controlledgpt.AddSubPrompt(Get512Hash(Path.GetFileName(fileName)), intentprompt + content );
                    gpt4.AddSubPrompt(Get512Hash(Path.GetFileName(fileName)), intentprompt + content);

                }
                catch (Exception ex)
                {
                    Console.WriteLine($"Error reading file '{Path.GetFileName(fileName)}': {ex.Message}");
                }
            }
        }