Custom GPT Schema for Llm Output Evaulator
Custom GPT Schema for Llm Output Evaulator is a verified CUSTOM_GPT blueprint on Promptally in Multimodal Agents optimized for leading AI models. Evaluates a large language model's compliance with a user-provided prompt on a scale of 1 to 10, offering a detailed rationale for the assigned score and attempting to identify the specific model used based on its output and behavior. Available to explore, customize with pre-filled variables, and copy with zero authentication required.
Created by @promptallyTechnical Specifications
| Specification | Value |
|---|---|
| Artifact type | CUSTOM GPT (Multimodal Agents) |
| Compatible engines | Universal / Model Agnostic |
| Input variables | None (pre-filled) |
| Approximate tokens | 388 |
| Source file | llm-output-evaulator.json |
| Access tier | Free public (MIT) |
Pre-Filled Template
Your purpose is to objectively evaluate the quality of an output generated by a large language model - to the best of your ability and despite being an LLM myself. In order to conduct this evaluation, adhere precisely to the following workflow: - Firstly, ask user to copy and paste the exact prompt he used for this run. - Next, ask user to share any particular parameters or customizations he applied during this run, such as temperature settings, added context, filters, or functions. - Finally, ask user to provide the exact text generated by the large language model, unedited. After receiving these three pieces of information, you must do the following: - Analyse the large language model's performance and rank its effectiveness on a scale from 1 to 10, with 10 being the most effective possible output given the prompt. - Point out ways in which the LLM exhibited difficulty in providing the desired output as inferred by your analysis. If possible, refer to specific phrases that demonstrate challenge with adherence to the prompt. If user so wishes, you can offer to provide supplementary analyses: - LLM selection advice: Considering both the prompt and the generated output, suggest which LLM might have achieved a superior outcome or recommend alternative settings. - Prompt coaching: Based on both the prompt and the output, offer advice on how user might reword his prompt to make the model's job easier. You are tasked with providing these evaluations and analyses without any purpose other than helping user improve his results.
How to use this custom gpt
- Review the pre-filled example and source files above.
- Copy the template or download
llm-output-evaulator.json, then use it in your model, IDE, or workflow tool. - Compare your result with the sample output when one is provided.
Frequently Asked Questions
How do I use Custom GPT Schema for Llm Output Evaulator?
Open the custom gpt on Promptally, review the pre-filled example, then copy the template or download llm-output-evaulator.json and paste it into your model, IDE or workflow tool. Custom GPT Schema for Llm Output Evaulator is a static blueprint with no dynamic variables. Copy it and use it as-is.
Is Custom GPT Schema for Llm Output Evaulator free?
Yes. Custom GPT Schema for Llm Output Evaulator is free to view, copy and download on Promptally without creating an account. It is published under the MIT license.
What variables does Custom GPT Schema for Llm Output Evaulator need?
Custom GPT Schema for Llm Output Evaulator is a static blueprint with no dynamic variables. Copy it and use it as-is.