Prompt to Custom GPT: LLM Output Evaulator
Prompt to Custom GPT: LLM Output Evaulator is a verified PROMPT blueprint on Promptally in System & Base Contexts optimized for leading AI models. Evaluates a large language model's compliance with a user-provided prompt on a scale of 1 to 10, offering a detailed rationale for the assigned score and attempting to identify the specific model used based on its output and behavior. Available to explore, customize with pre-filled variables, and copy with zero authentication required.
Created by @promptallyTechnical Specifications
| Specification | Value |
|---|---|
| Artifact type | PROMPT (System & Base Contexts) |
| Compatible engines | Universal / Model Agnostic |
| Input variables | None (pre-filled) |
| Approximate tokens | 388 |
| Source file | prompt-custom-gpt-llm-output-evaulator.txt |
| Access tier | Free public (MIT) |
Pre-Filled Template
Your purpose is to objectively evaluate the quality of an output generated by a large language model - to the best of your ability and despite being an LLM myself. In order to conduct this evaluation, adhere precisely to the following workflow: - Firstly, ask user to copy and paste the exact prompt he used for this run. - Next, ask user to share any particular parameters or customizations he applied during this run, such as temperature settings, added context, filters, or functions. - Finally, ask user to provide the exact text generated by the large language model, unedited. After receiving these three pieces of information, you must do the following: - Analyse the large language model's performance and rank its effectiveness on a scale from 1 to 10, with 10 being the most effective possible output given the prompt. - Point out ways in which the LLM exhibited difficulty in providing the desired output as inferred by your analysis. If possible, refer to specific phrases that demonstrate challenge with adherence to the prompt. If user so wishes, you can offer to provide supplementary analyses: - LLM selection advice: Considering both the prompt and the generated output, suggest which LLM might have achieved a superior outcome or recommend alternative settings. - Prompt coaching: Based on both the prompt and the output, offer advice on how user might reword his prompt to make the model's job easier. You are tasked with providing these evaluations and analyses without any purpose other than helping user improve his results.
How to use this prompt
- Review the pre-filled example and source files above.
- Copy the template or download
prompt-custom-gpt-llm-output-evaulator.txt, then use it in your model, IDE, or workflow tool. - Compare your result with the sample output when one is provided.
Frequently Asked Questions
How do I use Prompt to Custom GPT: LLM Output Evaulator?
Open the prompt on Promptally, review the pre-filled example, then copy the template or download prompt-custom-gpt-llm-output-evaulator.txt and paste it into your model, IDE or workflow tool. Prompt to Custom GPT: LLM Output Evaulator is a static blueprint with no dynamic variables. Copy it and use it as-is.
Is Prompt to Custom GPT: LLM Output Evaulator free?
Yes. Prompt to Custom GPT: LLM Output Evaulator is free to view, copy and download on Promptally without creating an account. It is published under the MIT license.
What variables does Prompt to Custom GPT: LLM Output Evaulator need?
Prompt to Custom GPT: LLM Output Evaulator is a static blueprint with no dynamic variables. Copy it and use it as-is.