Integrate RAGAS for Report Quality Evaluation

implementationChallengeNovember 25, 2025

Prompt Content

Develop a reporting module that leverages RAGAS. After the LLM agent runs a simulation and gathers data, it should generate a narrative summary report of the robot's performance, identified issues, and potential optimizations. Use RAGAS to evaluate the quality, coherence, and factual accuracy of this LLM-generated report based on the raw simulation logs. Provide example code for how RAGAS will be integrated and what specific metrics it will track (e.g., faithfulness, answer relevance).

Usage Tips

Copy the prompt and paste it into your preferred AI tool (Claude, ChatGPT, Gemini)

Customize placeholder values with your specific requirements and context

For best results, provide clear examples and test different variations