{"type":"video","version":"1.0","html":"<iframe src=\"https://www.loom.com/embed/4bc278914c774bf1bb1fd688f85e55cd\" frameborder=\"0\" width=\"1920\" height=\"1440\" webkitallowfullscreen mozallowfullscreen allowfullscreen></iframe>","height":1440,"width":1920,"provider_name":"Loom","provider_url":"https://www.loom.com","thumbnail_height":1440,"thumbnail_width":1920,"thumbnail_url":"https://cdn.loom.com/sessions/thumbnails/4bc278914c774bf1bb1fd688f85e55cd-03ba10990e22195f.gif","duration":5108.9458,"title":"Exploring AI Monitoring and Evaluation Tools for Developers","description":"In this video, I discussed the exciting opportunity to explore AI tools like Clockcode, which offers $1,000 in free credits for research and development. We delved into the importance of monitoring AI systems, particularly for small businesses and nonprofits looking to implement chatbots and other AI solutions. I introduced three evaluation tools—DeepEval, Ragus, and Decex—that help assess the accuracy and reliability of AI responses. I encouraged everyone to experiment with Ragus, adding examples of both high and low faithfulness responses to enhance our understanding of AI alignment. Please make sure to run the evaluations and share your findings!"}