{"type":"video","version":"1.0","html":"<iframe src=\"https://www.loom.com/embed/01fb7c0289d8420f8ae724aad0a6d165\" frameborder=\"0\" width=\"1920\" height=\"1440\" webkitallowfullscreen mozallowfullscreen allowfullscreen></iframe>","height":1440,"width":1920,"provider_name":"Loom","provider_url":"https://www.loom.com","thumbnail_height":1440,"thumbnail_width":1920,"thumbnail_url":"https://cdn.loom.com/sessions/thumbnails/01fb7c0289d8420f8ae724aad0a6d165-f598355c8087952f.gif","duration":1405.408,"title":"GUI Agent_1","description":"This Loom demos a GUI automation agent architecture that logs into the Higgs field platform using a React loop and multi-modal perception. It uses Playwright as the browser and input tool, with OmniParser performing screenshot annotation and OCR, then a Qwen model deciding the next bounding box and whether keyboard input is needed across human-in-the-loop levels. The agent navigates sign-in options, uses a fast-path for safe back or login flows, and requests password and OTP when required for security in a Chromium session. It saves execution logs and ends with a success flag after successful login, with screenshots and reasoning shown during the run."}