<?xml version="1.0" encoding="UTF-8"?><oembed><type>video</type><version>1.0</version><html>&lt;iframe src=&quot;https://www.loom.com/embed/cd05ff3e9dbe4963afdff4dc5de35f0a&quot; frameborder=&quot;0&quot; width=&quot;1280&quot; height=&quot;960&quot; webkitallowfullscreen mozallowfullscreen allowfullscreen&gt;&lt;/iframe&gt;</html><height>960</height><width>1280</width><provider_name>Loom</provider_name><provider_url>https://www.loom.com</provider_url><thumbnail_height>960</thumbnail_height><thumbnail_width>1280</thumbnail_width><thumbnail_url>https://cdn.loom.com/sessions/thumbnails/cd05ff3e9dbe4963afdff4dc5de35f0a-00001.gif</thumbnail_url><duration>155.956</duration><title>IngestFlow : Log Ingestor and Query Tool</title><description>In this video, I provide an overview of the architecture of Log-Insister, which is my submission for the internship ask. I explain the setup of multiple clients making requests to a load-balanced nginx server, and the use of Red Panda for efficient data streaming. I also discuss the role of producer services in ingesting logs to the Red Panda broker, the creation of topics for log ingest, and the consumer service that listens to these topics and sends data to Elasticsearch. I showcase the running services and demonstrate the data entry process. Additionally, I mention future plans to develop the query interface and add a load balancer for reading data from the database.</description></oembed>