The goal of project Monocle is to help GenAI developer to trace their applications. A typical GenAI application comprises of several technology components like application code/workflow, models, inferences services, vector databases etc. Understanding the dependencies and tracking application quickly becomes a difficult task. Monocle can be integrated into application code with very little to no code changes. Monocle supports tracing all GenAI technology components, application frameworks, LLM hosting services. The project finds what needs to be instrumented and how to instrument it, and thereby enables the enlightened applications to generate detailed traces without any additional efforts from the developers.
Monocle was contributed to LF AI & Data foundation by Okahu, Inc. as a Sandbox-stage project in June 2024.