no code implementations • 30 Apr 2024 • Nicholas S. Kersting, Mohammad Rahman, Suchismitha Vedala, Yang Wang
We introduce an intuitive method to test the robustness (stability and explainability) of any black-box LLM in real-time, based upon the local deviation from harmoniticity, denoted as $\gamma$.