Fully Formatted Facts

A recent discovery by programmer and inventor Michael Calvin Wood is addressing a persistent challenge in AI: hallucinations. These false or misleading outputs, long considered an inherent flaw in large language models (LLMs), have posed a significant issue for developers. However, Wood’s breakthrough is challenging this assumption, offering a solution that could transform how AI-powered applications are built and used.

Thank you for reading this post, don't forget to subscribe!

The Importance of Wood’s Discovery for Developers

Wood’s findings have substantial implications for developers working with AI. By eliminating hallucinations, developers can ensure that AI-generated content is accurate and reliable, particularly in applications where precision is critical.

Understanding the Root Cause of Hallucinations

Contrary to popular belief, hallucinations are not primarily caused by insufficient training data or biased algorithms. Wood’s research reveals that the issue stems from how LLMs process and generate information based on “noun-phrase routes.” LLMs organize information around noun phrases, and when they encounter semantically similar phrases, they may conflate or misinterpret them, leading to incorrect outputs.

How LLMs Organize Information

For example:

When asked about magnesium, an AI might provide information about calcium, due to their semantic similarity in the model’s training data.
In language translation, tools like Google Translate may confuse meanings for words like “pen” (writing instrument vs. animal enclosure) because the same word is used for both concepts.

The Noun-Phrase Dominance Model

Wood’s research led to the development of the Noun-Phrase Dominance Model, which posits that neural networks in LLMs self-organize around noun phrases. This model is key to understanding and eliminating hallucinations by addressing how AI processes noun-phrase conflicts.

Fully-Formatted Facts (FFF): A Solution

Wood’s solution involves transforming input data into Fully-Formatted Facts (FFF)—statements that are literally true, devoid of noun-phrase conflicts, and structured as simple, complete sentences. Presenting information in this format has led to significant improvements in AI accuracy, particularly in question-answering tasks.

How FFF Processing Works

While Wood has not provided a step-by-step guide for FFF processing, he hints that the process began with named-entity recognition using the Python SpaCy library and evolved into using an LLM to reduce ambiguity while retaining the original writing style. His company’s REST API offers a wrapper around GPT-4o and GPT-4o-mini models, transforming input text to remove ambiguity before processing it.

Current Methods vs. Wood’s Approach

Current approaches, like Retrieval Augmented Generation (RAG), attempt to reduce hallucinations by adding more context. However, these methods often introduce additional noun-phrase conflicts. For instance, even with RAG, ChatGPT-3.5 Turbo experienced a 23% hallucination rate when answering questions about Wikipedia articles. In contrast, Wood’s method focuses on eliminating noun-phrase conflicts entirely.

Results: RAG FF (Retrieval Augmented Generation with Formatted Facts)

Wood’s method has shown remarkable results, eliminating hallucinations in GPT-4 and GPT-3.5 Turbo during question-answering tasks using third-party datasets.

Real-World Example: Translation Error Elimination

Consider a simple translation example:

Original text: “Where’s the chicken? Is it in the pen?”
Google Translate: [Incorrect due to ambiguity of “pen”]
Fully-Formatted Fact: “Where’s the chicken? Is the chicken in the animal enclosure?”
Google Translate: [Correct translation with no ambiguity]

This transformation eliminates hallucinations by removing the potential noun-phrase conflict.

Implications for the Future of AI

The Noun-Phrase Dominance Model and the use of Fully-Formatted Facts have far-reaching implications:

Increased Reliability: AI systems can be developed with greater accuracy, opening up opportunities in fields like healthcare, law, and finance.
Improved Efficiency: By focusing on input formatting rather than model size, this approach could lead to more efficient AI systems that require less computational power.
Broader Access to Accurate AI: As this technique matures, it may enable the creation of highly accurate AI systems that can run on smaller devices.

Roadmap for Future Development

Wood and his team plan to expand their approach by:

Developing converters for various document types, including social media posts and research studies.
Creating specialized converters for domains such as law and finance.
Adapting the method to work with smaller AI models, potentially leading to a mobile LLM with 100% accuracy.

Conclusion: A New Era of Reliable AI

Wood’s discovery represents a significant leap forward in the pursuit of reliable AI. By aligning input data with how LLMs process information, he has unlocked the potential for accurate, trustworthy AI systems. As this technology continues to evolve, it could have profound implications for industries ranging from healthcare to legal services, where AI could become a consistent and reliable tool.

While there is still work to be done in expanding this method across all AI tasks, the foundation has been laid for a revolution in AI accuracy. Future developments will likely focus on refining and expanding these capabilities, enabling AI to serve as a trusted resource across a range of applications.

Experience RAGFix

For those looking to explore this technology, RAGFix offers an implementation of these groundbreaking concepts. Visit their official website to access demos, explore REST API integration options, and stay updated on the latest advancements in hallucination-free AI:

Visit RAGFix.ai