AI Engineer World's Fair 2026
AI-Driven Multi-Document Correlation for Enterprise Financial Compliance and Fraud Detection
About this talk
Varsha Shah presents a research-driven framework for detecting financial compliance risks and fraud across payroll, tax, procurement, and transaction records. The approach combines graph-based entity correlation, probabilistic risk modeling, and cross-jurisdictional normalization, then incorporates investigator feedback to refine risk scoring. Shah reports evaluation on approximately three million financial records spanning five years and four jurisdictions, with an F1 score of 0.89, and outlines integration with enterprise and audit systems.
Chapters
- 0:04Speaker introduction and the multi-document compliance problem
- 1:18Framework overview and limitations of document-level NLP
- 4:53Architecture and cross-jurisdictional normalization
- 9:48Evaluation dataset and reported F1 score
- 13:52Continuous learning and investigator feedback
- 15:53Enterprise deployment and closing perspective
Talk transcript
- 0:04
Hello, everyone. Um, thank you to the AI Engineering, uh, World's Fair, uh, team for providing this wonderful opportunity to share my research. It is truly an honor to be speaking alongside so many talented researchers and practitioners.
- 0:18
My name is Varsha Shah. Uh, I am an enterprise technical architect working at Tata Consultancy Services, working for Microsoft. Um, I'm focused on artificial intelligence, enterprise, uh, compliance, finance governance, and intelligent automation.
- 0:34
Today, I would like to share my research on AI-driven multi-document correlation for enterprise financial compliance and fraud detection. Uh, as organizations continue to digitalize their operations today, they generate a numerous amount of data, um, for the financial system across payroll, tax, procurement, transaction system.
- 0:56
Ironically, uh, while we have more data than ever before, compliance teams continue to struggle with hidden fraud patterns, regulatory risk. The reason is the most ex-existing solution analyze the documents independently, while many of the most critical risk only become visible when the information is connected across the multiple systems.
- 1:18
In this presentation, I'll introduce you to a framework that combines the graph-based entity, uh, correlation, probabilistic risk modeling, and cross-jurisdictional normalization to uncover these hidden relationships and transform enterprise compliance from reactive process into proactive intelligence capability.
- 1:38
The framework was, uh, evaluated using approximately, uh, three million financial records across four jurisdictional, uh, demonstrating both the strong detection performance and meaningful operations improvement. With that context, let's begin, uh, by looking at the compliance gap that organizations continue to face today.
- 2:01
Let's begin by understanding the compliance gap that many organizations continue to face. Enterprise compliance has become significantly more complex over the last decade. Organizations now operate across multiple countries, regulatory frameworks, and financial system, each with own reporting standards and compliance requirements.
- 2:20
At the same time, the volume of the enterprise has grown exponentially. Payroll records, tax filings, procurement transaction, and financial documents are generated every day, making manual reviews both time-consuming and increasingly, uh, impractical.
- 2:38
Adding to this challenge, fraud has been evolved. Modern fraud rarely appears as an, um, obvious error within a single document. Instead, it, uh, exploits subtle, uh, inconsistency across multiple system, patterns that often remain invisible when the records are reviewed independently.
- 2:59
This creates a fundamental limitation. Traditional, uh, rule-based and document-level NLP system are designed to validate individual records, but they are not built to understand relationship across the documents.
- 3:14
And that's the gap this research aims to address, moving beyond this isolated document analysis to uncover the hidden risk through the cross-document correlation. To better understand this limitation, let's look at why traditional document, uh, level analysis often fail to detect the most sophisticated fraud patterns.
- 3:37
To understand why traditional approaches struggle, let's consider how most compliance system operates, uh, nowadays. They evaluate each document independently. A payroll register is, uh, validated against the payroll rules.
- 3:51
The vendor invoices are checked against the procurement policies. A tax filings is reviewed under the tax, uh, regulations. If each document passes its individual validation, the transaction is generally considered compliant.
- 4:05
The challenge is that many sophisticated fraud patterns doesn't, um, really appear within a single document. They emerges only when the multiple documents are analyzed together. For example, a payroll record may appear accurate to us.
- 4:19
A, um, vendor invoice may seem legitimate to us. A tax filing, uh, may be correctly, uh, submitted. But when these records are connected, they are revealing the inconsistencies and indicate the fraud and compliance risk.
- 4:34
The information already exist. What missing is the ability to understand the relationship between these documents. That is why the research shifts the focus from document-level validation to cross-document intelligence, enabling the organizations to detect the risk that would, um, otherwise remain hidden.
- 4:53
So if the problem is understanding relationships rather than individual documents, what kind of architecture can solve this? Let me introduce you to the framework.
- 5:05
Now that we have established the problem, let's look at the proposed framework. Rather than relying on a single model or algorithm, the solution is built on three, um, complementary components that work together to transform the raw enterprise data into the actionable compliance intelligence.
- 5:22
The first component is the entity correlation engine. It, uh, the, the purpose of this is to connect the related information across the payroll, tax, procurement, financial systems, creating a unified view of, uh, enterprise activity rather than isolated records.
- 5:39
Once these relationships are established, the second component, that is adaptive probabilistic risk model eva- which is, which evaluates the connected data to determine which pattern represent meaningful compliance. Instead of, uh, generating alerts based on single rule, it, uh, it prioritize the cases using the multiple risk si-signals here.
- 6:03
Uh, the cross-jurisdictional normalization layer provides the regulatory context by, uh, standardizing the currency, tax structure, reporting standards, uh, and compliance rules across the different jurisdictions. This ensures that the risks are evaluated consistently, regardless of where the transaction originated.
- 6:24
So individually, each component provides a value. Together, they enable the framework that move beyond the document validation and towards the enterprise-wide compliance intelligence. In the next few slides, I'll briefly explain you how each of these components contribute to the process.
- 6:42
So let's begin with the, uh, foundation of the framework, the entity correlation engine, which makes the cross-document intelligence possible.
- 6:52
So the first component is graph-based entity correlation engine. The role is to connect the entities across the payroll, tax, procurement, financial system into unified network. Rather than analyzing the documents independently, it, um, it identifies the relationship between the employee, vendors, account, transaction, uh, regulatory files.
- 7:14
And this connection reveals the hidden pattern and structural anomalies that are often invisible, uh, to the traditional document-level analysis we were doing. In simple terms, this component answers one fundamental question: What is connected?
- 7:30
It provides the relation, uh, relational fundamental for the rest of the framework. Once those, uh, relationships are established, the next step is determining which one actually represents the meaningful risk.
- 7:48
Once relationships have been established, the next step is to determine which one actually represents meaningful risk. That's the role of the adaptive probabilistic risk model. Instead of relying on static rules, uh, it combines the multiple risk indicators such as anomaly, um, um, anomaly, uh, strengths or the source reliability, historic patterns has happened, to calculate a
- 8:13
confidence-based risk, uh, score. This helps, uh, prioritize the cases that require immediate attention while reducing the unnecessary investigations. The important advantage is its ability to learn from the audit outcomes, allowing the models to continuously improve its accuracy over the time.
- 8:32
Simply put, uh, this component answers the question that what is most likely to be genuine compliance risk? Once we have identified the high-risk cases, the final step is to ensure those risks are interpreted consistently across the different regulatory environments.
- 8:52
The final component is cross-jurisdictional normalization layer. Global organizations operate across different countries, currencies, tax structure, and reporting standards. Without normalization, the same transaction can be interpreted differently depending on the jurisdiction.
- 9:10
This layer harmonizes the financial data by standardizing the currencies, tax rules, um, the reporting periods, and the classification schemes as well. As a result, the risks are evaluated consistently regardless of where the, where it has originated.
- 9:29
In short, this component answers to the question: How should the risk be interpreted within the appropriate regulatory context? With all these components working together, the next step was to evaluate how the framework performs under real-world enterprise conditions.
- 9:48
So before discussing the result, let's, um... It's, it's very important to, uh, briefly understand the evaluation of the environment. The framework was evaluated using the approximately three million of the financial records collected over five years of period over the four different regulatory jurisdictions.
- 10:08
The objective was to assess how the framework perform under the realis-realistic, uh, enterprise condition and where a large volume of interconnected financial data and varying regulatory, uh, requirement introduce a significant complexity here.
- 10:24
Uh, with that foundation established, let's look at how the framework performed. So how effective was the framework in detecting hidden compliance risk? Let's look at the results.
- 10:37
So here now, uh, look at the detection performances. The framework achieve approximately ninety-one percent of precision, meaning the vast majority of the flagged cases were confirmed as a genuine anomalies here.
- 10:51
At, um, um... It also achieve eighty-seven percent, um, recalls, demonstrating its ability to identify most true fraud cases while minimal, uh, minimizing the misdetections here.
- 11:07
So together, these results produce a F1 score that is zero point, um, eight nine, indicating a strong balance between the precision and recall here. More importantly, these results are achieved across four jurisdictions and large enterprise-scale data, demonstrating that the framework performs consistently in the complex real-world, uh, environments.
- 11:29
The next question is, um, equally important. How do these improvements translate into operational value for the compliance teams? Detection accuracy is one part of the story. The real value, um, comes from improving the efficiency of the compliance opera-operations.
- 11:50
Beyond detection accuracy, the framework delivers measurable operational benefits. One of the most significant outcome was a seventy-six percent, uh, reduction in false positive, meaning, um, investigators spend, uh, far less than reviewing the cases that they, uh, they are ultimately, uh, legitimate.
- 12:10
So in addition, the framework reduces the manual audit efforts by approximately forty percent, allowing compliance teams to be focused on the only high-risk cases instead of, uh, routing the document reviews.
- 12:22
Ultimately, uh, this translates into faster investigations, improved, uh, resource utilization, and, uh, greater confidence in compliance decision. In other words, the, uh, the framework doesn't just detect fraud more effectively, it helps compliance teams work more effectively.
- 12:42
So these operational improvements become even more meaningful when we compare, uh, the, uh, the framework with the traditional rule-based approaches.
- 12:57
This comparison highlights the advantage of moving beyond the traditional rule-based system. Conventional approaches are effective at validating the individual records, but they often struggle to detect the complex fr-fraud patterns, uh, that spans multiple, uh, documents and systems.
- 13:15
So by incorporating entity correlation, probabilistic risk modeling, and regulatory normalization, the proposed framework consistently, um, performs the baseline across the key performance metrics. The key takeaway is simple.
- 13:31
Connecting data across documents produces better detection, fewer false positive, and more actionable, uh, compliance intelligence than analyzing the documents is, um, in, in isolations. One of the reason the framework continues to improve over the time is that, uh, it doesn't rely on the static rules anymore.
- 13:52
Instead, it continuously learn from the completed audit and investiga-- uh, and the investigator feedbacks here.
- 14:00
So this framework is, is designed to continuously improve through the feedback. Every, uh, completed audit provides the valuable information. Uh, confirm the fraud case, strengthen the future detection pattern.
- 14:14
While false positive helps refining the risk scoring and reduce the unnecessary alerts. This create a continuous learning cycle where the system becomes more accurate with each audit and investigation.
- 14:27
As fraud patterns evolve and business, uh, environments changes, the framework adopts rather than relying on manual rule updates. In simple terms, every completed audit helps make the next audit more efficient.
- 14:42
This continue, uh, continue learning, uh, capability enables a broader shift here from reactive to compliance issue after they occur to identifying the risk before they become audit, uh, findings here.
- 14:57
It's more of a proactive. Beyond improving detection accuracy, this framework changes how organization approach compliances. Traditionally, the compliance has been reactive. Issue were identified after audits investigation or regulatory reviews have happened.
- 15:18
This framework enables more proactive approach through continuous, uh, monitoring cross-document correlation adaptive learnings. Instead of asking what went wrong, organizations can begin asking what is likely to go wrong next.
- 15:32
That shifts from reactive validation to, uh, predictive governance, allowing the compliance teams to identify the risk earlier, prioritize the investigation more effectively, and make better-informed decision. Ultimately, the compliance becomes an ongoing intelligence functions rather than a periodic review process.
- 15:53
While the framework is research-driven, it has been designed with the enterprise deployment in mind. Successful implementation depends on, uh, four key consideration. First one is seamless integration with existing enterprise systems such as ERP, payroll, procurement, tax, uh, tax platforms.
- 16:13
Second, the jurisdictional specific, uh, configuration to ensure the compliance with local regulations and reporting standards. Third one is, um, alignment with the audit framework, uh, enabling the investigator to focus on prioritized risk-scored cases instead of manual document reviews.
- 16:33
And finally, scalability. The evaluation demonstrate that the, uh, framework can effectively process millions of financial records, um, making it suitable for the large enterprise environments. Uh, so together, these, uh, consi-- these considerations help bridge the gap between the research and the practical enterprise adoption.
- 16:57
As I conclude, I would like to leave you with four key takeaways. First is many of today's most significant compliance and fraud risk exist between the documents, not within them.
- 17:10
Detecting these risks require more beyond document-level analysis and cross-document intelligence.
- 17:19
Second is combining the graph-based entity correlation, probabilistic risk modeling, and cross-jurisdictional normalization creates a more comprehensive and scalable approach to enterprise compliance. Third is the result demonstrated that this, um, particular framework is not only improves the detection accuracy, but also, um, reduces the false positive and
- 17:43
significantly lowers the manual audit efforts, delivering the measurable operational value. Finally, by continuous learning from the audit outcomes and the framework enables, uh, um, the organizations to move beyond reactive compliance toward predictive intelligence-driven, um, risk management here.
- 18:03
I believe this, uh, represents an important step toward the future of enterprise financial gover-governance, uh, where AI is not only helping the organizations to detect risk, but also anti-anticipates and, uh, prevent this risk going forward.
- 18:25
So thank you once again to, uh, the AI Engineering World Fair's team for this wonderful opportunity, and thank you all for your time and attention. Please feel free to reach out to me, uh, with your questions and your enthusiasm on this, uh, email, uh, below or connect me on the LinkedIn.
- 18:43
I'm happy to help you, uh, if you are building, uh, with, uh, such kind of, uh, amazing systems for compliances, uh, using the AI. I wanted to transform them.
- 18:54
And, uh, thank you all again. Uh, see you next time.