AI Engineer World's Fair 2026
AI-Driven Multi-Document Correlation for Enterprise Financial Compliance and Fraud Detection
Read the talk
Finding Financial Compliance Risk Between Documents
Individually valid records can conceal collective risk. Graph correlation, probabilistic scoring, and jurisdictional normalization connect the evidence compliance teams need.
From a talk by Varsha Shah
What does a valid document fail to tell you?
Can every document pass its own compliance checks while the organization still misses fraud? Payroll, tax, procurement, and transaction systems each hold part of the financial picture. When those records are analyzed independently, inconsistencies between systems can remain invisible. Document validity does not establish consistency across documents. This is the problem Varsha Shah’s framework addresses by combining graph-based entity correlation, probabilistic risk modeling, and cross-jurisdictional normalization.
The difficulty grows along three dimensions. Operations across countries introduce different reporting standards and compliance requirements. Increasing volumes of financial records make manual review impractical. Meanwhile, fraud can exploit subtle inconsistencies across systems rather than obvious errors in individual records. Traditional rules and document-level NLP can validate a record without understanding its relationships to the rest of the enterprise’s activity.
Consider Shah’s conceptual example: a payroll register, a vendor invoice, and a tax filing each pass their respective checks.
| Record | Individual validation |
|---|---|
| Payroll register | Payroll rules |
| Vendor invoice | Procurement policies |
| Tax filing | Tax regulations |
The payroll record appears accurate, the invoice legitimate, and the tax filing correctly submitted. Connecting them can nevertheless reveal inconsistencies that none of those checks exposes alone. The example does not specify a particular fraudulent transaction; it isolates the missing capability: understanding relationships among records whose individual contents appear acceptable.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Connect the evidence, score the risk, supply the context
The proposed architecture divides that work among three complementary components. It is a framework for combining capabilities, rather than a single model or algorithm.
| Component | Responsibility |
|---|---|
| Entity correlation engine | Connect related information across enterprise systems |
| Adaptive probabilistic risk model | Prioritize connected patterns using multiple risk signals |
| Cross-jurisdictional normalization layer | Supply consistent financial and regulatory context |
The correlation engine creates a unified view of activity. The risk model evaluates that connected evidence to identify cases deserving attention. Normalization addresses differences in currencies, tax structures, reporting standards, and compliance rules so that the resulting assessment has the appropriate context.
The graph-based entity correlation engine establishes the relational foundation. It connects employees, vendors, accounts, transactions, and regulatory filings across payroll, tax, procurement, and financial systems. The analytical object becomes a network of entities and relationships rather than a collection of isolated documents. Hidden patterns and structural anomalies can then become visible in those connections.
Establishing a connection is only the first step. The graph identifies what is related; a subsequent assessment must determine whether the relationship represents meaningful compliance risk. Shah describes this division of responsibilities without specifying a graph schema, an entity-matching algorithm, or a traversal procedure. The architectural distinction matters: relationship discovery supplies evidence for risk assessment rather than making every connection an alert.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Prioritize connected patterns for investigation
The adaptive probabilistic risk model combines several indicators into a confidence-based risk score:
- Anomaly strength: the strength of the detected irregularity.
- Source reliability: the reliability of the evidence contributing to the assessment.
- Historical patterns: information from previously observed activity.
This moves prioritization beyond an alert triggered by a single static rule. Multiple signals contribute to deciding which connected patterns are most likely to represent genuine compliance risk.
The score is intended to direct immediate attention toward higher-risk cases and reduce unnecessary investigations. Completed audits then supply feedback that can improve later assessments. The presentation describes the inputs, purpose, and learning relationship, but does not give a scoring equation, decision threshold, or calibration method. Its central mechanism is the combination of evidence for prioritization, followed by learning from investigation outcomes.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Make records comparable without losing regulatory context
Cross-border comparison introduces a further problem: the same transaction can be interpreted differently under different jurisdictions. A risk assessment therefore needs more than connected entities and a score. It also needs an account of which financial conventions and regulatory requirements apply.
The cross-jurisdictional normalization layer harmonizes currencies, tax rules, reporting periods, and classification schemes. These transformations support consistent evaluation across financial systems, while the regulatory context determines how a risk should be interpreted locally. Comparable records and appropriate local interpretation are complementary requirements; standardization does not mean treating every jurisdiction as though it had identical rules.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Detection performance at enterprise record volumes
Shah reports evaluating the framework on approximately three million financial records collected over five years across four regulatory jurisdictions. The setting was intended to capture the complexity of large volumes of interconnected enterprise data under varying regulatory requirements.
The reported detection results address two different questions: how much of the flagged activity is genuine, and how much of the genuine fraud the framework finds.
| Metric | Reported result | Interpretation |
|---|---|---|
| Precision | Approximately 91% | Flagged cases confirmed as genuine anomalies |
| Recall | 87% | True fraud cases identified |
| F1 score | 0.89 | Balance between precision and recall |
These are aggregate results for the stated evaluation. Shah characterizes them as evidence of performance across complex enterprise environments; the presentation does not provide a per-jurisdiction breakdown.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Reduce the work generated by low-value alerts
Detection quality matters operationally because every alert can create work for an investigator. Shah reports a 76% reduction in false positives and approximately 40% less manual audit effort. Fewer legitimate cases entering investigation would let compliance teams spend more attention on high-risk cases instead of routine document review. Shah also describes faster investigations, better resource utilization, and greater confidence in decisions as resulting benefits.
The comparison with conventional rule-based approaches turns on the unit of analysis:
| Approach | Main capability | Treatment of relationships |
|---|---|---|
| Traditional rule-based validation | Check individual records | Struggles with patterns spanning documents |
| Proposed framework | Assess connected enterprise evidence | Combines correlation, scoring, and regulatory context |
Shah reports that the framework outperforms the baseline on key metrics. The presentation does not specify the baseline implementation, evaluation split, or denominators for the reported reductions, so the operational figures describe the presented evaluation rather than a forecast of staff-hours or cost savings for another deployment.
The proposed advantage also extends beyond the initial assessment. Completed audits and investigator feedback feed later decisions, allowing the framework to adjust instead of relying on static rules alone.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Use completed audits to improve the next assessment
Audit outcomes provide two complementary forms of feedback:
- Confirmed fraud: strengthens patterns used for future detection.
- False positives: helps refine risk scoring and reduce unnecessary alerts.
Together, these outcomes create a learning cycle between detection and investigation. As fraud patterns and business conditions change, the framework is designed to adapt through feedback rather than depend solely on manual rule updates.
That cycle supports a broader change in how compliance operates. In a reactive process, an audit, investigation, or regulatory review identifies an issue after it has occurred. Continuous monitoring combines cross-document correlation with adaptive learning to surface risks earlier and prioritize investigation. Compliance becomes an ongoing assessment of emerging risk rather than only a periodic review of past activity. Shah presents this as a path toward predictive governance; prospective prevention is an intended direction, not a separately measured result in the evaluation.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Bring the framework into enterprise workflows
Turning the research framework into an enterprise capability requires four pieces to fit together:
- System integration: connect existing ERP, payroll, procurement, and tax platforms so that the framework can work across their records.
- Jurisdiction-specific configuration: account for local regulations and reporting standards.
- Audit workflow alignment: deliver prioritized, risk-scored cases that investigators can act on, instead of merely adding another layer of document review.
- Scalability: support the financial-record volumes large organizations generate.
Shah points to the evaluation’s record volume as evidence for the scalability consideration. The presentation describes deployment requirements rather than a production topology, throughput measurement, or rollout procedure.
The resulting design keeps the relationship between detection and operations explicit. Risks that exist between documents require connected evidence; graph correlation supplies that evidence, probabilistic scoring prioritizes it, and normalization gives it regulatory meaning. The value of that combination is realized when investigators receive more useful cases and their completed audits improve subsequent assessments. Shah’s closing ambition is to extend this cycle from detecting risk toward anticipating and preventing it as part of everyday financial governance.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Resources
Further reading
Shah's paper presents the three-component framework and reports detection and review-workload results.
A companion presentation explaining LLM-assisted interpretation, entity linking and an employee-relocation compliance example.
Read the complete timestamped transcript
- 0:04
Hello, everyone. Um, thank you to the AI Engineering, uh, World's Fair, uh, team for providing this wonderful opportunity to share my research. It is truly an honor to be speaking alongside so many talented researchers and practitioners.
- 0:18
My name is Varsha Shah. Uh, I am an enterprise technical architect working at Tata Consultancy Services, working for Microsoft. Um, I'm focused on artificial intelligence, enterprise, uh, compliance, finance governance, and intelligent automation.
- 0:34
Today, I would like to share my research on AI-driven multi-document correlation for enterprise financial compliance and fraud detection. Uh, as organizations continue to digitalize their operations today, they generate a numerous amount of data, um, for the financial system across payroll, tax, procurement, transaction system.
- 0:56
Ironically, uh, while we have more data than ever before, compliance teams continue to struggle with hidden fraud patterns, regulatory risk. The reason is the most ex-existing solution analyze the documents independently, while many of the most critical risk only become visible when the information is connected across the multiple systems.
- 1:18
In this presentation, I'll introduce you to a framework that combines the graph-based entity, uh, correlation, probabilistic risk modeling, and cross-jurisdictional normalization to uncover these hidden relationships and transform enterprise compliance from reactive process into proactive intelligence capability.
- 1:38
The framework was, uh, evaluated using approximately, uh, three million financial records across four jurisdictional, uh, demonstrating both the strong detection performance and meaningful operations improvement. With that context, let's begin, uh, by looking at the compliance gap that organizations continue to face today.
- 2:01
Let's begin by understanding the compliance gap that many organizations continue to face. Enterprise compliance has become significantly more complex over the last decade. Organizations now operate across multiple countries, regulatory frameworks, and financial system, each with own reporting standards and compliance requirements.
- 2:20
At the same time, the volume of the enterprise has grown exponentially. Payroll records, tax filings, procurement transaction, and financial documents are generated every day, making manual reviews both time-consuming and increasingly, uh, impractical.
- 2:38
Adding to this challenge, fraud has been evolved. Modern fraud rarely appears as an, um, obvious error within a single document. Instead, it, uh, exploits subtle, uh, inconsistency across multiple system, patterns that often remain invisible when the records are reviewed independently.
- 2:59
This creates a fundamental limitation. Traditional, uh, rule-based and document-level NLP system are designed to validate individual records, but they are not built to understand relationship across the documents.
- 3:14
And that's the gap this research aims to address, moving beyond this isolated document analysis to uncover the hidden risk through the cross-document correlation. To better understand this limitation, let's look at why traditional document, uh, level analysis often fail to detect the most sophisticated fraud patterns.
- 3:37
To understand why traditional approaches struggle, let's consider how most compliance system operates, uh, nowadays. They evaluate each document independently. A payroll register is, uh, validated against the payroll rules.
- 3:51
The vendor invoices are checked against the procurement policies. A tax filings is reviewed under the tax, uh, regulations. If each document passes its individual validation, the transaction is generally considered compliant.
- 4:05
The challenge is that many sophisticated fraud patterns doesn't, um, really appear within a single document. They emerges only when the multiple documents are analyzed together. For example, a payroll record may appear accurate to us.
- 4:19
A, um, vendor invoice may seem legitimate to us. A tax filing, uh, may be correctly, uh, submitted. But when these records are connected, they are revealing the inconsistencies and indicate the fraud and compliance risk.
- 4:34
The information already exist. What missing is the ability to understand the relationship between these documents. That is why the research shifts the focus from document-level validation to cross-document intelligence, enabling the organizations to detect the risk that would, um, otherwise remain hidden.
- 4:53
So if the problem is understanding relationships rather than individual documents, what kind of architecture can solve this? Let me introduce you to the framework.
- 5:05
Now that we have established the problem, let's look at the proposed framework. Rather than relying on a single model or algorithm, the solution is built on three, um, complementary components that work together to transform the raw enterprise data into the actionable compliance intelligence.
- 5:22
The first component is the entity correlation engine. It, uh, the, the purpose of this is to connect the related information across the payroll, tax, procurement, financial systems, creating a unified view of, uh, enterprise activity rather than isolated records.
- 5:39
Once these relationships are established, the second component, that is adaptive probabilistic risk model eva- which is, which evaluates the connected data to determine which pattern represent meaningful compliance. Instead of, uh, generating alerts based on single rule, it, uh, it prioritize the cases using the multiple risk si-signals here.
- 6:03
Uh, the cross-jurisdictional normalization layer provides the regulatory context by, uh, standardizing the currency, tax structure, reporting standards, uh, and compliance rules across the different jurisdictions. This ensures that the risks are evaluated consistently, regardless of where the transaction originated.
- 6:24
So individually, each component provides a value. Together, they enable the framework that move beyond the document validation and towards the enterprise-wide compliance intelligence. In the next few slides, I'll briefly explain you how each of these components contribute to the process.
- 6:42
So let's begin with the, uh, foundation of the framework, the entity correlation engine, which makes the cross-document intelligence possible.
- 6:52
So the first component is graph-based entity correlation engine. The role is to connect the entities across the payroll, tax, procurement, financial system into unified network. Rather than analyzing the documents independently, it, um, it identifies the relationship between the employee, vendors, account, transaction, uh, regulatory files.
- 7:14
And this connection reveals the hidden pattern and structural anomalies that are often invisible, uh, to the traditional document-level analysis we were doing. In simple terms, this component answers one fundamental question: What is connected?
- 7:30
It provides the relation, uh, relational fundamental for the rest of the framework. Once those, uh, relationships are established, the next step is determining which one actually represents the meaningful risk.
- 7:48
Once relationships have been established, the next step is to determine which one actually represents meaningful risk. That's the role of the adaptive probabilistic risk model. Instead of relying on static rules, uh, it combines the multiple risk indicators such as anomaly, um, um, anomaly, uh, strengths or the source reliability, historic patterns has happened, to calculate a
- 8:13
confidence-based risk, uh, score. This helps, uh, prioritize the cases that require immediate attention while reducing the unnecessary investigations. The important advantage is its ability to learn from the audit outcomes, allowing the models to continuously improve its accuracy over the time.
- 8:32
Simply put, uh, this component answers the question that what is most likely to be genuine compliance risk? Once we have identified the high-risk cases, the final step is to ensure those risks are interpreted consistently across the different regulatory environments.
- 8:52
The final component is cross-jurisdictional normalization layer. Global organizations operate across different countries, currencies, tax structure, and reporting standards. Without normalization, the same transaction can be interpreted differently depending on the jurisdiction.
- 9:10
This layer harmonizes the financial data by standardizing the currencies, tax rules, um, the reporting periods, and the classification schemes as well. As a result, the risks are evaluated consistently regardless of where the, where it has originated.
- 9:29
In short, this component answers to the question: How should the risk be interpreted within the appropriate regulatory context? With all these components working together, the next step was to evaluate how the framework performs under real-world enterprise conditions.
- 9:48
So before discussing the result, let's, um... It's, it's very important to, uh, briefly understand the evaluation of the environment. The framework was evaluated using the approximately three million of the financial records collected over five years of period over the four different regulatory jurisdictions.
- 10:08
The objective was to assess how the framework perform under the realis-realistic, uh, enterprise condition and where a large volume of interconnected financial data and varying regulatory, uh, requirement introduce a significant complexity here.
- 10:24
Uh, with that foundation established, let's look at how the framework performed. So how effective was the framework in detecting hidden compliance risk? Let's look at the results.
- 10:37
So here now, uh, look at the detection performances. The framework achieve approximately ninety-one percent of precision, meaning the vast majority of the flagged cases were confirmed as a genuine anomalies here.
- 10:51
At, um, um... It also achieve eighty-seven percent, um, recalls, demonstrating its ability to identify most true fraud cases while minimal, uh, minimizing the misdetections here.
- 11:07
So together, these results produce a F1 score that is zero point, um, eight nine, indicating a strong balance between the precision and recall here. More importantly, these results are achieved across four jurisdictions and large enterprise-scale data, demonstrating that the framework performs consistently in the complex real-world, uh, environments.
- 11:29
The next question is, um, equally important. How do these improvements translate into operational value for the compliance teams? Detection accuracy is one part of the story. The real value, um, comes from improving the efficiency of the compliance opera-operations.
- 11:50
Beyond detection accuracy, the framework delivers measurable operational benefits. One of the most significant outcome was a seventy-six percent, uh, reduction in false positive, meaning, um, investigators spend, uh, far less than reviewing the cases that they, uh, they are ultimately, uh, legitimate.
- 12:10
So in addition, the framework reduces the manual audit efforts by approximately forty percent, allowing compliance teams to be focused on the only high-risk cases instead of, uh, routing the document reviews.
- 12:22
Ultimately, uh, this translates into faster investigations, improved, uh, resource utilization, and, uh, greater confidence in compliance decision. In other words, the, uh, the framework doesn't just detect fraud more effectively, it helps compliance teams work more effectively.
- 12:42
So these operational improvements become even more meaningful when we compare, uh, the, uh, the framework with the traditional rule-based approaches.
- 12:57
This comparison highlights the advantage of moving beyond the traditional rule-based system. Conventional approaches are effective at validating the individual records, but they often struggle to detect the complex fr-fraud patterns, uh, that spans multiple, uh, documents and systems.
- 13:15
So by incorporating entity correlation, probabilistic risk modeling, and regulatory normalization, the proposed framework consistently, um, performs the baseline across the key performance metrics. The key takeaway is simple.
- 13:31
Connecting data across documents produces better detection, fewer false positive, and more actionable, uh, compliance intelligence than analyzing the documents is, um, in, in isolations. One of the reason the framework continues to improve over the time is that, uh, it doesn't rely on the static rules anymore.
- 13:52
Instead, it continuously learn from the completed audit and investiga-- uh, and the investigator feedbacks here.
- 14:00
So this framework is, is designed to continuously improve through the feedback. Every, uh, completed audit provides the valuable information. Uh, confirm the fraud case, strengthen the future detection pattern.
- 14:14
While false positive helps refining the risk scoring and reduce the unnecessary alerts. This create a continuous learning cycle where the system becomes more accurate with each audit and investigation.
- 14:27
As fraud patterns evolve and business, uh, environments changes, the framework adopts rather than relying on manual rule updates. In simple terms, every completed audit helps make the next audit more efficient.
- 14:42
This continue, uh, continue learning, uh, capability enables a broader shift here from reactive to compliance issue after they occur to identifying the risk before they become audit, uh, findings here.
- 14:57
It's more of a proactive. Beyond improving detection accuracy, this framework changes how organization approach compliances. Traditionally, the compliance has been reactive. Issue were identified after audits investigation or regulatory reviews have happened.
- 15:18
This framework enables more proactive approach through continuous, uh, monitoring cross-document correlation adaptive learnings. Instead of asking what went wrong, organizations can begin asking what is likely to go wrong next.
- 15:32
That shifts from reactive validation to, uh, predictive governance, allowing the compliance teams to identify the risk earlier, prioritize the investigation more effectively, and make better-informed decision. Ultimately, the compliance becomes an ongoing intelligence functions rather than a periodic review process.
- 15:53
While the framework is research-driven, it has been designed with the enterprise deployment in mind. Successful implementation depends on, uh, four key consideration. First one is seamless integration with existing enterprise systems such as ERP, payroll, procurement, tax, uh, tax platforms.
- 16:13
Second, the jurisdictional specific, uh, configuration to ensure the compliance with local regulations and reporting standards. Third one is, um, alignment with the audit framework, uh, enabling the investigator to focus on prioritized risk-scored cases instead of manual document reviews.
- 16:33
And finally, scalability. The evaluation demonstrate that the, uh, framework can effectively process millions of financial records, um, making it suitable for the large enterprise environments. Uh, so together, these, uh, consi-- these considerations help bridge the gap between the research and the practical enterprise adoption.
- 16:57
As I conclude, I would like to leave you with four key takeaways. First is many of today's most significant compliance and fraud risk exist between the documents, not within them.
- 17:10
Detecting these risks require more beyond document-level analysis and cross-document intelligence.
- 17:19
Second is combining the graph-based entity correlation, probabilistic risk modeling, and cross-jurisdictional normalization creates a more comprehensive and scalable approach to enterprise compliance. Third is the result demonstrated that this, um, particular framework is not only improves the detection accuracy, but also, um, reduces the false positive and
- 17:43
significantly lowers the manual audit efforts, delivering the measurable operational value. Finally, by continuous learning from the audit outcomes and the framework enables, uh, um, the organizations to move beyond reactive compliance toward predictive intelligence-driven, um, risk management here.
- 18:03
I believe this, uh, represents an important step toward the future of enterprise financial gover-governance, uh, where AI is not only helping the organizations to detect risk, but also anti-anticipates and, uh, prevent this risk going forward.
- 18:25
So thank you once again to, uh, the AI Engineering World Fair's team for this wonderful opportunity, and thank you all for your time and attention. Please feel free to reach out to me, uh, with your questions and your enthusiasm on this, uh, email, uh, below or connect me on the LinkedIn.
- 18:43
I'm happy to help you, uh, if you are building, uh, with, uh, such kind of, uh, amazing systems for compliances, uh, using the AI. I wanted to transform them.
- 18:54
And, uh, thank you all again. Uh, see you next time.