Customize Consent Preferences

We use cookies to help you navigate efficiently and perform certain functions. You will find detailed information about all cookies under each consent category below.

The cookies that are categorized as "Necessary" are stored on your browser as they are essential for enabling the basic functionalities of the site. ... 

Always Active

Necessary cookies are required to enable the basic features of this site, such as providing secure log-in or adjusting your consent preferences. These cookies do not store any personally identifiable data.

No cookies to display.

Functional cookies help perform certain functionalities like sharing the content of the website on social media platforms, collecting feedback, and other third-party features.

No cookies to display.

Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics such as the number of visitors, bounce rate, traffic source, etc.

No cookies to display.

Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.

No cookies to display.

Advertisement cookies are used to provide visitors with customized advertisements based on the pages you visited previously and to analyze the effectiveness of the ad campaigns.

No cookies to display.

DiscoverCloud

How Eficens implemented RAG based Generative AI application at Appleton Partners Inc.

How Eficens implemented RAG based Generative AI application at Appleton Partners Inc.
Table of Contents

Appleton Investments is a financial company focused on investment management tailored for individual financial needs. Their business processes around document processing and creation of new proposals for end customers were one of the pain areas.  Eficens stepped in as Appleton’s strategic partner, bringing the power of their Generative AI Expertise across solutioning considering the key business requirements in terms of speedy document processing at scale. Eficens also ensured that their solution provides an agnostic approach in building this platform for Appleton. They used Retrieval Augmented Generation pattern of architecture in order to provide enterprise specific context with data connected from across the enterprise data stores such as transactional systems (relational databases), unstructured data in S3, MS SharePoint and CRM data.    

Key Challenges:

  • Data extraction and structuring: – Financial documents often come in various formats (PDFs, scanned images, spreadsheets, etc.) with unstructured data, making it difficult to extract and standardize the information.  
  • Contextual understanding: – Financial documents can be complex, with technical jargon and domain-specific terminology, making it challenging for traditional rule-based systems to accurately interpret the content.  
  • Automated decision-making: – Financial institutions often need to make quick and informed decisions based on the information in the documents, but manual review can be time-consuming and prone to human errors.  
  • Regulatory compliance: – Financial services are heavily regulated, and institutions must ensure that their document processing adheres to various compliance requirements, such as data privacy, anti-money laundering (AML), and know-your-customer (KYC) regulations.  
  • Scalability and efficiency: – Financial institutions often must process a large volume of documents, which can be a labour intensive and time-consuming task, especially during peak periods.  

Solution:

Challenges outlined above are often solved by Retrieval Augmented Generation (RAG) pattern of architecture for Generative AI. Recognizing the increasing need for Vector Store Selection Guidance in this domain, Appleton Partners, Inc. has successfully implemented a Generative AI application for summarization of documents on AWS with Eficens Engineering team’s specialized skills and today, we’ll delve into their approach. 

Vector data stores play a pivotal role in RAG pattern implementations, offering scalability and security necessary for handling vast amounts of domain-specific information. With numerous options available, selecting the right vector data store becomes paramount. Here’s where Eficens Engineering team’s expertise shines, as they’ve navigated through various considerations to make informed decisions. 

Key factors which were when choosing a vector data store include: 

  • Latency of Response 
  • Level of Product Quantization 
  • Scale of Vectors to be Stored 
  • Dimensions of Generated Vectors 
  • Supported Algorithms (e.g., HNSW, IVF) 
  • Similarity Metrics Supported   

Solution Architecture

Designing an efficient ingestion pipeline for embeddings, along with prompt and context engineering, are crucial steps in the process. But Eficens has streamlined this process further with the help of AWS’s latest offering, Knowledge Bases (KB) for Amazon Bedrock. At the recently concluded re:Invent 2023, AWS announced the General Availability of KB for Amazon Bedrock, simplifying the evaluation of multiple vector stores.  

Here’s a step-by-step guide on how the leading financial services company leveraged KB to set up their vector data store seamlessly:

  • You start by naming the Knowledge Base relevant to one of the Business Units to whose data corpus this was being created for. 
  • Created a Data Source Data source by ingesting data from an S3 location where all the corpus was available. 
  • The workflow on KB offers a choice between different types of vector stores, including Amazon OpenSearch Serverless (OSS) for new deployments or pointing to existing deployments of OSS, Aurora PostgreSQL, Pinecone, or Redis Enterprise Cloud. 
  • After reviewing the setup, the Knowledge Base is created, with the vector data store provisioned in a few minutes. Titan Embeddings G1 model converts the knowledge corpus into embeddings and stores them into the vector data store. 

With the data sync completed, users could initiate initial testing of the Knowledge Base using the user interface and integrations available with LLMs Claude Models. And just like that, Eficens has set up their vector data store within minutes, ready to integrate with agents and applications using SDKs and APIs provided by AWS. 

Outcomes: 

  • Cost Reduction: Appleton Investment saw a 30% reduction in their TCO with Eficens’ engagement as the manual tasks were being largely automated.
  • Accelerated Innovation: With the beta version available now to limited users, Appleton & Eficens plan to further improve accuracy, look at fine tuning approaches on the road map. They are also planning to completely automate the document processing by including OCR along with Generative AI processing to provide in-document summaries, Q&A capabilities etc.

Conclusion

Eficens’s successful implementation of Generative AI Apps on AWS showcases the power of leveraging innovative technologies to meet customer demands efficiently. By embracing solutions like Knowledge Bases for Amazon Bedrock, companies can accelerate their AI initiatives and stay ahead in today’s competitive landscape. So, whether you’re embarking on your AI journey or looking to enhance existing capabilities, Eficens’s experience serves as a guiding light to help you navigate the complexities of AI implementation on AWS.   

Looking to solve a similar problem? 

Reach out to us to get started with this transformation – Contact Eficens. 

    • United States+1
    • United Kingdom+44
    • Afghanistan (‫افغانستان‬‎)+93
    • Albania (Shqipëri)+355
    • Algeria (‫الجزائر‬‎)+213
    • American Samoa+1684
    • Andorra+376
    • Angola+244
    • Anguilla+1264
    • Antigua and Barbuda+1268
    • Argentina+54
    • Armenia (Հայաստան)+374
    • Aruba+297
    • Australia+61
    • Austria (Österreich)+43
    • Azerbaijan (Azərbaycan)+994
    • Bahamas+1242
    • Bahrain (‫البحرين‬‎)+973
    • Bangladesh (বাংলাদেশ)+880
    • Barbados+1246
    • Belarus (Беларусь)+375
    • Belgium (België)+32
    • Belize+501
    • Benin (Bénin)+229
    • Bermuda+1441
    • Bhutan (འབྲུག)+975
    • Bolivia+591
    • Bosnia and Herzegovina (Босна и Херцеговина)+387
    • Botswana+267
    • Brazil (Brasil)+55
    • British Indian Ocean Territory+246
    • British Virgin Islands+1284
    • Brunei+673
    • Bulgaria (България)+359
    • Burkina Faso+226
    • Burundi (Uburundi)+257
    • Cambodia (កម្ពុជា)+855
    • Cameroon (Cameroun)+237
    • Canada+1
    • Cape Verde (Kabu Verdi)+238
    • Caribbean Netherlands+599
    • Cayman Islands+1345
    • Central African Republic (République centrafricaine)+236
    • Chad (Tchad)+235
    • Chile+56
    • China (中国)+86
    • Christmas Island+61
    • Cocos (Keeling) Islands+61
    • Colombia+57
    • Comoros (‫جزر القمر‬‎)+269
    • Congo (DRC) (Jamhuri ya Kidemokrasia ya Kongo)+243
    • Congo (Republic) (Congo-Brazzaville)+242
    • Cook Islands+682
    • Costa Rica+506
    • Côte d’Ivoire+225
    • Croatia (Hrvatska)+385
    • Cuba+53
    • Curaçao+599
    • Cyprus (Κύπρος)+357
    • Czech Republic (Česká republika)+420
    • Denmark (Danmark)+45
    • Djibouti+253
    • Dominica+1767
    • Dominican Republic (República Dominicana)+1
    • Ecuador+593
    • Egypt (‫مصر‬‎)+20
    • El Salvador+503
    • Equatorial Guinea (Guinea Ecuatorial)+240
    • Eritrea+291
    • Estonia (Eesti)+372
    • Ethiopia+251
    • Falkland Islands (Islas Malvinas)+500
    • Faroe Islands (Føroyar)+298
    • Fiji+679
    • Finland (Suomi)+358
    • France+33
    • French Guiana (Guyane française)+594
    • French Polynesia (Polynésie française)+689
    • Gabon+241
    • Gambia+220
    • Georgia (საქართველო)+995
    • Germany (Deutschland)+49
    • Ghana (Gaana)+233
    • Gibraltar+350
    • Greece (Ελλάδα)+30
    • Greenland (Kalaallit Nunaat)+299
    • Grenada+1473
    • Guadeloupe+590
    • Guam+1671
    • Guatemala+502
    • Guernsey+44
    • Guinea (Guinée)+224
    • Guinea-Bissau (Guiné Bissau)+245
    • Guyana+592
    • Haiti+509
    • Honduras+504
    • Hong Kong (香港)+852
    • Hungary (Magyarország)+36
    • Iceland (Ísland)+354
    • India (भारत)+91
    • Indonesia+62
    • Iran (‫ایران‬‎)+98
    • Iraq (‫العراق‬‎)+964
    • Ireland+353
    • Isle of Man+44
    • Israel (‫ישראל‬‎)+972
    • Italy (Italia)+39
    • Jamaica+1
    • Japan (日本)+81
    • Jersey+44
    • Jordan (‫الأردن‬‎)+962
    • Kazakhstan (Казахстан)+7
    • Kenya+254
    • Kiribati+686
    • Kosovo+383
    • Kuwait (‫الكويت‬‎)+965
    • Kyrgyzstan (Кыргызстан)+996
    • Laos (ລາວ)+856
    • Latvia (Latvija)+371
    • Lebanon (‫لبنان‬‎)+961
    • Lesotho+266
    • Liberia+231
    • Libya (‫ليبيا‬‎)+218
    • Liechtenstein+423
    • Lithuania (Lietuva)+370
    • Luxembourg+352
    • Macau (澳門)+853
    • Macedonia (FYROM) (Македонија)+389
    • Madagascar (Madagasikara)+261
    • Malawi+265
    • Malaysia+60
    • Maldives+960
    • Mali+223
    • Malta+356
    • Marshall Islands+692
    • Martinique+596
    • Mauritania (‫موريتانيا‬‎)+222
    • Mauritius (Moris)+230
    • Mayotte+262
    • Mexico (México)+52
    • Micronesia+691
    • Moldova (Republica Moldova)+373
    • Monaco+377
    • Mongolia (Монгол)+976
    • Montenegro (Crna Gora)+382
    • Montserrat+1664
    • Morocco (‫المغرب‬‎)+212
    • Mozambique (Moçambique)+258
    • Myanmar (Burma) (မြန်မာ)+95
    • Namibia (Namibië)+264
    • Nauru+674
    • Nepal (नेपाल)+977
    • Netherlands (Nederland)+31
    • New Caledonia (Nouvelle-Calédonie)+687
    • New Zealand+64
    • Nicaragua+505
    • Niger (Nijar)+227
    • Nigeria+234
    • Niue+683
    • Norfolk Island+672
    • North Korea (조선 민주주의 인민 공화국)+850
    • Northern Mariana Islands+1670
    • Norway (Norge)+47
    • Oman (‫عُمان‬‎)+968
    • Pakistan (‫پاکستان‬‎)+92
    • Palau+680
    • Palestine (‫فلسطين‬‎)+970
    • Panama (Panamá)+507
    • Papua New Guinea+675
    • Paraguay+595
    • Peru (Perú)+51
    • Philippines+63
    • Poland (Polska)+48
    • Portugal+351
    • Puerto Rico+1
    • Qatar (‫قطر‬‎)+974
    • Réunion (La Réunion)+262
    • Romania (România)+40
    • Russia (Россия)+7
    • Rwanda+250
    • Saint Barthélemy+590
    • Saint Helena+290
    • Saint Kitts and Nevis+1869
    • Saint Lucia+1758
    • Saint Martin (Saint-Martin (partie française))+590
    • Saint Pierre and Miquelon (Saint-Pierre-et-Miquelon)+508
    • Saint Vincent and the Grenadines+1784
    • Samoa+685
    • San Marino+378
    • São Tomé and Príncipe (São Tomé e Príncipe)+239
    • Saudi Arabia (‫المملكة العربية السعودية‬‎)+966
    • Senegal (Sénégal)+221
    • Serbia (Србија)+381
    • Seychelles+248
    • Sierra Leone+232
    • Singapore+65
    • Sint Maarten+1721
    • Slovakia (Slovensko)+421
    • Slovenia (Slovenija)+386
    • Solomon Islands+677
    • Somalia (Soomaaliya)+252
    • South Africa+27
    • South Korea (대한민국)+82
    • South Sudan (‫جنوب السودان‬‎)+211
    • Spain (España)+34
    • Sri Lanka (ශ්‍රී ලංකාව)+94
    • Sudan (‫السودان‬‎)+249
    • Suriname+597
    • Svalbard and Jan Mayen+47
    • Swaziland+268
    • Sweden (Sverige)+46
    • Switzerland (Schweiz)+41
    • Syria (‫سوريا‬‎)+963
    • Taiwan (台灣)+886
    • Tajikistan+992
    • Tanzania+255
    • Thailand (ไทย)+66
    • Timor-Leste+670
    • Togo+228
    • Tokelau+690
    • Tonga+676
    • Trinidad and Tobago+1868
    • Tunisia (‫تونس‬‎)+216
    • Turkey (Türkiye)+90
    • Turkmenistan+993
    • Turks and Caicos Islands+1649
    • Tuvalu+688
    • U.S. Virgin Islands+1340
    • Uganda+256
    • Ukraine (Україна)+380
    • United Arab Emirates (‫الإمارات العربية المتحدة‬‎)+971
    • United Kingdom+44
    • United States+1
    • Uruguay+598
    • Uzbekistan (Oʻzbekiston)+998
    • Vanuatu+678
    • Vatican City (Città del Vaticano)+39
    • Venezuela+58
    • Vietnam (Việt Nam)+84
    • Wallis and Futuna (Wallis-et-Futuna)+681
    • Western Sahara (‫الصحراء الغربية‬‎)+212
    • Yemen (‫اليمن‬‎)+967
    • Zambia+260
    • Zimbabwe+263
    • Åland Islands+358

    More Blogs

    Table of Contents Appleton Investments is a financial company focused on investment management tailored for individual financial needs. Their business processes around …

    Table of Contents In today’s fast-paced business environment, seamless access to enterprise data is crucial for enhancing productivity. The challenge, however, lies …

    Table of Contents Businesses are continually seeking ways to optimize their operations, reduce costs, and enhance performance. Cloud computing, with its promise …

    Table of Contents The Evolution of Cloud Computing The Emergence of AIOps or AI in Cloud Computing How AI is Becoming an …