How PerformLine makes use of immediate engineering on Amazon Bedrock to detect compliance violations 

This submit is co-written with Bogdan Arsenie and Nick Mattei from PerformLine.

PerformLine operates inside the advertising compliance trade, a specialised subset of the broader compliance software program market, which incorporates varied compliance options like anti-money laundering (AML), know your buyer (KYC), and others. Particularly, advertising compliance refers to adhering to rules and tips set by authorities companies that be certain an organization’s advertising, promoting, and gross sales content material and communications are truthful, correct, and never deceptive for customers. PerformLine is the main service offering complete compliance oversight throughout advertising, gross sales, and associate channels. As pioneers of the advertising compliance trade, PerformLine has carried out over 1.1 billion compliance observations over the previous 10+ years, automating all the compliance course of—from pre-publication assessment of supplies to steady monitoring of consumer-facing channels corresponding to web sites, emails, and social media. Trusted by shopper finance manufacturers and international organizations, PerformLine makes use of AI-driven options to guard manufacturers and their customers, reworking compliance efforts right into a aggressive benefit.

“Uncover. Monitor. Act. This isn’t simply our tagline—it’s the muse of our innovation at PerformLine,” says PerformLine’s CTO Bogdan Arsenie. PerformLine’s engineering workforce brings these rules to life by creating AI-powered expertise options. On this submit, PerformLine and AWS discover how PerformLine used Amazon Bedrock to speed up compliance processes, generate actionable insights, and supply contextual information—delivering the pace and accuracy important for large-scale oversight.

The issue

One in all PerformLine’s enterprise clients wanted a extra environment friendly course of for working compliance checks on newly launched product pages, notably those who combine a number of merchandise inside the identical visible and textual framework. These complicated pages typically function overlapping content material that may apply to 1 product, a number of merchandise, and even all of them without delay, necessitating a context-aware interpretation that mirrors how a typical shopper would view and work together with the content material. By adopting AWS and the structure mentioned on this submit, PerformLine can retrieve and analyze these intricate pages via AI-driven processing, producing detailed insights and contextual information that seize the nuanced interaction between varied product parts. After the related data is extracted and structured, it’s fed instantly into their guidelines engine, enabling strong compliance checks. This accomplishes a seamless move, from information ingestion to rules-based evaluation. It not solely preserves the depth of every product’s presentation but in addition delivers the pace and accuracy important to large-scale oversight. Monitoring hundreds of thousands of webpages each day for compliance calls for a system that may intelligently parse, extract, and analyze content material at scale—very similar to the method PerformLine has developed for his or her enterprise clients. On this dynamic panorama, the ever-evolving nature of internet content material challenges conventional static parsing, requiring a context-aware and adaptive resolution. This structure not solely processes bulk information offline but in addition delivers close to real-time efficiency for one-time requests, dynamically scaling to handle the varied complexity of every web page. By utilizing AI-powered inference, PerformLine gives complete protection of each product and advertising aspect throughout the online, whereas placing a cautious stability between accuracy, efficiency, and value.

Answer overview

With this versatile, adaptable resolution, PerformLine can deal with even essentially the most difficult webpages, offering complete protection when extracting and analyzing internet content material with a number of merchandise. On the identical time, by combining consistency with the adaptability of basis fashions (FMs), PerformLine can preserve dependable efficiency throughout the varied vary of merchandise and web sites their clients monitor. This twin deal with agility and operational consistency makes positive their clients profit from strong compliance checks and information integrity, with out sacrificing the pace or scale wanted to stay aggressive.

PerformLine’s upstream ingestion pipeline effectively collects hundreds of thousands of internet pages and their related metadata in a batch course of. Downstream property are submitted to PerformLine’s guidelines engine and compliance assessment processes. It was crucial that they not disrupt these processes or introduce cascading adjustments for this resolution.

PerformLine determined to make use of generative AI and Amazon Bedrock to handle their core challenges. Amazon Bedrock permits for a broad choice of fashions, together with Amazon Nova. Amazon Bedrock is repeatedly increasing function units round utilizing FMs at scale. This gives a dependable basis to construct a extremely out there and environment friendly content material processing system.

PerformLine’s resolution incorporates the next key elements:

PerformLine carried out a scalable, serverless event-driven structure (proven within the following diagram) that seamlessly integrates with their current system, requiring lower than a day to develop and deploy. This made it doable to deal with immediate optimization, analysis, and value administration somewhat than infrastructure overhead. This structure permits PerformLine to dynamically parse, extract, and analyze internet content material with excessive reliability, flexibility, and cost-efficiency.

PerformLine’s course of consists of a number of steps, together with processing (Step 1), occasion set off and storage (Steps 2–6), structured output and storage (Step 7), and downstream processing and compliance checks (Steps 8–9):

1. Hundreds of thousands of pages are processed by an upstream extract, remodel, and cargo (ETL) course of from PerformLine’s core techniques working on the AWS Cloud.
2. When a web page is retrieved, it triggers an occasion within the compliance test system.
3. Amazon S3 permits for storage of the info from a web page in line with metadata.
4. EventBridge makes use of event-driven processing to route Amazon S3 occasions to Amazon SQS.
5. Amazon SQS queues messages for processing and allows messages to be retried on failure.
6. A Lambda Operate consumes SQS messages and likewise scales dynamically to deal with even unpredictable workloads:
   1. This operate makes use of Amazon Bedrock to carry out extraction and generative AI evaluation of the content material from Amazon SQS. Amazon Bedrock gives the best flexibility to decide on the appropriate mannequin for the job. For PerformLine’s use case, Amazon’s Nova Professional was greatest suited to complicated requests that require a robust mannequin however nonetheless permits for a excessive efficiency to price ratio. Anthropic’s Claude Haiku mannequin permits for optimized fast calls, the place a quick response is paramount for added processing if wanted. Amazon Bedrock options, together with Amazon Bedrock Immediate Administration and inference profiles are used to extend enter code variability with out affecting output and scale back complexity in utilization of FMs via Amazon Bedrock.
   2. The operate shops customer-defined product schemas in Amazon DynamoDB, enabling dynamic massive language mannequin (LLM) concentrating on and schema-driven output technology.
7. Amazon S3 shops the extracted information, which is formatted as structured JSON adhering to the goal schema.
8. EventBridge forwards Amazon S3 occasions to Amazon SQS, making extracted information out there for downstream processing.
9. Compliance checks and enterprise guidelines, working on different PerformLine’s techniques, are utilized to validate and implement regulatory necessities.

Value optimizations

The answer gives a number of price optimizations, together with change information seize (CDC) on the internet and strategic multi-pass inference. After a web page’s content material has been analyzed and formatted, it’s written again to a partition that features a metadata hash of the asset. This allows upstream processes to find out whether or not a web page has already been processed and if its content material has modified. The important thing advantages of this method embody:

• Assuaging redundant processing of the identical pages, contributing to PerformLine experiencing a 15% workload discount in human analysis duties. This frees time for human evaluators and permits them deal with important pages somewhat than all of the pages.
• Avoiding reprocessing unchanged pages, dynamically decreasing PerformLine’s analysts’ workload by over 50% along with deduplication positive aspects.

LLM inference prices can escalate at scale, however context and thoroughly structured prompts are important for accuracy. To optimize prices whereas sustaining precision, PerformLine carried out a multi-pass method utilizing Amazon Bedrock:

• Preliminary filtering with Amazon Nova Micro – This light-weight mannequin effectively identifies related merchandise with minimal price.
• Focused extraction with Amazon Nova Lite – Recognized merchandise are batched into smaller teams and handed to Amazon Nova Lite for deeper evaluation. This retains PerformLine inside token limits whereas bettering extraction accuracy.
• Elevated accuracy via context-aware processing – By first figuring out the goal content material after which processing it in smaller batches, PerformLine considerably improved accuracy whereas minimizing token consumption.

Use of Amazon Bedrock

Throughout preliminary testing, PerformLine shortly realized the necessity for a extra scalable method to immediate administration. Manually monitoring a number of immediate variations and templates turned inefficient as PerformLine iterated and collaborated.

Amazon Bedrock’s Immediate Administration service supplied a centralized resolution, enabling them to model, handle, and seamlessly deploy prompts to manufacturing. After the prompts are deployed, they are often dynamically referenced in AWS Lambda, permitting for versatile configuration. Moreover, by utilizing Amazon Bedrock utility profile inference endpoints, PerformLine can dynamically alter the fashions the Lambda operate invokes, monitor price per invocation, and attribute prices to particular utility cases via establishing price tags.

To streamline mannequin interactions, PerformLine selected the Amazon Bedrock Converse API which gives a developer-friendly, standardized interface for mannequin invocation. When mixed with inference endpoints and immediate administration, a Lambda operate utilizing the Amazon Bedrock Converse API turns into extremely configurable—PerformLine builders can quickly check new fashions and prompts, consider outcomes, and iterate without having to rebuild or redeploy. The simplification of immediate administration and talent to deploy varied fashions via Amazon Bedrock is proven within the following diagram.

Complete AWS ML mannequin configuration structure highlighting three essential elements: Inference System: Mannequin ID integration Profile configuration Content material administration Inference settings Immediate Administration: Model management (V1 and Draft variations) Publish ID monitoring Mannequin A specs Retailer configurations Setting Management: Separate PROD and DEV paths Setting-specific parameter shops Invoke ID administration Engineering iteration monitoring

Future plans and enhancements

PerformLine is worked up to dive into extra Amazon Bedrock options, together with immediate caching and Amazon Bedrock Flows.

With immediate caching, customers can checkpoint immediate tokens, successfully caching context for reuse in subsequent API calls. Immediate caching on Amazon Bedrock gives as much as 85% latency enhancements and 90% price discount compared to calls with out immediate caching. PerformLine sees immediate caching as a function that may turn out to be the usual shifting ahead. They’ve quite a lot of use instances for his or her information, and being able to use additional evaluation on the identical content material at a decrease price creates new alternatives for function growth and improvement.

Amazon Bedrock Flows is a visible workflow builder that permits customers to orchestrate multi-step generative AI duties by connecting FMs and APIs with out intensive coding. Amazon Bedrock Flows is a subsequent step in simplifying PerformLine’s orchestration of data bases, immediate caching, and even Amazon Bedrock brokers sooner or later. Creating flows will help scale back time to function deployment and upkeep.

Abstract

PerformLine has carried out a extremely scalable, serverless, AI-driven structure that enhances effectivity, cost-effectiveness, and compliance within the internet content material processing pipeline. By utilizing Amazon Bedrock, EventBridge, Amazon SQS, Lambda, and DynamoDB, they’ve constructed an answer that may dynamically scale, optimize AI inference prices, and scale back redundant processing—all whereas sustaining operational flexibility and compliance integrity. Based mostly on their present quantity and workflow, PerformLine is projected to course of between 1.5 to 2 million pages each day, from which they anticipate to extract roughly 400,000 to 500,000 merchandise. Moreover, PerformLine anticipates making use of guidelines to every asset, leading to about 500,000 rule observations that may require assessment every day.All through the design course of PerformLine made positive their resolution stays so simple as doable whereas nonetheless delivering operational flexibility and integrity. This method minimizes complexity, enhances maintainability, and accelerates deployment, empowering them to adapt shortly to evolving enterprise wants with out pointless overhead.

By utilizing a serverless AI-driven structure constructed on Amazon Bedrock, PerformLine helps their clients deal with even essentially the most complicated, multi-product webpages with unparalleled accuracy and effectivity. This holistic method interprets visible and textual parts as a typical shopper would, verifying that each product variant is precisely assessed for compliance. The ensuing insights are then fed instantly right into a guidelines engine, enabling speedy, data-driven choices. For PerformLine’s clients, this implies much less redundant processing, decrease operational prices, and a dramatically simplified compliance workflow, all with out compromising on pace or accuracy. By decreasing the overhead of large-scale information evaluation and streamlining compliance checks, PerformLine’s resolution in the end frees groups to deal with driving innovation and delivering worth.

Concerning the authors

Bogdan Arsenie is the Chief Know-how Officer at PerformLine, with over 20 years of expertise main technological innovation throughout digital promoting, large information, cell gaming, and social engagement. Bogdan started programming at age 13, customizing bulletin board software program to fund his ardour for Star Trek memorabilia. He served as PerformLine’s founding CTO from 2007–2009, pioneering their preliminary compliance platform. Later, as CTO on the Rumie Initiative, he helped scale a worldwide schooling initiative acknowledged by Google’s Influence Problem.

Nick Mattei is a Senior Software program Engineer at PerformLine. He’s targeted on options structure and distributed utility improvement in AWS. Exterior of labor, Nick is an avid bike owner and skier, all the time on the lookout for the subsequent nice climb or powder day.

Shervin Suresh is a Generative AI Options Architect at AWS. He helps generative AI adoption each internally at AWS and externally with fast-growing startup clients. He’s obsessed with utilizing expertise to assist enhance the lives of individuals in all elements. Exterior of labor, Shervin likes to cook dinner, construct LEGO, and collaborate with individuals on issues they’re obsessed with.

Medha Aiyah is a Options Architect at AWS. She graduated from the College of Texas at Dallas with an MS in Pc Science, with a deal with AI/ML. She helps ISV clients in all kinds of industries, by empowering clients to make use of AWS optimally to realize their enterprise targets. She is very all for guiding clients on methods to implement AI/ML options and use generative AI. Exterior of labor, Medha enjoys mountain climbing, touring, and dancing.

Michael Zhang is a generalist Options Architect at AWS working with small to medium companies. He has been with Amazon for over 3 years and makes use of his background in pc science and machine studying to assist clients on AWS. In his free time, Michael likes to hike and discover different cultures.