Google [just announced you can use Bard in BigQuery](https://cloud.google.com/bigquery/docs/reference/standard-sql/bigqueryml-syntax-generate-text) to do Generative AI at scale. That means you can run your queries right inside of your data warehouse, where your data lives. No more rate limits, HTTP clients, error messages, etc.

Well, it's not exactly [Bard](https://bard.google.com/)... it's actually [PaLM 2](https://ai.google/discover/palm2/), called [`text-bison` in Vertex AI](https://cloud.google.com/vertex-ai/docs/generative-ai/learn/models) land.

It works as "one shot" prompts - where you give it context inside of the prompt itself. It won't remember what you tell it, so it's **safe to use on biz data**. You can use [Vertex AI API to fine-tune your model](https://cloud.google.com/vertex-ai/docs/generative-ai/models/tune-models) and I'm expecting this to be available via SQL soon.

First, create a US-based dataset: (or use one you already have... or another region that supports LLM)

```bash
bq mk --dataset --location us --project_id=$PROJECT_ID $DATASET_ID
```

Next, create a BigQuery connection: (there is no way to do this in SQL as far as I know)

```bash
$ bq mk --connection --connection_type=CLOUD_RESOURCE --location us --project_id=$PROJECT_NAME
Connection 78793318712.us.40833e7c-1c99-440f-911b-c553cf8485f1 successfully created
```

Next, see what service account is associated with that connection: (look at the end of the table)

```bash
$ bq show --connection 78793318712.us.40833e7c-1c99-440f-911b-c553cf8485f1
Connection 78793318712.us.40833e7c-1c99-440f-911b-c553cf8485f1

                          name                           friendlyName   description    Last modified         type        hasCredential                                            properties
 ------------------------------------------------------ -------------- ------------- ----------------- ---------------- --------------- -----------------------------------------------------------------------------------------------
  78793318712.us.40833e7c-1c99-440f-911b-c553cf8485f1                                25 Jun 17:35:01   CLOUD_RESOURCE   False           {"serviceAccountId": "bqcx-78793318712-abcd@gcp-sa-bigquery-condel.iam.gserviceaccount.com"}
```

Next, give the service account associated with that connection access to Vertex AI:

```bash
gcloud projects add-iam-policy-binding $PROJECT_ID \
  --member='serviceAccount:bqcx-78793318712-abcd@gcp-sa-bigquery-condel.iam.gserviceaccount.com' \
  --role='roles/aiplatform.user'
```

Next, create a remote model inside of BigQuery: (use the connection ID you got above, and note that I'm naming the model `my_llm_1`)

```sql
CREATE OR REPLACE MODEL
  `$PROJECT_ID.$DATASET_ID.my_llm_1`
REMOTE
WITH CONNECTION `projects/$PROJECT_ID/locations/us/connections/40833e7c-1c99-440f-911b-c553cf8485f1`
OPTIONS (remote_service_type ='cloud_ai_large_language_model_v1')
```

Then you should be able to run LLM queries:

```sql
SELECT
  *
FROM
  ML.GENERATE_TEXT(
    MODEL `$PROJECT_ID.$DATASET_ID.my_llm_1`,
    (
      SELECT
        "Say hello world" AS prompt
    ),
    STRUCT()
  )
```

But the killer app for LLM in the data warehouse is to **run prompts across tables full of data**. Here's how I tried sentiment analysis for some financial products:

```sql
CREATE TABLE `$PROJECT_ID.$DATASET_ID.my_outputs` AS (
  SELECT
    my_id,
    ml_generate_text_result["predictions"][0]["content"] AS sentiment_analysis,
  FROM
    ML.GENERATE_TEXT(
      MODEL `$PROJECT_ID.$DATASET_ID.my_llm_1`,
      (
        SELECT
          -- return my id so I can join this back to my data
          my_id,
          CONCAT(
            "Please provide an entity sentiment analysis of bonds, annuities, and CDs in the following text: ",
            text_content
          ) AS prompt,
        -- here's the magic: running a prompt for every row of `my_inputs` table
        FROM `$PROJECT_ID.$DATASET_ID.my_inputs`
      ),
      -- tell the LLM not to be super creative, but just return the highest probability results always
      STRUCT(
        0 AS temperature,
        1 AS top_k
      )
    )
)
```

Here's the final production query that uses some regex parsing to extract structured data from the LLM response:

````sql
CREATE TABLE `$PROJECT_ID.$DATASET_ID.my_outputs` AS (
  SELECT
    my_id,
    CASE
      -- if it gives back raw JSON, use it
      WHEN LEFT(JSON_VALUE(ml_generate_text_result["predictions"][0]["content"]), 1) = '{'
      THEN SAFE.PARSE_JSON(JSON_VALUE(ml_generate_text_result["predictions"][0]["content"]))
      -- if it gives back JSON inside a markdown block, use it
      ELSE SAFE.PARSE_JSON(REGEXP_EXTRACT(JSON_VALUE(ml_generate_text_result["predictions"][0]["content"]), r'```json([^`]+)```'))
    END AS sentiment_analysis,
  FROM
    ML.GENERATE_TEXT(
      MODEL `$PROJECT_ID.$DATASET_ID.my_llm_1`,
      (
        SELECT
          my_id,
          CONCAT(
            "Please provide, as a JSON object with only entity and sentiment, an entity sentiment analysis of bonds, annuities, and CDs in the following text: ",
            -- remove backticks that might interfere with parsing response
            REGEXP_REPLACE(text_content, r'`', "")
          ) AS prompt,
        FROM `$PROJECT_ID.$DATASET_ID.my_inputs`
      ),
      STRUCT(
        0 AS temperature,
        1 AS top_k
      )
    )
)
````

I'm hoping it will get easier to extract structured results soon, using [jsonformer](https://github.com/1rgs/jsonformer) for example.

Thanks to the [BigQuery ML team](https://cloud.google.com/bigquery/docs/bqml-introduction) for implementing this. I think it's the obvious place for LLM!

Google just released LLM support inside of BigQuery. Here's how to start using it today.

How to use Google Bard in BigQuery (quickstart)

If you have at least 2000 payments, Stripe data probably contains your buyer signal - the unique patterns that predict who will buy from you.

Last month, a friendly brand exported about 10,000 payment records from Stripe as a CSV. Then they uploaded them to Faraday and, within 24 hours, got their results:

![Buyer signal showing importance of different features](/images/blog/buyer-signal.png)

Let's focus on one feature - "Science/new technology." If a person is interested in this, they are much more likely to buy this brand's products:

![Likelihood to buy based on science interest](/images/blog/science-directionality.png)

Faraday is batteries-included - we know things like whether people like science thanks to our [built-in consumer data](https://faraday.ai/features/data).

Now, this brand can predict the likelihood of more than **240 million Americans** to buy their product. Faraday can take any list of people and sort it by likelihood to buy... or Faraday can generate the list in the first place, using a ["Deployment"](https://faraday.ai/docs/abstractions/deployments).

So... how did they get this? First, by doing a [Stripe Payment Report](https://support.stripe.com/questions/exporting-payment-reports). In particular, doing a [**Successful Payments**](https://dashboard.stripe.com/payments?status%5B%5D=successful) report.

![You want Succeeded payments](/images/blog/stripe-payment-export-succeeded.png)

Faraday only needs the following fields:

![PII, date, and amount fields](/images/blog/stripe-custom-columns.png)

(Later, you can set up an automated integration. But for now, since this is a relatively stable model based on inherent consumer characteristics, it should be stable for at least a few weeks.)

In Faraday, you map the fields:

![Address mapping](/images/blog/stripe-dataset-identity-mapping.png)

Then, [follow the standard process for importing transactions](https://faraday.ai/docs/cohorts/customers_from_hosted_csv#option-a-each-row-represents-a-transaction-event).

And finally, you make a [likely buyers model](/docs/abstractions/outcomes).

In total, if this takes longer than 15 minutes, [email the CTO](mailto:seamus@faraday.ai) because that's a critical bug!

Happy Signal Hunting!

-Seamus

PS. When this brand loaded our model into Facebook, we immediately started beating Facebook's internal model, even though we were still in learning phase...

![Beating Facebook](/images/blog/stripe-adset.png)

[Sign up](https://faraday.ai/signup) free today.

If you have at least 2000 payments, Stripe data probably contains your buyer signal - the unique patterns that predict who will buy from you.

How to determine buyer signal from Stripe payments

Using machine learning to identify customer personas in your data can help improve your understanding of your customer base, and with the right infrastructure, deliver personalized experiences at a greater scale.

In a nutshell, the process entails using an algorithm to segment your customer data into distinct groups, or personas. Faraday uses a time-tested method called k-means clustering.

## What is k-means clustering?

K-means clustering is an unsupervised clustering algorithm that was first introduced in 1957. An unsupervised algorithm does not require the data to be labeled in order to train the model. This is an important feature of the k-means algorithm because it allows for the discovery of subgroups within the data without any previous assumptions about possible groupings — in this case, personas.

## How does k-means clustering work?

When presented with a data set, the k-means algorithm first introduces random center points around which each data point will eventually be clustered (circles, Fig. 1). Then each data point is assigned to the group of the center to which they are closest.
This happens by calculating the distance from a data point to each cluster center using an equation known as the Euclidean distance measure. For two dimensions, the Euclidean distance is represented by the diagonal line connecting the point to each of the cluster centers. The point is then assigned to the cluster center with the shortest diagonal line (Fig. 2).

Once each point has been assigned to the randomly chosen cluster centers, the centers then "update," moving to the center of the group by recalculating the mean (average) distances to all the points in the group (Fig. 3).

After the cluster centers have updated to their new positions, each point is reassigned to a new group using the Euclidean distance measure again. Most of the points will remain in their original groups, but some points will be assigned to a new group (Fig. 4). So, then the centers must be updated again to be at the center of the new group. This pattern repeats until the centers no longer move.

## Using k-means clustering for customer personas

All of the above is how k-means clustering worked back in 1957. Since then there have been upgrades allowing us to use something called categorical features. At Faraday, we create persona groups using a mix of these features.

As far as algorithms go, k-means is rather straightforward, but has one major downfall: you have to tell it how many groups to look for, and it will always succeed in finding that many groups. That means if you tell the algorithm to look for 500 groups, it will find them — even if there is no reason for there to be 500 distinct groups within the data.

If you're a marketer, you probably don't want to create 500 unique ads for every campaign. But should you make four? Or six? Or ten?

## How to find the optimal number of personas using k-means clustering

We target the optimal number of groups hidden within the data, rather than guessing and hoping we are right. We’ll share a few methods we use to find the optimal number of personas for our users.

### The elbow method: finding diminishing returns

The most common metric for measuring the success of k-means clustering is called the ratio of sum of squares (rss). At Faraday, we determine the optimal number of personas by comparing the rss for k-means models with two to fourteen personas. We employ the elbow method, which shows the cutoff after which we see diminishing returns for increasing the number of personas. For most clients, the optimal number of distinct personas is usually between four and seven.

**Going beyond the elbow method**

The elbow method is simple, but it has a downside: sometimes, there just isn't a clear single point that is optimal. Maybe three personas could be optimal, maybe six, and we have to intervene based on our client’s business needs to choose one or the other as the optimal number of personas.

Additionally, while reducing variability within each group is an extremely useful way to measure k-means clustering success, it doesn't tell the whole story. We believe that an important aspect of clustered groups is stability, which isn't considered with the elbow method selection process. Our clients expect that their persona groups won't shift every time they convert a lead. This is why we are currently researching a new method for determining the optimal number of personas, which focuses on the stability of the persona group.

### The bootstrap method: focusing on stability

Our first step to assess the stability of k-means clustering involves resampling the client’s data using the bootstrap method. Like k-means clustering, bootstrapping has been around for a while – it was first [introduced in 1979 by Bradley Efron](https://projecteuclid.org/journals/annals-of-statistics/volume-7/issue-1/Bootstrap-Methods-Another-Look-at-the-Jackknife/10.1214/aos/1176344552.full). The basic idea behind bootstrapping is to take data from the pool we have, with the ability to pick the same data point multiple times. This is a method known as sampling with replacement.

The bootstrap method provides us with a powerful tool to measure how much our desired clustering outcome could change with different data. We can get a good sense of how much the personas will change with the addition of new customers. Our goal is to minimize how much influence single customers, or small groups of customers, have on the resulting personas. We want personas that remain relatively unchanged by single customers. In other words, we want more stability.

## Pulling it all together

Once we have the results from bootstrapping, we use the ratio of sum of squares again to measure just how stable the personas are. What we’re looking for is a ratio close to 1, which would indicate that there is no variability within the personas.

The stability metric for determining the optimal number of personas shows promising results for the basic examples in this blog post. At Faraday, we’re actively working on applying this methodology to the more complex persona groupings our clients rely on. Stay tuned for more developments with respect to improving our personas methodology.

Learn how machine learning is used to identify distinct clusters—or personas—in your customer data.

How k-means clustering is used to identify customer personas

[Propensity predictions](https://faraday.ai/features/predictions) indicate the likelihood of an individual to perform a defined action (buy, buy again, churn, etc.), which enable businesses to grow and retain revenue by engaging with the right customers, leads, or audiences at the right time. To get accurate propensity predictions, you need a good propensity model. Here’s how Faraday approaches propensity modeling.

## Selecting the right propensity model

Our prediction system classifies against outcomes using an array of predictive algorithms, including individual decision trees, random decision forests, logistic regressions, and neural networks. At run time, we are attempting, in each case, to figure out which algorithm works best. Usually it’s random decision forests.

## How random decision forests work

Random decision forests are made up of individual decision trees, which are classifier algorithms that look like flow charts, showing the choices made to reach a certain outcome.

Predictions aren’t based on a single tree, though; we use dozens of trees to improve the accuracy of the algorithm, hence the random decision forest. We look at the universe of trees, their splits and branches, and choose the ones that are the most promising when it comes to creating a path towards the desired outcome. This path leads from seemingly arbitrary data to a classification: the “yes” or “no” to the outcome. In other words, we're defining someone as a “good potential customer.” (In the image above, the “yes” is “mostly converted” and the “no” is the “mostly did not convert.”)

While the classification seems binary, the reality is that often there's not a clear “yes” or “no.” We are dealing with the likelihood that someone performs an action, and that is never definitively 100% or 0%. During the prediction process, we employ propensity scores, which are a way of saying, “This person is more likely to be a good potential customer than not.” Every individual in the group we’re looking at is scored, and those in the top percentiles are recommended to the client as the best fits for the outcome they want to realize.

_Now, if there are so many predictive algorithms we can use, why do we choose random decision forests?_

## Benefits of predicting propensity using random decision forests

### Building explainable models

Well, for one, they’re the most explainable; with so many decision trees at play, we have a strong sense of the different importances at each node split in a tree. These importances show us which attributes contribute most toward the success of an outcome, or the most toward failure.

### Handling missing data

The random decision forest technique also handles missing data very well, especially compared to a logistic regression or neural network, which both tend to require values to make predictions. In a decision tree, if there is a missing value, it moves onto the next node because there are other decision paths in the case of missing data. When you scale that to a whole random decision forest, the prediction becomes very accurate and isn’t perturbed by missing data.

### Identifying collinearity

A third reason we use random decision forests is collinearity. Random decision forests may see that some data are correlated — say, mortgage value and income. A lot of the attributes the algorithm deals with are linearly related but don’t necessarily directly drive a certain customer behavior.

A random decision forest algorithm finds areas of greatest information gain, meaning that it may realize there is interdependence between attributes, but it will choose the feature that gives the algorithm the greatest leverage over the prediction. This is particularly helpful for us, as we deal with tremendous amounts of customer data, and data on humans is generally noisy and often subverts expected distributions and assumptions.

## How propensity predictions help improve marketing efforts

Propensity predictions are especially helpful in improving campaign targeting efforts across a number of marketing channels. By identifying individuals ranked in the top percentile of the analyzed group—those that have the highest likelihood of performing the desired action—businesses typically see improvements in efficiency metrics (cost per acquisition, return on ad spend, etc.). Here are some popular business use cases for propensity predictions:

- Reaching likely buyers
- Driving repeat purchases
- Scoring and prioritizing leads

Learn how propensity models help predict the likelihood of individuals to exhibit a defined behavior.

How propensity models help predict customer behavior

Since the dawn of commerce, sellers have invested significant time and effort into figuring out what influences prospective buyers. Identifying your ideal customer—who they are, what they do, why they do it, and how they feel about various products and services—can help you craft powerful, people-first marketing campaigns that accelerate every sales cycle.

Building a customer insight strategy is the most efficient way to understand that ideal customer, evaluate your brand’s current situation, and adapt for the future. Here’s how you can get started.

## How to develop a customer insight strategy

To develop a customer insight strategy, you will need to focus on both qualitative and quantitative data. Gathering this information ensures you have a complete picture of who your ideal customer is, how they behave, and what their wants and needs are.

Identifying the key team players involved in the process and employing the right tools, techniques, and resources can take a lot of the guesswork out of building an insight strategy.

## Why customer insights are important for business growth

Competitive advantage begins with clear customer insights. Without a comprehensive customer insight strategy, brands are bound to miss out on crucial data that has the power to significantly impact their bottom line.

A customer insight strategy can unlock a wealth of information about your customers and what influences their purchases. Through a combination of consumer data, feedback, social listening, and website analytics, you can begin to draw conclusions about how your customers behave and why. This knowledge can help you improve the customer journey and create an experience that is truly memorable for those who purchase your product or service.

Having a strong foundational awareness of customer insights is the first step to developing a strategy of your own.

## Key components of a customer insight strategy

### Objectives

A clear understanding of why you want to gather customer insights can make developing a strategy easier. What is your reasoning behind gathering insights, and what do you hope to do with this data once you have it?

Maybe you’re hoping to increase revenue by a certain percentage next quarter or determine whether your current pricing strategy aligns with your competitors’. Maybe your ad campaigns aren’t converting like they used to and need to be refreshed. Or perhaps you’re exploring ways to optimize your current content strategy and attract a new audience. All these objectives can be achieved through a smart customer insight strategy.

### Research and data

A viable customer insight strategy calls for a combination of high-quality research and data. From customer interviews and social listening to surveys and focus groups, gathering data about your customers’ preferences can help influence your marketing strategy and content creation.

This emphasis on first-party data is increasingly important as the [end of third-party cookies](https://faraday.ai/blog/death-of-third-party-cookies-strategies) approaches, but you may also consider [responsibly sourced data](https://faraday.ai/features/data) from other vendors to add even more depth to your customer profiles.

Of course, high-quality data is of little use if there is no one to analyze it. A strong analytics team can help brands make sense of the noise and pull focus to the trends that matter most.

### Audience

There is no one-size-fits-all approach to customer insights. Before you can begin gathering valuable data, you’ll need to take a close look at which segment of customers you want to explore. For example, analyzing your current customer base will require a different approach than analyzing potential customers. Knowing whose insight is valuable in achieving certain objectives will ensure you use your time and resources as effectively as possible.

Keep in mind: customer feedback doesn’t always have to be about you to be useful. It doesn’t have to be gathered exclusively from your own customers, either. Finding out what people think about your competitors, for example, can provide a glimpse into what drives customers within your industry to buy.

### Customer journey map

Data-driven insights have the power to affect every level of decision-making when creating and marketing a product. As you gather data about your target audience, it should help you build a better understanding of your brand’s customer journey. Leverage those insights to create or refine a map of customer interactions with your brand—that way, you can skip the guesswork when it comes to what messaging and offers your audience should get at every step of their journey.

For instance, if most customers hear about your brand through digital channels but make their final purchase in-store, your campaigns should facilitate that leap from online to offline interactions. On the other hand, if most customers interact with multiple digital touchpoints before buying online, you’ll want to use those insights to guide them from touchpoint to touchpoint.

### Customer personas

Once you’ve thoroughly collected and analyzed your customer data, and determined what the typical customer journey looks like, you can take your customer insight strategy one step further to develop customer personas.

Personas are a means of clustering your customer base into distinct groups that share certain similarities. One persona group may contain customers who mostly have young families, live in the suburbs, and like to shop at brick-and-mortar stores; another may be digitally-native young professionals or wealthy urbanites. By honing in on the key customer insights that define each persona, you can tailor your campaigns to their unique interests and [better personalize every customer interaction](https://faraday.ai/predict/category/persona_assignments).

### AI enhancements

Sifting through such an enormous amount of data and unifying insights across platforms can be a huge endeavor. For some brands, off-the-shelf AI tools are the most straightforward way to enrich and make sense of all their customer data. Some of the ways they achieve this with AI include:

- Enhancing customer data with an identity graph to create detailed customer profiles
- Scoring leads based on how likely they are to purchase a product
- Predicting the lifetime value of potential or current customers
- Developing powerful quantitative persona groups
- Building lookalike audiences of good fits for use on any marketing channel
- Identifying which customers are at highest risk of churning

## Conclusion

Just about every successful brand relies on customer insights to inform their decision-making. Once you’ve pulled together all the components of your customer insight strategy, you can review them holistically to determine which insights offer the most potential for your team to work with.

An effective customer insight strategy can take the pressure off your sales and marketing teams, improve overall customer satisfaction, drive customer retention, and increase profitability over time. There’s no question that it’s worth your team’s time to get it right.

At Faraday, we offer a number of customer insight tools that allow brands to enhance their first-party data with responsibly sourced, opt-in consumer data and develop powerful, personalized marketing campaigns.

Learn what goes into a successful customer insight strategy and how you can start gathering the data you need to truly understand your customers.

How to create a customer insight strategy

Every marketer knows that personalization is critical. Once considered a nice touch to spruce up campaigns, today it’s a full-on necessity for digital-first brands. Plus, the bar for personalization is getting higher and higher, to the point that consumers expect real-time, highly-curated interactions on every marketing channel.

The groundwork for personalized marketing begins with knowing your customer. Before you can so much as sketch out a campaign idea, you need to know who you’re marketing to. However, even this seemingly simple question is getting a lot more complicated thanks to the phase-out of the third-party cookie.

Nowadays marketers need to take stock of their cookieless identity resolution options and ensure they have the rich customer profiles they need to achieve true personalization.

Looking for cookieless options for enhanced customer data? Eager to add more sophisticated personalization strategies to your arsenal? Here's what this article covers:

- Customer insights and segmentation
- Personalized advertising
- Personalized product recommendations
- Personalized promotions

## Personalization starts with segmentation

Third-party cookies have always gone hand in hand with personalized marketing, since they’ve unlocked access to swaths of data that marketers can use for surgically precise segmentation. But [the end of the cookie](https://faraday.ai/blog/death-of-third-party-cookies-strategies) doesn’t have to sound the death knell for highly personalized ads. If anything, it’s ushering in a new era of more meaningful personalization strategies, where people see content that speaks to them as people, not a click to be retargeted.

### Adding consumer data to the mix

Segmentation is still key to achieving human-centric interactions. Without third-party cookies, you can certainly segment your first-party data, but frankly, it won’t offer enough nuance to craft personalized campaigns. Now more than ever, marketers need to prioritize [data enrichment from responsible sources](https://faraday.ai/features/responsible-ai). This cookieless consumer data enables brands to build out rich customer profiles based on a wealth of demographic, psychographic, and firmographic data.

Once you’ve enhanced your first-party data, you’ll have the full picture you need to segment your audience in a meaningful way. This might mean segmenting by income level, household size, or even hobbies and interests. The savviest brands go even further and leverage machine learning algorithms to parse through billions of data points, surface the most significant patterns in their audience, and cluster their customers into highly accurate persona groups.

All of this paves the way for true [personalization at scale](https://faraday.ai/predict/category/persona_assignments). By segmenting your audience into clusters or personas, you can craft highly personalized campaigns that speak to each unique segment and orchestrate more meaningful interactions across channels.

If that sounds like a plan, read on for the strategies you can use to start bringing those campaigns to life.

## Personalizing ad campaigns

Personalized advertising is a fantastic tool for connecting with good fits across the buyer’s journey. Since consumers are bombarded with ads all day long — social media, TV, radio, podcast, flyers, billboards — meaningfully personalized ads help cut through the noise and create an immediate connection.

### Using personas to create custom audiences

It’s one thing to segment your existing audience based on [rich consumer data](https://faraday.ai/features/data), but quite another to personalize ads for potential customers who aren’t yet known to you. Lookalike audience options from platforms like Facebook used to reliably expand brands’ reach to new pools of good fits, but with the advent of iOS 14 and Apple’s privacy updates, these lookalikes have lost a lot of signal and are less cost-effective by the day. You’ll need additional strategies up your sleeve to reach new audiences.

One such strategy involves seeding Facebook lookalikes with AI-driven personas, which gives Facebook a more defined seed audience to work with and enhances its ability to surface consumers that fit your personas. Think of it like giving Facebook’s algorithm a bit of a boost. Then, you can craft highly personalized ad campaigns for individuals you would never have reached otherwise. Brands doing this typically see increased conversion rates and lower CPA.

Another option is to skip Facebook’s native lookalikes and leverage AI to build your own custom lookalike audiences. In this strategy, algorithms can uncover great fits from an identity graph and match them to your brand’s personas, providing you with fresh audiences to upload to Facebook or any other ad platform — greatly expanding your audience beyond what these platforms would normally surface.

With these in place, and your personas already established, you can personalize your ad campaigns with confidence in spite of having never interacted with the audience before.

## Personalized product recommendations

Once someone has made themselves known to your brand— for instance, subscribing to your email list, creating a free online account, or signing up for a rewards program — personalized product recommendations are another invaluable strategy. You can leverage insights in your CRM to create a truly personalized experience on your website, in-store, via email marketing, and more.

Crucially, consumers have high expectations for these experiences. In such a competitive market, where shoppers can find dozens of similar products and services online with just a quick Google search, it’s the real-time, personalized interactions that help brands stand out from the crowd and earn their trust. Orchestrating this type of personalization requires sophisticated automation and algorithms to make recommendations instantaneously and at scale.

### Personalized recommendations based on journey stage

Truly personalized recommendations tend to come back to great life cycle marketing. Once you have an accurate picture of where current and potential customers fall on the buyer’s journey, you can map recommendations to each stage — such as promoting a product quiz or survey to your social followers in order to collect more first-party data, launching email campaigns that are tailored to your unique personas, or nudging customers about new releases.

With most modern ESPs and email marketing platforms, such as Iterable, Klaviyo, and MailChimp, you can also build powerful workflows to trigger personalized product recommendations based on specific actions. For a financial organization, this could look like an email with more information on home loan options after a lead schedules a consultation. For an apparel brand, it could mean triggering an alert that an item has come back in stock for every rewards member who'd added it to their virtual wish list.

By aligning recommendations with an individual’s journey stage and automating them to be delivered at the perfect moment, you create the real-time, personalized interactions today’s consumers crave — and you’ll see the results in your revenue.

### Personalized recommendations with predicted purchases

For marketing teams that have already dialed up product recommendations and want to offer even more valuable suggestions to potential customers, there’s also the option to take it one step further with predictive journey mapping. Rather than make an assumption about what a person is going to purchase, this entails using AI to actually predict what they’ll get.

These [predictions](https://faraday.ai/features/predictions) are far more accurate than any other product recommendation you could make, allowing your marketing efforts to become less like a sales pitch and more like the advice of a trusted friend. Just like automated email campaigns, these predictions can be triggered from a platform like Iterable to deliver the perfect recommendation to a given individual at the perfect time.

## Personal discounts and pomotions

Sometimes consumers need a little extra encouragement to get them to commit. For these individuals, a well-timed promotion or discount can make an enormous difference. The trick is to tailor the promotion to the consumer in order to protect your bottom line — after all, you don’t want to offer 15% off or a first month free to someone who’s likely to pay full price, but you definitely want that to be an option for valuable lead that’s on the fence.

### Using personalized discounts to build brand affinity

To be certain that you’re only offering discounts to the customers that matter most, customer lifetime value (LTV) predictions can eliminate an enormous amount of guesswork. LTV is difficult to determine on your own, but a wide variety of AI tools available to marketers make it a piece of cake.

With LTV predictions uploaded to Salesforce, HubSpot, or wherever you track your customer information, it becomes much clearer how to personalize discounts for distinct audiences. You may want to try rewarding your most valuable customers with a discount, as a small thanks for their brand loyalty, or you may want to test out special offers for customers with middling LTV to see if that extra push inspires them to spend even more.

### Using personalized discounts to retain high-value customers

Another proven discount strategy relies on [churn prediction](https://faraday.ai/predict/category/churn_scores). As with all things predictive, AI is the best tool to utilize here, with churn predictions at least five times more accurate than those that traditional methods produce. Once you understand exactly which customers are at the highest risk of falling away, you can intervene proactively, with a personalized touch, rather than reactively.

For instance, you can tailor the discount to the level of churn risk. High-value customers at great risk of churn might deserve a generous discount offer, whereas customers with lower risk can get a smaller one. And just like with product recommendations and LTV predictions, churn predictions can be delivered seamlessly to wherever your team needs them most, whether that’s triggering an email drip or refreshing the customer profile in your CRM — empowering you to provide a seamless customer experience.

## Level up your personalization strategies today

Whether you’re just getting started with personalization or are looking to truly master 1:1 communication at scale, you’ve got numerous opportunities available at every stage of the buyer’s journey. Consumers overwhelmingly prefer personalized offers, and an increasingly crowded digital space is making it harder and harder to gain an edge — so it’s more important than ever to double down on personalization before it’s too late.

Explore practical personalization strategies that leading brands use to create more enjoyable experiences across the customer lifecycle.

5 ways to personalize experiences across the customer lifecycle

Iterable interviews Faraday's CEO to unlock the secrets to automated personalization using consumer data and AI responsibly.

AI and the future of personalized marketing with Iterable & Faraday

With brand trust at an [all-time low](https://www.havasgroup.com/press_release/havas-meaningful-brands-report-2021-finds-we-are-entering-the-age-of-cynicism/), it’s a good time to ask: is your organization doing the right thing with consumer data? 50% of consumers say they’d pay more for a brand that takes a stand on important issues. With privacy at the heart of a global reassessment of social media, big tech, and surveillance, organizations at the vanguard of this issue will win in 2022.

The good news is that playing fair isn’t all that complicated. “When in doubt, follow your heart,” says Andy Rossmeissl, CEO of Faraday, the leading customer prediction platform. “Our motto from the start has been ‘don’t be creepy,’ and it’s remarkable how far that can take you.”

Looking for specifics? Here are the top 3 rules for using customer data ethically:

## Rule 1: Use identifiers people can recite from memory.

This rule sounds simple, but it’s surprisingly powerful. “Ask your mom if she knows any of her tracking cookies by heart,” suggests Rossmeissl. “Ask yourself what your mobile device ID is.” The digital surveillance panopticon relies on these [long, unique strings](https://www.quora.com/What-does-the-code-for-a-tracking-cookie-look-like) of gibberish assigned to virtually every eyeball in the world.

Instead, ask yourself what identifiers you have that you can actually recite. “I have an address on my mailbox for all the world to see, and you probably do too,” says Rossmeissl. “I put my number in the phone book, and my email address is all over the Internet.”

Relying on real-world identifiers, or “known identities,” has the additional benefit of steering brands away from collecting and using anonymous behavior, such as data collected from unidentified web and mobile visitors. “Until somebody has identified themselves to you," explains Rossmeissl, "tracking their behavior is, frankly, creepy.”

## Rule 2: Use data that comes from commercial behavior

“I call it the ‘laying in bed rule,’” Rossmeissl shares. “When I’m laying in bed and I read a news article on my tablet or like something on Instagram, that’s private. Watching me do that is creepy.”
The surveillance of private behavior has rapidly normalized, much to the dismay of both privacy experts and, increasingly, consumers alike. A 2019 study found that nearly two thirds of Americans believe they can’t go through daily life without their data being collected.

And yet marketers have long known the power of data-driven growth practices. How can brands [use consumer data while still respecting privacy](https://faraday.ai/features/responsible-ai)? Rossmeissl shares:

> We thought long and hard about this when we started Faraday in 2012. We drew on anthropology, architecture, history, and other disciplines for our research, but the result was fairly simple.

> It turns out that commerce is one of the main reasons humans started to live in communities. Markets are some of the earliest forms of non-residential architecture we know of. No matter how you look at it, commerce and the marketplace have been with us longer than virtually any other social structure.

This provides a clue: humans are quite used to buying and selling, and they’re used to doing it in public. We have evolved an innate ability to operate in the marketplace, and an accompanying understanding that this behavior is public.

“What we put in our cart at the grocery store is public,” says Rossmeissl. “What we buy walking around a farmer's market is public. And when we buy online, there's an extension of this understanding. Engaging in commerce is a collaborative act — there's a buyer and a seller — and also a performative one.”

The upshot is that we instinctually treat data arising from commercial transactions as fair game. Luckily, this kind of data is not only the most ethical, but also some of the most powerful available for predicting subsequent consumer behavior. Faraday includes over 300 data points like this on virtually every US adult, but you can also procure your own from reputable licensing groups like Epsilon.

## Rule 3: Let people easily opt out

“Imagine being in a store and being told you can’t leave,” says Rossmeissl. “That goes from creepy to nightmarish very quickly.”

The right to opt out is at the heart of CCPA, the landmark privacy legislation. And while the law only protects California residents, brands should meet its requirements across the board. Luckily, that’s quite simple: provide an easy to use opt-out link, and pass along opt-outs both up- and down-stream to your partners.

Beyond the fact that [honoring opt-outs is actually good for business](https://sendgrid.com/blog/honoring-opt-outs-is-good-business/), it’s the right thing to do.

Is your organization doing doing the right things with consumer data? Here are 3 common-sense rules to follow.

3 common-sense rules for ethical data use 

During the pandemic, interest rates for home mortgages reached all-time low. As people were spending significantly more time at home, buying a house — especially for those who relocated out of denser cities — has become a more practical option than renting. In August 2020, [home sales shot up](https://www.businessinsider.com/how-2020-broke-the-housing-market-inventory-could-run-out-2020-9) to reach a 14-year high.

Millennials in particular have made their mark on the real estate business, as they now make up the largest share of home buyers in the country, according to the [National Association of Realtors](https://www.nar.realtor/research-and-statistics/research-reports/home-buyer-and-seller-generational-trends). However, many businesses that service the home, like HVAC contractors, report that they [do not focus on millennials](https://www.achrnews.com/articles/144348-ignore-millennials-if-you-dont-want-to-reach-homeowners) for their marketing campaigns. This is their loss, especially since millennial homeowners are at their fingertips on social media and digital platforms, where targeting younger demographics is a breeze.

So, if you’re in the business of home renovation, DIY tools, residential energy efficiency, or HVAC, consider the following when marketing to millennials — a generation eager to take you up on your services.

## Find millennial homeowners on the right channels

Millennials are a digitally native generation. A [global survey](https://www.gwi.com/reports/millennials) conducted by the Global Web Index in Q3 2020 looked at more than 66,000 internet users and found that millennials ages 24–37 spent an average of 2 hours and 30 minutes each day on social media alone.

If your brand is not capitalizing on social media, digital ads, and OTT options like streaming channels to reach millennial homeowners, you’re missing out on crucial brand awareness and conversion opportunities.

In addition to actively targeting specific audiences, be sure your SEM strategy is up to par, as millennials are big online researchers. Back in the day, newspaper and yellow pages ads may have cut it, but that’s all switched over to online search engines now. Ensure that your areas of interest and/or operation are prioritized in any search your brand may be relevant to.

And once you’ve got your lead on the hook, you can ease their journey to conversion by communicating on the platforms that are most convenient for them; this may be SMS text, video chat, or a website chatbox. From getting a quote for a solar installation to matching a desired paint color, millennials value seamless communication that meets them where they already are in the digital realm.\

## Cash in on millennials' renovation obsession

To accommodate growing families, remote work, and even houseplant obsessions, millennials are big into remodeling and DIY renovations — they’ve even been coined the “renovation generation.” Compared to both older and younger groups, millennials are [3X more likely](https://www.homeadvisor.com/r/wp-content/uploads/2020/12/DP6355-StateOfHomeSpending-2020-R4.pdf?ref=faraday-blog) to take on home office projects and additions. It’s imperative that contractors and home service providers take these trends into account when fleshing out marketing campaigns.

This could mean kitchen remodelers including messaging around spending more time cooking in the kitchen since dine-in options are still limited around the country; or perhaps construction companies advertising the ease of adding on a home office to accommodate remote work. Even video-based consultations can be a deciding factor for homeowners concerned about social distancing or eager for ease of access to an expert.

No matter the product or service, using digital marketing campaigns to introduce ideas for how millennials can improve their at-home lifestyles may spark interests homeowners didn’t know they had, bringing them closer to converting.

## Emphasize eco-friendly products and services

The millennial homeowner is no stranger to “going green” — this messaging has been prevalent throughout much of their life, so much so that [73% of millenials](https://www.inc.com/melanie-curtin/73-percent-of-millennials-are-willing-to-spend-more-money-on-this-1-type-of-product.html) are willing to pay more for sustainable products. Green features are especially popular when they’re sure to lower utility bills in the future.

[During the pandemic](https://porch.com/advice/home-improvement-trends-covid), 34% of homeowners have made their homes more environmentally friendly, with half of that percentage being millennials and Gen Z. On average, millennials are going to spend $10,000 this year alone on home improvement projects, and they recognize that their return is greater if those projects include eco-friendly materials and products.

So whether you’re offering the installation of more environmentally friendly heat pumps, solar panels, or even sustainably harvested hardwood flooring or low VOC paints, make a point to emphasize that your products are eco-friendly to further appeal to millennials. This angle may be even more effective if used to support social media campaigns, as those platforms serve as a hub for eco-conscious consumers proliferating sustainable home improvement solutions.

## Tap into trends to market to millennials

As a digitally native generation, millennials easily take to social media trends, especially those that are good for their wallets, the environment, and lifestyles at home. Tapping into the right channels with messaging relevant to millennial interests can improve the performance of your campaigns and attract the consumers who hold the most spending power in the economy.

Digital campaigns, relevant messaging, and eco-friendly products are key to wooing the largest share of homebuyers in the country.

Marketing to millenials: Tips for home services companies

**UPDATED FOR 2017** Now with easy subquery support and a more sensible argument order!

We adapted [this excellent piece by Dmitri Fontaine](http://tapoueh.org/blog/2014/02/21-PostgreSQL-histogram) and turned it into a function.

It can be invoked like this:

```
SELECT * FROM histogram($table_name_or_subquery, $column_name);
```

. . . to give sweet results like this, in a check of the distribution of 2016 political contributions in Vermont:

```
fec=# SELECT * FROM histogram('(SELECT * FROM small_donors_vt LIMIT 50000)', 'transaction_amt');

 bucket |   range   | freq |       bar
--------+-----------+------+-----------------
      1 | [0,9]     | 2744 | ******
      2 | [10,19]   | 5630 | *************
      3 | [20,29]   | 6383 | ***************
      4 | [30,39]   | 1290 | ***
      5 | [40,49]   |  369 | *
      6 | [50,59]   | 3541 | ********
      7 | [60,69]   |  174 |
      8 | [70,79]   |  313 | *
      9 | [80,89]   |  171 |
     10 | [90,99]   |   65 |
     11 | [100,109] | 2363 | ******
     12 | [110,119] |   51 |
     13 | [120,129] |  115 |
     14 | [130,139] |   32 |
     15 | [140,146] |   11 |
     16 | [150,159] |  187 |
     17 | [160,169] |   24 |
     18 | [170,177] |   33 |
     19 | [180,189] |   19 |
     20 | [191,199] |   24 |
     21 | [200,200] |  795 | **

```

Use it yourself by adding this to your postgres setup:

```
CREATE OR REPLACE FUNCTION histogram(table_name_or_subquery text, column_name text)
RETURNS TABLE(bucket int, "range" numrange, freq bigint, bar text)
AS $func$
BEGIN
RETURN QUERY EXECUTE format('
  WITH
  source AS (
    SELECT * FROM %s
  ),
  min_max AS (
    SELECT min(%s) AS min, max(%s) AS max FROM source
  ),
  histogram AS (
    SELECT
      width_bucket(%s, min_max.min, min_max.max, 20) AS bucket,
      numrange(min(%s)::numeric, max(%s)::numeric, ''[]'') AS "range",
      count(%s) AS freq
    FROM source, min_max
    WHERE %s IS NOT NULL
    GROUP BY bucket
    ORDER BY bucket
  )
  SELECT
    bucket,
    "range",
    freq::bigint,
    repeat(''*'', (freq::float / (max(freq) over() + 1) * 15)::int) AS bar
  FROM histogram',
  table_name_or_subquery,
  column_name,
  column_name,
  column_name,
  column_name,
  column_name,
  column_name,
  column_name
  );
END
$func$ LANGUAGE plpgsql;
```

Note:

1. You don't need to use a subquery - you can also just provide a table name as the first argument.
1. Subqueries are useful for sampling. For example, `(SELECT * FROM bigtable LIMIT 500 ORDER BY RANDOM()`. Don't forget parentheses!
1. You can call this as `SELECT histogram()` or `SELECT * FROM histogram()`. The latter form is much more legible!

Happy querying!

Learn how to create in-table histograms with PostgreSQL.

Tech