Programs

# Apriori Algorithm: How Does it Work? How Brands Can Utilize Apriori Algorithm?

Imagine youâ€™re at the supermarket, and in your mind, you have the items you wanted to buy. But you end up buying a lot more than you were supposed to. This is called impulsive buying and brands use the apriori algorithm to leverage this phenomenon. Click to learn more if you are interested to learn more about data science algorithms.

What is this algorithm? And how does it work? Youâ€™ll find the answers to these questions in this article. Weâ€™ll first take a look at what this algorithm is and then at how it works.

Letâ€™s begin.Â

## What is the Apriori Algorithm?

The apriori algorithm gives you frequent itemsets. Its basis is the apriori property which we can explain in the following way:

Suppose an item set you have has a support value less than the necessary support value. Then, the subsets of this itemset would also have less support value than required. So, you wonâ€™t include them in your calculation and as a result, save a lot of space.Â

Support value refers to the number of times a particular itemset appears in transactions. The apriori algorithm is quite popular due to its application in recommendation systems. Generally, youâ€™ll apply this algorithm to transactional databases, which means, a database of transactions. There are many real-world applications of this algorithm as well. You should also make yourself familiar with Association Rule Mining to understand the apriori algorithm properly.Â

## How does the Apriori Algorithm Work?

The apriori algorithm generates association rules by using frequent itemsets. Its principle is simple – the subset of a frequent itemset would also be a frequent itemset. An itemset that has a support value greater than a threshold value is a frequent itemset. Consider the following data:

 TID Items T1 1 3 4 T2 2 3 5 T3 1 2 3 5 T4 2 5 T5 1 3 5

In the first iteration, suppose the support value is two and make the itemsets with size 1. Now calculate their support values accordingly. We would discard the item which would have a support value lower than the minimum one. In this example, that would be item number four.Â

C1 (Result of the first iteration)

 Itemset Support {1} 3 {2} 3 {3} 4 {4} 1 {5} 4

 Itemset Support {1} 3 {2} 3 {3} 4 {5} 4

In the second iteration, weâ€™ll keep the size of the itemsets two and then calculate the support values. Weâ€™ll use all the combinations of table F1 in this iteration. Weâ€™ll remove any itemsets that would have support values less than two.Â

C2 (Only has items present in F1)

 Itemset Support {1,2} 1 {1,3} 3 {1,5} 2 {2,3} 2 {2,5} 3 {3,5} 3

F2 (After we remove items that have support values lower than 2)

 Itemset Support {1,3} 3 {1,5} 2 {2,3} 2 {2,5} 3 {3,5} 3

Now, weâ€™ll perform pruning. In this case, weâ€™ll divide the itemsets of C3 into subsets and remove the ones that have a support value lower than two.Â

C3 (After we perform pruning)

 Itemset In F2? {1,2,3}, {1,2}, {1,3}, {2,3} NO {1,2,5}, {1,2}, {1,5}, {2,5} NO {1,3,5}, {1,5}, {1,3}, {3,5} YES {2,3,5}, {2,3}, {2,5}, {3,5} YES

In the third iteration, weâ€™ll discard {1,2,5} and {1,2,3} as they both have {1,2}. This is the main impact of the apriori algorithm.Â

F3 (After we discard {1,2,5} and {1,2,3})

 Itemset Support {1,3,5} 2 {2,3,5} 2

## Explore our Popular Data Science Courses

 Executive Post Graduate Programme in Data Science from IIITB Professional Certificate Program in Data Science for Business Decision Making Master of Science in Data Science from University of Arizona Advanced Certificate Programme in Data Science from IIITB Professional Certificate Program in Data Science and Business Analytics from University of Maryland Data Science Courses

In the fourth iteration, weâ€™ll use the sets of F3 to create C4. however, as the support value of C4 is lower than 2, we wouldnâ€™t proceed and the final itemset is F3.Â

C3Â

 Itemset Support {1,2,3,5} 1

Weâ€™ve got the following itemsets with F3:

For I = {1,3,5}, the subsets we have are {5}, {3}, {1}, {3,5}, {1,5}, {1,3}

For I = {2,3,5}, the subsets we have are {5}, {3}, {2}, {3,5}, {2,5}, {2,3}

## Explore our Popular Data Science Courses

 Executive Post Graduate Programme in Data Science from IIITB Professional Certificate Program in Data Science for Business Decision Making Master of Science in Data Science from University of Arizona Advanced Certificate Programme in Data Science from IIITB Professional Certificate Program in Data Science and Business Analytics from University of Maryland Data Science Courses

Now, weâ€™ll create and apply rules on the itemset F3. For that purpose, weâ€™ll assume that the minimum confidence value is currently 60%. For subsets S of I, hereâ€™s the rule we output:

• S -> (I,S) (this means S recommends I-S)
• If support(I) / support(S) >= min_conf value

Letâ€™s do this for the first subset we have, i.e., {1,3,5}

Rule no.1: {1,3} -> ({1,3,5} – {1,3}) this means 1 & 3-> 5

Confidence value = support value of (1,3,5) / support value of (1,3) = â…” = 66.66%

As the result is higher than 60%, we select Rule no.1.

Â

Rule no.2: {1,5} -> {(1,3,5) – {1,5}) this means 1 & 5 -> 3

Confidence value = support value of (1,3,5) / support value of (1,5) = 2/2 = 100%

As the result is higher than 60%, we select Rule no.2.

Rule no.3: {3} -> ({1,3,5} – {3}) this means 3 -> 1 & 5

Confidence value = support value of (1,3,5) / support value of (3) = 2/4 = 50%

As the result is lower than 60%, we reject Rule no.3.

upGrad’s Exclusive Data Science Webinar for you –

Watch our Webinar on The Future of Consumer Data in an Open Data Economy

Earn data science courses from the Worldâ€™s top Universities. Join our Executive PG Programs, Advanced Certificate Programs, or Masters Programs to fast-track your career.

## Read our popular Data Science Articles

 Data Science Career Path: A Comprehensive Career Guide Data Science Career Growth: The Future of Work is here Why is Data Science Important? 8 Ways Data Science Brings Value to the Business Relevance of Data Science for Managers The Ultimate Data Science Cheat Sheet Every Data Scientists Should Have Top 6 Reasons Why You Should Become a Data Scientist A Day in the Life of Data Scientist: What do they do? Myth Busted: Data Science doesnâ€™t need Coding Business Intelligence vs Data Science: What are the differences?

With the example above, you can see how the Apriori algorithm creates and applies rules. You can follow these steps for the second item set ({2,3,5}) we have. Trying it out will surely give you a great experience in understanding what rules the algorithm accepts and which ones it rejects. The algorithm remains the same in other places such as the Apriori algorithm Python.Â

## Top Data Science Skills to Learn

 Top Data Science Skills to Learn 1 Data Analysis Course Inferential Statistics Courses 2 Hypothesis Testing Programs Logistic Regression Courses 3 Linear Regression Courses Linear Algebra for Analysis

## Conclusion

After reading this article, weâ€™re sure that youâ€™d be quite familiar with this algorithm and its application. Due to its use in recommendation systems, it has become quite popular as well.Â

## Is there a more efficient algorithm than the Apriori algorithm?

The ECLAT (Equivalence Class Clustering and bottom-up Lattice Traversal) algorithm is found to be a pretty useful and popular one for association rule mining. On top of that, it is also known to be a more efficient and faster algorithm as compared to the Apriori algorithm.

The Apriori algorithm works in a horizontal manner as it imitates the Breadth-First Search of a Graph, while the ECLAT algorithm works in a vertical manner by imitating the Depth-First Search of a Graph. This vertical approach is the reason behind the faster speed and better efficiency of the ECLAT algorithm as compared to the Apriori algorithm.

## Apriori algorithm is useful for what purpose?

Apriori algorithm is a classic algorithm that is widely used in data mining. It is really useful for mining relevant association rules and also frequent itemsets from the available database. Usually, this algorithm is utilized by organizations that have to handle a database consisting of plenty of transactions. For instance, the apriori algorithm makes it pretty easy to determine the items that customers frequently buy from your store. The market sales can be highly improved with the help of this algorithm.

Other than that, this algorithm is also utilized in the healthcare sector for detecting adverse drug reactions. The algorithm produces association rules to determine all the combinations of patient characteristics and medications that could lead to adverse drug reactions.

## What are the pros and cons of the Apriori algorithm?

Apriori algorithm is pretty easy to implement, understand and can be used very efficiently on large itemsets. Sometimes, there might be a need to find a large number of candidate rules, and this process could be a bit computationally expensive. As it has to go through the entire database, it is also expensive to calculate the support.

## Prepare for a Career of the Future

PG DIPLOMA FROM IIIT-B, 100+ HRS OF CLASSROOM LEARNING, 400+ HRS OF ONLINE LEARNING & 360 DEGREES CAREER SUPPORT