📊 Text Analysis Using Python 🧠

Text Analysis

Text analysis is one of the most important tasks in Natural Language Processing (NLP). It helps us understand, process, and extract useful insights from textual data such as articles, reviews, or social media posts.

In this tutorial, we will create a simple text analysis project using Python. This project will analyze a text and provide insights like:

• 📌 Total number of words
• 📌 Number of unique words
• 📌 Most frequently used words

Even beginners can easily follow along. Let’s get started! 🚀

🧰 Requirements

To run this project, you only need Python installed on your system. We will use two built-in Python libraries:

• re – for text cleaning using regular expressions
• collections.Counter – for counting word frequency

No external libraries are required. 👍

📝 Step 1: Import Required Libraries

First, we import the necessary modules.

• Counter helps count occurrences of words.
• re is used to clean the text by removing punctuation and symbols.

📄 Step 2: Create Sample Text

Next, we define a small paragraph that we want to analyze.

sample text

This text will be used for our analysis.

🧹 Step 3: Clean the Text

Before analyzing text, we should remove punctuation and convert everything to lowercase.

This step ensures that words like AI, ai, and Ai are treated the same.

🔤 Step 4: Convert Text into Words

Now we split the cleaned text into individual words.

This creates a list of all words in the text.

📊 Step 5: Perform Text Analysis

Now we calculate different statistics from the text.

Here’s what each part does:

• word_count → Total number of words
• unique_words → Number of distinct words
• most_common(5) → Top 5 frequently used words

💻 Complete Python Code

Below is the complete working code for the project.

Get Nazish Javeed’s stories in your inbox

Join Medium for free to get updates from this writer.

Remember me for faster sign in

# 📊 Text Analysis Using Python 🧠

from collections import Counter
import re

text = “””
Artificial Intelligence is transforming the world.
AI makes machines smart and helps humans solve complex problems.
“””

# 🔹 Clean text
clean_text = re.sub(r’[^a-zA-Z\s]’, ‘’, text.lower())

# 🔹 Word list
words = clean_text.split()

# 🔹 Word count
word_count = len(words)

# 🔹 Unique words
unique_words = len(set(words))

# 🔹 Most common words
common_words = Counter(words).most_common(5)

print(“📌 Total Words:”, word_count)
print(“📌 Unique Words:”, unique_words)
print(“📌 Most Common Words:”, common_words)

📈 Example Output

When you run the code, you may see an output like this:

🌟 Why Text Analysis is Important

Text analysis is widely used in many applications:

• 📊 Sentiment Analysis (analyzing reviews or opinions)
• 📰 News Classification
• 💬 Chatbots and Virtual Assistants
• 📧 Spam Email Detection
• 📚 Document Summarization

It is a fundamental step in Natural Language Processing (NLP).

🚀 Conclusion

In this tutorial, we built a simple text analysis tool using Python. We learned how to:

✔ Clean text using regular expressions
✔ Split text into words
✔ Count total and unique words
✔ Find the most common words

This is just the beginning! You can extend this project by adding:

• 📊 Word frequency visualization
• 🧠 Sentiment analysis
• ☁ Processing large text datasets

Python makes text analysis simple, powerful, and fun.

🚀 Conclusion

In this tutorial, we built a simple text analysis tool using Python. We learned how to:

✔ Clean text using regular expressions
✔ Split text into words
✔ Count total and unique words
✔ Find the most common words

This is just the beginning! You can extend this project by adding:

• 📊 Word frequency visualization
• 🧠 Sentiment analysis
• ☁ Processing large text datasets

Python makes text analysis simple, powerful, and fun.