Skip to content
SEM Solutions

Keyword Research: A Practical Guide for Marketers

How to read search intent from the results page, build a seed list from Search Console and your customers, judge difficulty, cluster and prioritize keywords, map them to pages, and pick free or paid tools for the job.

Written by SEM Solutions Editorial Team

Published May 12, 2026

9 min read

Start with intent, then read the results page

Search volume tells you how many people type a phrase. It doesn't tell you what they want, and what they want decides which kind of page can rank. Before you judge any keyword, sort it by intent. Informational searches ask how or why, such as "how to clean a cast iron pan". Commercial investigation compares options, such as "project management software for agencies". Transactional searches are ready to act, such as "asana pricing" or "buy 12 inch cast iron skillet". Navigational searches look for a specific brand or site.

Intent labels in research tools help, but the most reliable signal is the results page itself. Search the keyword in a private window and look at what ranks. If the top ten are how-to articles, a product page will struggle there however well you optimize it. If they're category pages from retailers, a blog post is the wrong format. Note three things: the format (guide, list, product page, tool, video), the angle (beginner, comparison, price-led), and the features above the organic results, such as ads, a local map pack, video carousels, People Also Ask boxes or an AI Overview. Each of those pushes the first organic result further down the page and can reduce the clicks a top ranking brings.

Google's SEO starter guide makes a related point: people who know a topic well often search with different words from newcomers. The same need can show up under several phrasings, and reading the results is how you spot that two different-looking keywords are really one need.

Build a seed list from customers and your own data

Seed keywords are the short, broad terms that describe what you sell or know: "email templates", "dog training", "project management software". Most people pull seeds from memory. Better sources sit closer to the customer: the words people use in sales calls and support tickets, the questions they ask before buying, your site search log, the menus on competitors' sites and the categories in your own product.

Your best free source is Google Search Console, which shows real Google data for your own site. The Performance report lists the queries you appear for with clicks, impressions, click-through rate and average position, and Search Console keeps 16 months of data. Three filters are worth running every quarter. First, queries with plenty of impressions and an average position between about 5 and 20: Google already connects you with them, and a better page can move them onto page one. Second, queries a page ranks for that it wasn't written for, which often point to a new page. Third, queries that contain question words such as how, what, why and best, which feed FAQ sections and new articles.

Know the limits. Search Console only shows queries you already appear for, so it can't show what competitors rank for. Average position is the topmost position your site held, averaged across queries, so it blends locations and devices. Google also leaves out anonymized queries, very rare searches hidden to protect user privacy, and the interface shows up to 1,000 rows. On larger sites, the Search Console API or the bulk export gets you more of the data.

Expand the list and treat volumes as estimates

Feed your seeds into research tools to find variations, questions and related terms. Google offers two free starting points. Keyword Planner, inside Google Ads, suggests related keywords with monthly search estimates and ad cost estimates; Google asks you to finish account setup, including billing information, before it will generate new keyword ideas. Google Trends shows interest over time on a 0 to 100 scale, based on a topic's share of all searches in that place and period. It's good for seasonality and for comparing two phrasings, but it doesn't show absolute volume.

Suggestion tools fill in the long tail. Google's autocomplete and People Also Ask boxes show how people phrase questions, and WordStream's free keyword tool returns related terms without a paid account. AnswerThePublic arranges suggestions around question words and prepositions, with paid plans from $13.33 a month on annual billing.

Treat every volume figure as an estimate. Keyword Planner's average monthly searches include close variants of a keyword, and third-party tools build their numbers with their own models, so the same phrase can show different volumes in different tools. Use volume to compare keywords inside one tool. Don't read it as a traffic forecast.

Judge difficulty against the real results

Difficulty scores are a useful first filter. Semrush, for example, scores keyword difficulty from 0 to 100 using the median number of referring domains pointing to the ranking URLs, the dofollow to nofollow ratio of those links, the median authority of the ranking domains and the features on the results page. It groups scores into bands: 0 to 14 is very easy, 15 to 29 easy, 30 to 49 possible, 50 to 69 difficult, 70 to 84 hard and 85 to 100 very hard. Other tools use other formulas, so a 40 in one tool and a 40 in another don't mean the same thing. Pick one tool and stick with its scale.

Because these scores lean on links, they miss other things that decide rankings. Before you rule out a hard keyword or commit to an easy one, open the results and check three things. Do the ranking pages match the intent closely, or are they near misses that a focused page could beat? Are they current, or years out of date? Are the ranking sites similar to yours in size and topic, or are they major publishers and marketplaces? A keyword scored as difficult where the top pages are thin or off-topic can be more realistic than its score suggests. A low score where every result is a well-known brand's product page is a warning sign.

Cluster keywords and set priorities

A raw keyword list repeats itself. "Project management software for small teams", "small team project management tool" and "project management app for small business" usually describe one need, and one page can rank for all three. Writing a page for each splits your effort and can leave several of your own pages competing for the same results.

Cluster by the results, not by shared words. Two keywords belong together when Google ranks largely the same URLs for both. A common working rule is to group keywords that share several of their top ten results; choose a threshold that suits your niche and apply it consistently. For a few dozen keywords, a spreadsheet and a private browser window will do. For hundreds or thousands, use software. Semrush, Ahrefs and SE Ranking include clustering, and dedicated tools such as Keyword Insights, from $58 a month, and Keyword Cupid, from $9.99 a month, group large lists by results overlap.

Then rank the clusters. Score each from 1 to 5 on value (would a visitor from this search be close to something you sell, or worth reaching for your audience?), effort (how hard are the results to beat, and how much work is the page?) and fit (can you credibly write the best answer, with real expertise, examples or data?). Sort by the total. Push clusters where you already sit on page two toward the top, since Search Console shows Google already sees you as relevant. Small and new sites should favor specific, long-tail clusters with clear intent: they're easier to win, and the visitors are closer to a decision. Leave broad head terms for later, once you have supporting pages and links.

Map every cluster to one page

The keyword map is where research becomes a plan. Build a sheet with one row per cluster and columns for the primary keyword, supporting keywords, intent, target URL (existing or planned), page type, current position from Search Console and status.

Three rules keep the map clean. One cluster, one page: if two rows point at the same URL, merge them, and if one cluster has two URLs, pick one and consolidate or redirect the other. Match the page type to the results: list articles where lists rank, product or category pages where the results are transactional, and tools or calculators where tools rank. Check existing pages before planning new ones, because the fastest win is often improving a page that already ranks on page two.

On the page, use the primary keyword where it reads naturally: the title, the main heading, the URL and the opening paragraph. Cover supporting keywords as subheadings and direct answers. Google's starter guide says plainly that repeating the same words over and over is tiring for readers and that keyword stuffing is against its spam policies, and Google Search doesn't use the keywords meta tag at all. Link the pages within a topic to each other so readers and crawlers can follow it.

Review the map every quarter. Compare the queries each page actually gets in Search Console with the cluster it was built for. When a page draws impressions for a different intent, update it or give that intent its own page.

Free and paid keyword research tools

Free tools take you a long way. Google Search Console, Keyword Planner, Google Trends and autocomplete cover your own data, rough demand and real phrasing. Ahrefs offers a free tier, Ahrefs Webmaster Tools, with keyword and backlink views for sites you verify, and Semrush's free account allows 10 queries a day in tools such as Keyword Research and Domain Overview. That's enough to check a handful of keywords in one sitting.

A paid tool earns its cost when you need competitor research (which keywords another site ranks for), large lists with difficulty scores, and clustering. Entry points in our directory include Ubersuggest at $16 a month on annual billing, Ahrefs Starter at $29 a month, SpyFu Basic at $39, Moz Pro's Starter plan and Mangools Basic at $49 each, and Keyword Tool's Starter plan at $68. Full suites cost more. Ahrefs Lite and SE Ranking's Core plan are $129 a month and Semrush's SEO plan is $139, each combining keyword research with rank tracking, site audits and backlink data.

Our keyword research subcategory is ordered by our Overall Score, half Editor Rating and half Market Signal, the 0-100 score we build from Ahrefs and Semrush data. On the data through September 2026, Semrush has the highest Market Signal there, followed by WordStream's free tools and Ahrefs. That ranking measures market footprint. Whether a tool's keyword database covers your country and language well is something to test in a free tier or trial before you pay, by checking its numbers for your own site against Search Console.

Frequently Asked Questions

How many keywords should a single page target?⌄

One primary keyword plus the variations that share its intent and its top-ranking pages. There's no fixed number: a well-clustered page can rank for dozens of related phrases without being written for each one. If two keywords return mostly different results, they usually need different pages.

Are keyword difficulty scores comparable across tools?⌄

No. Each tool calculates difficulty with its own formula, usually built from the links pointing to the pages that rank. Semrush, for example, uses a 0 to 100 scale with bands from very easy to very hard. Use one tool's score consistently and confirm it by looking at the actual results page.

Should I target keywords with zero reported search volume?⌄

Often, yes, if the intent is clear and the phrase matches what your customers say. Volume figures are estimates and tend to miss newer and very specific searches. Cover such phrases inside a page you're already planning instead of giving each one its own page.

Can I do keyword research with only free tools?⌄

Yes, for a small site. Google Search Console shows the queries you already appear for, Keyword Planner and Google Trends show rough demand and seasonality, and Ahrefs Webmaster Tools and Semrush's free account (10 queries a day) add limited third-party data. Paid tools become worth it when you need regular competitor research or clustering of large lists.

How often should I redo keyword research?⌄

Review your keyword map every quarter using fresh Search Console data, and do a full round of research when you launch a new product, enter a new market, or see a page's traffic fall. Intent and the layout of results pages change over time, so a page built for one intent can drift.

Sources

  1. developers.google.com/search/docs/fundamentals/seo-starter-guide
  2. support.google.com/webmasters/answer/7576553
  3. support.google.com/webmasters/answer/7042828
  4. developers.google.com/search/blog/2022/10/performance-data-deep-dive
  5. support.google.com/google-ads/answer/7337243
  6. support.google.com/google-ads/answer/3022575
  7. support.google.com/trends/answer/4365533
  8. semrush.com/kb/1158-what-is-kd
  9. semrush.com/blog/what-can-i-do-with-a-free-account-from-semrush
  10. ahrefs.com/webmaster-tools
  11. ahrefs.com/pricing
Last updated: October 12, 2026

Published May 12, 2026

Related Categories