optimizing your site for 5 things that search engine cannot see

How do you identify problems with your site which search engines fail to see and leads to search spiders missing indexing your site.
Problem 1 For example here is a simple scenario “ your webmaster is working on a site on a staging server"as  you don't want the search engine to see this page which as they are duplicate versions of your page  which you normally keep on a staging server which is keept as "NoIndex" This is something that search engines cannot see
Normally when you move the site from the staging server to the live server you should remove the NoIndex tags. However in case you forget removing the Noindex , you will see phenomenal drop in traffic .

Problem 2 : Some webmasters implement robot.txt that prohibits crawling of your site in the staging server. If this site gets copied over when the site is switched to live server , the consequences will be just as bad as the NoIndex example

Problem3 : A key difference between a person using a browser and a search engine spider is that the person can manually type a URL into the browser window and retrieve the page the URL points to. Search engine crawlers lack this capability.Instead, they’re forced to rely on links they find on Web pages to find other pages. This is one of the reason why inbound links are so very crucial 

Problem:4 Another technical problems which happens is when " search crawlers " encounters an object or file type that’s not a simple text document." Search engines are designed to index text and are highly optimized to perform search and retrieval operations on text. But they don’t do very well with nontextual data

Problem :5 The best way of understanding this and detecting this and taking appropriate action is to use an analytics software to find pages in your site that gets page views but no referring site traffic. Though this itself is not conclusive enough but it does provide a clue on what is going wrong in your site. The reverse of this situation is also true. If you see content on your site that is getting search referrals even though you don't want it or expect it, you may want to hide that content

Auditing what you have missed in search optimisation:Another data point which you can use to find if search engines are not able to see you content is check if your content is being picked up by search engines. For example if you have a site with 1000 pages with good inbound links and after 3 months you see only 20 pages are indexed thats enough clue that there is a problem

how google hummingbird was the precursor to semantic search revolution

HOW GOOGLE HUMMINGBIRD UPDATE STARTED THE SEMANTIC SEARCH REVOLUTION 

September 16th, 2013  was a  a watershed day in the history of search marketing, as Google dropped its Google Hummingbird Bombshell on  its knowledge graph as it announced that Google hummingbird was live and its search algorithm  undergone a dramatic makeover.

When hummingbird flew in, the old way of just matching up strings of characters in a search query  just went out of window. With its Hummingbird update Google changed  its core prowess from strings  to things and in the process it changed google from a search engine to a knowledge engine

The Need For Semantic Search:All  search engines compete among themselves to keep their search keywords more relevant  and in tune with users  actual intent. While a users input device might increase 10 times or 20 times, their intent does not change.. For any search engine its true test starts and begins with user intent  as it tries to understand the query itself and not only just the keywords and in the query. Once a semantic search  engine understands the context  and relevance..it will throw up the same results and meanings of their words as humans do

For example a search query "what is the height of Barrack Obama",  a conventional search engines will try to bring up pages which may have " stories on Obama, height of something, which might or might  not have any connection to Obama, news on American Presidents". This 

is a typical machine to machine learning in progress

However by  bringing on the human element ..where one user asks the other .. whats the height of Barrack Obama..Its being made amply clear  that we are interested  to know the height of the American President. This conversation is now aided by semantics

In terms of semantic search, The Hummingbird update takes the small but a significant step towards bridging the gap between machine led learning to human  based  learning. The best example of how Hummingbird update finally manages to bridge the semantic gap is this example shown below

A search for “pizza hut calories per slice” used to list an answer like this, Google said, but not one from Pizza Hut. However Now,  after the Google Hummingbird update it lists this answer directly from Pizza Hut itself, Google says. 

Google Hummingbird has been the precursor  to  start the  first Semantic search revolution. Semantic search technology seeks to extract entities from its databases as answers and displays personalised results based on the individuals personal  browsing habits

Hummingbird and Voice Search: Hummingbird paved the way for voice search by ability to search by speaking your query into search engine using a smartphone . The ability of the the search engine to understand spoken search queries by users intent and contextual meaning which are today used  in spoken conversation is an perfect application of using semantic technology across  search engines . 

Imagine being able to talk  to your computer the same way  you talk to your friend. 

"Hey I saw this awesome Oscar nominated bridge of spies.movie.. Why dont you watch it too? do you want me to find out wheres it playing at NJ "?

Semantic search is revolutionizing how people search because they can not merely  interact  by keywords but in conversational line . With mobile penetration burning up all records.. Voice based search is set to grow in numbers that will defy all expectations 

5 facts about rel=no follow attribute to keep in mind before optimizing your search

In 2005 all 3 search engines,Yahoo, Bing an google agreed to support an initiative to reduce the effectiveness of automated spam
Unlike the meta robots version of NoFollow, a new directive was employed as an attribute with within an or link tag to indicte the fact that the linking site " does not vouch for the quality of the linked page.

With In short the rel=nofollow tag was intended for search spiders not to pass on the link juice to the third party link which the website is linking to originally this enabled to " stop automated links appearing o blogs as comments, forums and other user generated content siteswhere links were liberally splashed around, to fool the search engine to crawl and pass on the usual benefits of the search benefits


 In due course of time" it was seen" most website owners used content from other sites, but used the tag rel=no follow" to stop the link juice flowing to the linked page. However google guidelines say that " only paid links" or links attained through dubious methods should be used as rel=noFollow tag. Google also says that " when linking a site " which is editorially good" you should not be using the " rel=no follow tag.


Please note that although the rel=noFollow tag is used to indicate search crawlers from passing on the linking benefits, it does not stop indexing the link( despite the lack of semantic logic)
You can implement the no Follow link as follows a <a href="http://www.onlinemarketing-trends.com/" rel="NoFollow">


In  2009, Matt Cutts wrote a post which suggests that" link juice " associated with NoFollowed link is discarded rather than reallocated , In theory you can still use rel=NoFollow  many times you want, however using it on internal links does not bring the type of benefit webmasters and seo preference which it once used to

One word of caution, is  using it many times across external links too many times,can be flagged as a site being overoptimized. the thumb rule here is out of 10 posts use no follow for 7 of them , while for posts which  you use from third parties" no do use rel=no Follow for sites which are editorially seen as very strong

10 duplicate content checker tools to prevent seo penalty

Here are some of the tools which will help you to filter out duplicate content issues and prevent SEO to crawl your site which it sees as duplicate and penalise the, . This list contains both paid and free tools

1. Duplichecker :Duplichecker free plagiarism checker search This free plagiarism checker tool allows you to conduct text searches, docx or Text file, and URL searches.

 2. Siteliner: Free Duplicate Content Checker  from Siteliner For checking entire websites for duplicate content.Simply paste your site’s URL in the box and it will scan for duplicate content, the SiteLiner premium service is very affordable (each page scanned only costs 1c),

 3. PlagSpotter :Free Plagiarism Checker Recommendation From Thrive .You can sign up for their no-cost 7 day trial to enjoy a plethora of useful features, including plagiarism monitoring, unlimited searches, batch searches, full site scans, and much more. PlagSpotter's paid version is extremely affordable.

 4)Moz Tool : quite handy  paid tool to understand,which content keywords or phrase is duplicated.

5) CopyScape : One of the most well known duplicate content checker for free from copyscape.CopyScape offers a free URL search, with duplicate content results coming in in just a few seconds.

6) Wordtracker Tool : This filters the duplicate  phrases and lets you import into a pdf file. It also helps you match a url that is stealing content from you site

7) Webconf : This tool will tell you the number of pages and the urls  which are duplicate content and the site results which has copied content from your site .Once your type the url in the content box, it allows you to determine the percentage of duplication similarity between two pages.)http://www.webconfs.com/similar-page-checker.php

 Free Tools 
 1. Duplichecker
2. Plagiarisma
3. Plagium